00000001:02000400:2.0F:1788459778.494045:0:3317:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg605-server.virtnet: executing set_hostid 00000001:02000400:0.0F:1788459796.006533:0:3537:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg605-server.virtnet: executing load_modules_local 00000001:01000000:0.0:1788459797.751416:0:3599:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 517 MB/s 00000001:01000000:1.0F:1788459798.007354:0:3599:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 492 MB/s 00000001:01000000:0.0:1788459798.257068:0:3599:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4811 MB/s 00000020:02000000:2.0:1788459799.022318:0:3628:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_7_g065ac5e 00000400:02000000:3.0F:1788459799.852360:0:3643:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.206.105@tcp [8/256/0/180] 00008000:02000000:1.0:1788459803.363064:0:3793:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1788459858.722430:0:5760:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg605-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788459871.884566:0:6510:0:(obd_mount.c:1011:lmd_print()) mount data: 00000020:01000004:2.0:1788459871.884572:0:6510:0:(obd_mount.c:1014:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1788459871.884573:0:6510:0:(obd_mount.c:1017:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788459871.885828:0:6510:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000005294716a 00000080:02000400:2.0:1788459871.885840:0:6510:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1788459871.907609:0:6510:0:(tgt_mount.c:2642:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1788459871.907621:0:6510:0:(obd_mount.c:308:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788459871.908320:0:6510:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000000a97fc4f) 00000020:00000080:3.0:1788459871.908341:0:6510:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788459871.974978:0:6510:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1788459871.975044:0:6510:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:2.0:1788459871.992606:0:6510:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788459871.992861:0:6510:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788459871.992868:0:6510:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788459871.992878:0:6510:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5dfa74784542a8b0 00000020:01000004:2.0:1788459871.992884:0:6510:0:(tgt_mount.c:2727:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1788459871.992889:0:6510:0:(tgt_mount.c:234:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788459871.992893:0:6510:0:(tgt_mount.c:115:server_register_mount()) register mount 000000005294716a from MGS 00000020:01000004:2.0:1788459871.992897:0:6510:0:(obd_mount.c:308:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788459871.992914:0:6510:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000c84850ac) 00000020:00000080:2.0:1788459871.992925:0:6510:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788459871.993047:0:6510:0:(tgt_mount.c:167:server_get_mount()) get mount 000000005294716a from MGS, refs=2 00080000:01000000:2.0:1788459871.993053:0:6510:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788459871.993058:0:6510:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5dfa74784542a8be 00000100:00100000:2.0:1788459871.993152:0:6510:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788459871.993275:0:6510:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788459871.993281:0:6510:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788459871.994164:0:6510:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788459871.994172:0:6510:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788459871.994939:0:6510:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788459871.995267:0:6510:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788459871.995272:0:6510:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788459871.999045:0:6510:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788459871.999060:0:6510:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788459871.999442:0:6510:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1788459871.999448:0:6510:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1788459872.000077:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788459872.000080:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788459872.000082:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788459872.000287:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788459872.000289:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788459872.000291:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788459872.001079:0:6510:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1788459872.005027:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1788459872.251316:0:6510:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 1975 MB/s 00000001:01000000:2.0:1788459872.501002:0:6510:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2931 MB/s 00000001:01000000:2.0:1788459872.751238:0:6510:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 535 MB/s 00000001:01000000:0.0:1788459873.003444:0:6510:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 567 MB/s 00080000:10000000:0.0:1788459873.018362:0:6510:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:3.0:1788459873.041808:0:6510:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1788459873.043973:0:6524:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788459873.044060:0:6510:0:(mgs_nids.c:693:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788459873.044101:0:6510:0:(mgs_llog.c:690:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1788459873.044271:0:6510:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1788459873.044293:0:6510:0:(mgs_llog.c:690:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788459873.044610:0:6510:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788459873.045042:0:6510:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788459873.045048:0:6510:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788459873.046409:0:6510:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788459873.046421:0:6510:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00010000:00010000:3.0:1788459873.046711:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788459873.052883:0:6510:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788459873.052897:0:6510:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788459873.055815:0:6510:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788459873.055839:0:6510:0:(obd_mount.c:496:lustre_start_mgc()) Start MGC 'mgc192.168.206.105@tcp' 00000020:01000004:3.0:1788459873.055841:0:6510:0:(obd_mount.c:505:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788459873.055898:0:6510:0:(obd_mount.c:308:lustre_start_simple()) Starting OBD mgc192.168.206.105@tcp (typ=mgc) 00000020:00000080:3.0:1788459873.055909:0:6510:0:(genops.c:413:class_newdev()) Allocate new device mgc192.168.206.105@tcp (0000000076971d71) 00000020:00000080:3.0:1788459873.055924:0:6510:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788459873.056033:0:6510:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000026b10f40@mgc192.168.206.105@tcp: add connection 192.168.206.105@tcp at head 00000100:00080000:1.0:1788459873.057665:0:6529:0:(pinger.c:473:ping_evictor_main()) Starting Ping Evictor 00010000:00010000:3.0:1788459873.058674:0:6510:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mgc192.168.206.105@tcp-0 is initialized 00000040:01000000:3.0:1788459873.058684:0:6510:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.206.105@tcp ctxt 1 is initialized 10000000:01000000:0.0:1788459873.061481:0:6530:0:(mgc_request.c:900:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1788459873.061576:0:6510:0:(obd_config.c:826:class_setup()) finished setup of obd mgc192.168.206.105@tcp (uuid 0cf73fe6-82e2-434e-b670-631647721b2c) 00000020:00000080:3.0:1788459873.061598:0:6510:0:(genops.c:1385:class_connect()) connect: client 0cf73fe6-82e2-434e-b670-631647721b2c, cookie 0x5dfa74784542a8cc 00000100:00080000:3.0:1788459873.061611:0:6510:0:(import.c:545:import_select_connection()) mgc192.168.206.105@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788459873.061616:0:6510:0:(import.c:665:import_select_connection()) mgc192.168.206.105@tcp: import 0000000026b10f40 using connection 192.168.206.105@tcp/0@lo 00000100:00100000:3.0:1788459873.061660:0:6510:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000754ca42b x1875336022196352/t0(0) o250->mgc192.168.206.105@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788459873.061689:0:6510:0:(pinger.c:380:ptlrpc_pinger_add_import()) adding pingable import 0cf73fe6-82e2-434e-b670-631647721b2c->MGS 00000020:01000004:3.0:1788459873.061708:0:6510:0:(tgt_mount.c:1939:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1788459873.061712:0:6510:0:(obd_mount.c:308:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1788459873.061734:0:6510:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000eb0ea6d0) 00000020:00000080:3.0:1788459873.061745:0:6510:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1788459873.062674:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000754ca42b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0cf73fe6-82e2-434e-b670-631647721b2c:3658:1875336022196352:0@lo:250: 00000100:00100000:0.0:1788459873.062760:0:3658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459873.062862:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022196352 00000100:00100000:0.0:1788459873.062870:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022196352 00000100:00100000:0.0:1788459873.063136:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788459873.063142:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d462f1b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3658:x1875336022196352:12345-0@lo:250: 00010000:00080000:0.0:1788459873.063247:0:6525:0:(ldlm_lib.c:1461:target_handle_connect()) MGS: connection from 0cf73fe6-82e2-434e-b670-631647721b2c@0@lo t0 exp 0000000000000000 cur 170 last 0 00000020:00000080:0.0:1788459873.063284:0:6525:0:(genops.c:1385:class_connect()) connect: client 0cf73fe6-82e2-434e-b670-631647721b2c, cookie 0x5dfa74784542a8da 00000100:00080000:0.0:1788459873.063415:0:6525:0:(import.c:65:import_set_state_nolock()) 000000009ac47536 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788459873.063470:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d462f1b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+5:3658:x1875336022196352:12345-0@lo:250: Request processed in 327us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459873.063478:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788459873.063524:0:3658:0:(client.c:3126:ptlrpc_free_committed()) mgc192.168.206.105@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1788459873.063532:0:3658:0:(import.c:1176:ptlrpc_connect_interpret()) mgc192.168.206.105@tcp: connect to target with instance 0 00000100:00080000:0.0:1788459873.064641:0:3658:0:(import.c:1000:ptlrpc_connect_set_flags()) mgc192.168.206.105@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788459873.064650:0:3658:0:(mgc_request.c:1476:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788459873.064653:0:3658:0:(import.c:65:import_set_state_nolock()) 0000000026b10f40 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788459873.064655:0:3658:0:(mgc_request.c:1476:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788459873.064664:0:3658:0:(pinger.c:193:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788459873.064671:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000754ca42b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0cf73fe6-82e2-434e-b670-631647721b2c:3658:1875336022196352:0@lo:250: 00000100:00100000:3.0:1788459873.088590:0:6510:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788459873.092521:0:6510:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1788459873.092535:0:6510:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788459873.101836:0:6510:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788459873.101849:0:6510:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1788459873.105276:0:6510:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1788459873.105323:0:6510:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1788459873.118653:0:6510:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788459873.120155:0:6510:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1788459873.120233:0:6510:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788459873.127151:0:6510:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788459873.127182:0:6510:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1788459873.197546:0:6510:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788459873.198326:0:6510:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788459873.198335:0:6510:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1788459873.207304:0:6510:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1788459873.207318:0:6510:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788459873.209333:0:6510:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788459873.209505:0:6510:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788459873.209511:0:6510:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1788459873.210925:0:6510:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788459873.210935:0:6510:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1788459873.212139:0:6510:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788459873.214470:0:6510:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788459873.214478:0:6510:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788459873.216356:0:6510:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788459873.216367:0:6510:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788459873.217211:0:6510:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788459873.217392:0:6510:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788459873.217397:0:6510:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788459873.224263:0:6510:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788459873.224284:0:6510:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788459873.273168:0:6510:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788459873.273394:0:6510:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788459873.273401:0:6510:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788459873.276748:0:6510:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788459873.276761:0:6510:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788459873.282524:0:6510:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788459873.282647:0:6510:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1788459873.297930:0:6510:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1788459873.298023:0:6510:0:(tgt_mount.c:1519:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.105@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1788459873.298029:0:6510:0:(tgt_mount.c:1239:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788459873.298030:0:6510:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788459873.298031:0:6510:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788459873.298032:0:6510:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:2.0:1788459873.298034:0:6510:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788459873.298035:0:6510:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788459873.298036:0:6510:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788459873.298037:0:6510:0:(tgt_mount.c:1250:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788459873.298038:0:6510:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788459873.298039:0:6510:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788459873.298041:0:6510:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788459873.298042:0:6510:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788459873.298045:0:6510:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1788459873.298054:0:6510:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788459873.298055:0:6510:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788459873.298056:0:6510:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788459873.298057:0:6510:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:2.0:1788459873.298057:0:6510:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788459873.298058:0:6510:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788459873.298059:0:6510:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788459873.298060:0:6510:0:(tgt_mount.c:1250:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788459873.298061:0:6510:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788459873.298062:0:6510:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788459873.298062:0:6510:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788459873.298063:0:6510:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788459873.298104:0:6510:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788459873.298121:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000289815cf pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:6510:1875336022196480:0@lo:253: 00000100:00100000:2.0:1788459873.298210:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459873.298265:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b0403228 going to sleep for 11 seconds 00000100:00100000:0.0:1788459873.298594:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022196480 00000100:00100000:0.0:1788459873.298602:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022196480 00000100:00100000:0.0:1788459873.298655:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788459873.298663:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d2b4e715 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+5:6510:x1875336022196480:12345-0@lo:253: 20000000:01000000:0.0:1788459873.298726:0:6528:0:(mgs_llog.c:690:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788459873.298729:0:6528:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:0.0:1788459873.302899:0:6549:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1788459873.303076:0:6528:0:(mgs_nids.c:693:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1788459873.303360:0:6528:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788459873.306573:0:6550:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1788459873.307019:0:6528:0:(mgs_llog.c:690:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788459873.307024:0:6528:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1788459873.307029:0:6528:0:(mgs_llog.c:875:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1788459873.307032:0:6528:0:(mgs_llog.c:3618:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1788459873.307043:0:6528:0:(mgs_llog.c:3178:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1788459873.307235:0:6528:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788459873.307415:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1788459873.307429:0:6528:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788459873.307447:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1788459873.307463:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1788459873.307480:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1788459873.307533:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1788459873.307541:0:6528:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1788459873.307564:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1788459873.307570:0:6528:0:(mgs_llog.c:1545:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1788459873.307580:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1788459873.307585:0:6528:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1788459873.307596:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1788459873.307611:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1788459873.307637:0:6528:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1788459873.307642:0:6528:0:(mgs_llog.c:3178:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1788459873.307649:0:6528:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788459873.307978:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1788459873.307992:0:6528:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1788459873.308011:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1788459873.308025:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1788459873.308039:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1788459873.308048:0:6528:0:(mgs_llog.c:3135:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1788459873.308075:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1788459873.308083:0:6528:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1788459873.308097:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1788459873.308127:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1788459873.308145:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1788459873.308508:0:6528:0:(mgs_llog.c:3100:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1788459873.308544:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1788459873.308553:0:6528:0:(mgs_llog.c:1545:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1788459873.308567:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1788459873.308583:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1788459873.308634:0:6528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1788459873.308654:0:6528:0:(mgs_llog.c:3315:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1788459873.308660:0:6528:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1788459873.317806:0:6551:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1788459873.318785:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1788459873.318825:0:6528:0:(mgs_llog.c:3361:mgs_write_log_mdc_to_lmv()) add nid 192.168.206.105@tcp for mdt 20000000:01000000:3.0:1788459873.318828:0:6528:0:(mgs_llog.c:1545:record_base_raw()) lcfg (null) 0xcf005 192.168.206.105@tcp (null) (null) (null) 00000040:00080000:3.0:1788459873.318846:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1788459873.318866:0:6528:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1788459873.318883:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1788459873.318889:0:6528:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.206.105@tcp (null) (null) 00000040:00080000:3.0:1788459873.318902:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1788459873.318909:0:6528:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1788459873.318922:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1788459873.318938:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1788459873.319066:0:6528:0:(mgs_llog.c:5258:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788459873.319070:0:6528:0:(mgs_llog.c:4754:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788459873.319074:0:6528:0:(mgs_llog.c:4187:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788459873.319321:0:6528:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788459873.319323:0:6528:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788459873.321408:0:6552:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:1.0:1788459873.321810:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1788459873.321839:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:1.0:1788459873.321855:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:1.0:1788459873.321866:0:6528:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788459873.321868:0:6528:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788459873.322234:0:6553:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1788459873.322372:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1788459873.322391:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1788459873.322404:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:1.0:1788459873.322416:0:6528:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788459873.322418:0:6528:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:1.0:1788459873.322423:0:6528:0:(mgs_llog.c:5258:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1788459873.322426:0:6528:0:(mgs_llog.c:4754:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1788459873.322430:0:6528:0:(mgs_llog.c:5078:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1788459873.322435:0:6528:0:(mgs_llog.c:1385:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1788459873.323391:0:6554:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:1.0:1788459873.323510:0:6528:0:(mgs_llog.c:4126:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1788459873.345351:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:1.0:1788459873.345391:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:1.0:1788459873.345408:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:1.0:1788459873.345426:0:6528:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788459873.345450:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000f96bd10d/0x5dfa74784542a8e1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459873.345466:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f96bd10d/0x5dfa74784542a8e1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459873.345785:0:6528:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f96bd10d/0x5dfa74784542a8e1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459873.345801:0:6528:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f96bd10d/0x5dfa74784542a8e1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459873.345808:0:6528:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000f96bd10d/0x5dfa74784542a8e1 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459873.345814:0:6528:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000f96bd10d/0x5dfa74784542a8e1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459873.345820:0:6528:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f96bd10d already unused, calling callback (000000003e0ee701) 00010000:00010000:1.0:1788459873.345823:0:6528:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000f96bd10d/0x5dfa74784542a8e1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459873.345829:0:6528:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000f96bd10d/0x5dfa74784542a8e1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459873.345841:0:6528:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000f96bd10d/0x5dfa74784542a8e1 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459873.345866:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000f96bd10d/0x5dfa74784542a8e1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459873.345871:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f96bd10d/0x5dfa74784542a8e1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788459873.345887:0:6528:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788459873.357366:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d2b4e715 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+5:6510:x1875336022196480:12345-0@lo:253: Request processed in 58697us (59149us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459873.357387:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788459873.357490:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000289815cf pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:6510:1875336022196480:0@lo:253: 10000000:01000000:2.0:1788459873.357504:0:6510:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788459873.357508:0:6510:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788459873.357509:0:6510:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788459873.357511:0:6510:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788459873.357512:0:6510:0:(tgt_mount.c:1242:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1788459873.357513:0:6510:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788459873.357514:0:6510:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788459873.357515:0:6510:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788459873.357516:0:6510:0:(tgt_mount.c:1250:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788459873.357518:0:6510:0:(tgt_mount.c:1260:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788459873.357519:0:6510:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788459873.357520:0:6510:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788459873.357536:0:6510:0:(tgt_mount.c:115:server_register_mount()) register mount 000000005294716a from lustre-MDT0000 10000000:01000000:2.0:1788459873.357565:0:6510:0:(mgc_request.c:2423:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788459873.357568:0:6510:0:(mgc_request.c:424:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788459873.357572:0:6510:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8c4be2d81000 10000000:01000000:2.0:1788459873.357576:0:6510:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788459873.357595:0:6510:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-sptlrpc-ffff8c4be2d81000 from 1 10000000:01000000:2.0:1788459873.357599:0:6510:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788459873.357644:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: 00000000631cf243/0x5dfa74784542a8e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459873.357654:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: 00000000631cf243/0x5dfa74784542a8e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459873.357662:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: 00000000631cf243/0x5dfa74784542a8e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788459873.357681:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000289815cf pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:6510:1875336022196608:0@lo:101: 00000100:00100000:2.0:1788459873.357808:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459873.357853:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set 000000009e7bc1a4 going to sleep for 11 seconds 00000100:00100000:0.0:1788459873.358208:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022196608 00000100:00100000:0.0:1788459873.358215:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022196608 00000100:00100000:0.0:1788459873.358249:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788459873.358256:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000181673a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+5:6510:x1875336022196608:12345-0@lo:101: 00010000:00010000:0.0:1788459873.358269:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788459873.358283:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000090767814/0x5dfa74784542a8ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542a8e8 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459873.358302:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000090767814/0x5dfa74784542a8ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542a8e8 expref: 6 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459873.358312:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000090767814/0x5dfa74784542a8ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542a8e8 expref: 6 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459873.358319:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000090767814, rc 0) 00000100:00100000:0.0:1788459873.358366:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000181673a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+6:6510:x1875336022196608:12345-0@lo:101: Request processed in 111us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459873.358372:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788459873.358464:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000289815cf pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:6510:1875336022196608:0@lo:101: 00010000:00010000:1.0:1788459873.358479:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: 00000000631cf243/0x5dfa74784542a8e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542a8ef expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459873.358488:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: 00000000631cf243/0x5dfa74784542a8e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542a8ef expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788459873.358538:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c00b2f49 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:6510:1875336022196736:0@lo:501: 00000100:00100000:1.0:1788459873.358567:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459873.358597:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a62c6cac going to sleep for 11 seconds 00000100:00100000:0.0:1788459873.358630:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022196736 00000100:00100000:0.0:1788459873.358635:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022196736 00000100:00100000:0.0:1788459873.358675:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788459873.358681:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000041183690 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+6:6510:x1875336022196736:12345-0@lo:501: 00000100:00100000:0.0:1788459873.358760:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000041183690 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+6:6510:x1875336022196736:12345-0@lo:501: Request processed in 80us (193us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788459873.358767:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788459873.358883:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c00b2f49 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:6510:1875336022196736:0@lo:501: 10000000:01000000:3.0:1788459873.358897:0:6510:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788459873.359095:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: 00000000631cf243/0x5dfa74784542a8e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542a8ef expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459873.359104:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: 00000000631cf243/0x5dfa74784542a8e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542a8ef expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788459873.359111:0:6510:0:(mgc_request.c:206:do_config_log_add()) do adding config log params-ffff8c4be2d81000 10000000:01000000:2.0:1788459873.359180:0:6510:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788459873.359221:0:6510:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-barrier-ffff8c4be2d81000 10000000:01000000:2.0:1788459873.359224:0:6510:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788459873.359245:0:6510:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-barrier-ffff8c4be2d81000 from 1 10000000:01000000:2.0:1788459873.359248:0:6510:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788459873.359266:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: 000000002a403bfd/0x5dfa74784542a8f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459873.359273:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: 000000002a403bfd/0x5dfa74784542a8f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459873.359281:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: 000000002a403bfd/0x5dfa74784542a8f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788459873.359293:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ddbfac53 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:6510:1875336022196864:0@lo:101: 00000100:00100000:2.0:1788459873.359324:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459873.359386:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set 00000000de49441f going to sleep for 11 seconds 00000100:00100000:0.0:1788459873.359471:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022196864 00000100:00100000:0.0:1788459873.359477:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022196864 00000100:00100000:0.0:1788459873.359546:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788459873.359554:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005d4faac7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+6:6510:x1875336022196864:12345-0@lo:101: 00010000:00010000:0.0:1788459873.359564:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788459873.359573:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000efb514c2/0x5dfa74784542a8fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542a8f6 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459873.359590:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000efb514c2/0x5dfa74784542a8fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542a8f6 expref: 7 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459873.359599:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000efb514c2/0x5dfa74784542a8fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542a8f6 expref: 7 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459873.359605:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000efb514c2, rc 0) 00000100:00100000:0.0:1788459873.359644:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005d4faac7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+7:6510:x1875336022196864:12345-0@lo:101: Request processed in 92us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459873.359650:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788459873.359709:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ddbfac53 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:6510:1875336022196864:0@lo:101: 00010000:00010000:2.0:1788459873.359729:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: 000000002a403bfd/0x5dfa74784542a8f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542a8fd expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459873.359736:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: 000000002a403bfd/0x5dfa74784542a8f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542a8fd expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788459873.359748:0:6510:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788459873.359766:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: 000000002a403bfd/0x5dfa74784542a8f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542a8fd expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459873.359773:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: 000000002a403bfd/0x5dfa74784542a8f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542a8fd expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788459873.359778:0:6510:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788459873.359782:0:6510:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788459873.359824:0:6510:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-mdtir-ffff8c4be2d81000 10000000:01000000:2.0:1788459873.359828:0:6510:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788459873.359850:0:6510:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788459873.359853:0:6510:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788459873.359867:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: 000000004da08286/0x5dfa74784542a904 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459873.359873:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: 000000004da08286/0x5dfa74784542a904 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459873.359879:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: 000000004da08286/0x5dfa74784542a904 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788459873.359891:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ddbfac53 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:6510:1875336022196992:0@lo:101: 00000100:00100000:2.0:1788459873.359916:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459873.360318:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set 00000000de49441f going to sleep for 11 seconds 00000100:00100000:1.0:1788459873.360425:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022196992 00000100:00100000:1.0:1788459873.360432:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022196992 00000100:00100000:1.0:1788459873.360468:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788459873.360475:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000932de526 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+7:6510:x1875336022196992:12345-0@lo:101: 00010000:00010000:1.0:1788459873.360483:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788459873.360490:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f96bd10d/0x5dfa74784542a90b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542a904 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459873.360518:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f96bd10d/0x5dfa74784542a90b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542a904 expref: 8 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459873.360526:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f96bd10d/0x5dfa74784542a90b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542a904 expref: 8 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459873.360532:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f96bd10d, rc 0) 00000100:00100000:1.0:1788459873.360576:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000932de526 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+8:6510:x1875336022196992:12345-0@lo:101: Request processed in 102us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459873.360582:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788459873.360656:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ddbfac53 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:6510:1875336022196992:0@lo:101: 00010000:00010000:3.0:1788459873.360667:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: 000000004da08286/0x5dfa74784542a904 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542a90b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459873.360674:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: 000000004da08286/0x5dfa74784542a904 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542a90b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788459873.360715:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000adea08f1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:6510:1875336022197120:0@lo:501: 00000100:00100000:3.0:1788459873.360753:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459873.360776:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e49789c4 going to sleep for 11 seconds 00000100:00100000:1.0:1788459873.360830:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022197120 00000100:00100000:1.0:1788459873.360834:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022197120 00000100:00100000:1.0:1788459873.360851:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788459873.360855:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b76854cd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+8:6510:x1875336022197120:12345-0@lo:501: 00000100:00100000:1.0:1788459873.361337:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b76854cd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+9:6510:x1875336022197120:12345-0@lo:501: Request processed in 480us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459873.361344:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788459873.361568:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000adea08f1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:6510:1875336022197120:0@lo:501: 00000100:00100000:2.0:1788459873.361695:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ed37d469 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:6510:1875336022197248:0@lo:503: 00000100:00100000:2.0:1788459873.361737:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459873.361813:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set 000000005bfffd4b going to sleep for 11 seconds 00000100:00100000:1.0:1788459873.361850:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022197248 00000100:00100000:1.0:1788459873.361855:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022197248 00000100:00100000:1.0:1788459873.361921:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788459873.361928:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001dcd39c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+9:6510:x1875336022197248:12345-0@lo:503: 00000100:00100000:1.0:1788459873.362039:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001dcd39c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+9:6510:x1875336022197248:12345-0@lo:503: Request processed in 111us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459873.362046:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788459873.362119:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ed37d469 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:6510:1875336022197248:0@lo:503: 00000100:00100000:0.0:1788459873.362607:0:6555:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e066d1af pname:cluuid:pid:xid:nid:opc:job llog_process_th:0cf73fe6-82e2-434e-b670-631647721b2c:6555:1875336022197376:0@lo:502: 00000100:00100000:0.0:1788459873.362645:0:6555:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459873.362767:0:6555:0:(client.c:2716:ptlrpc_set_wait()) set 000000006bc9b0ab going to sleep for 11 seconds 00000100:00100000:2.0:1788459873.362836:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022197376 00000100:00100000:2.0:1788459873.362842:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022197376 00000100:00100000:2.0:1788459873.362866:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788459873.362872:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001a044757 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+9:6555:x1875336022197376:12345-0@lo:502: 00000100:00100000:2.0:1788459873.362983:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001a044757 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+9:6555:x1875336022197376:12345-0@lo:502: Request processed in 111us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459873.362990:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788459873.363126:0:6555:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e066d1af pname:cluuid:pid:xid:nid:opc:job llog_process_th:0cf73fe6-82e2-434e-b670-631647721b2c:6555:1875336022197376:0@lo:502: 00000020:01000000:0.0:1788459873.363147:0:6555:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788459873.363230:0:6555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788459873.363232:0:6555:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788459873.363239:0:6555:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1788459873.363242:0:6555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788459873.363262:0:6555:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000f49f0fb0) 00000020:00000080:0.0:1788459873.363277:0:6555:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1788459873.363283:0:6555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788459873.363370:0:6555:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788459873.363385:0:6555:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5dfa74784542a919 00000020:00000080:0.0:1788459873.363570:0:6555:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788459873.363575:0:6555:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788459873.363578:0:6555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788459873.363580:0:6555:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788459873.363583:0:6555:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788459873.363586:0:6555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788459873.363587:0:6555:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1788459873.363590:0:6555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788459873.363596:0:6555:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000be18b44b) 00000020:00000080:0.0:1788459873.363605:0:6555:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1788459873.363609:0:6555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788459873.363611:0:6555:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1788459873.363613:0:6555:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1788459873.363619:0:6555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788459873.363661:0:6555:0:(tgt_mount.c:167:server_get_mount()) get mount 000000005294716a from lustre-MDT0000, refs=3 00000020:00000080:0.0:1788459873.363670:0:6555:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000d5bc87c3) 00000020:00000080:0.0:1788459873.363677:0:6555:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1788459873.363736:0:6555:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788459873.363741:0:6555:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5dfa74784542a92e 00000020:00000080:0.0:1788459873.366372:0:6555:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1788459873.366386:0:6555:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788459873.366397:0:6555:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x5dfa74784542a935 00080000:01000000:0.0:1788459873.366405:0:6555:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788459873.366409:0:6555:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5dfa74784542a93c 00080000:10000000:0.0:1788459873.366818:0:6555:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:0.0:1788459873.367459:0:6555:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1788459873.379678:0:6555:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1788459873.515576:0:6555:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1788459873.516337:0:6555:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1788459873.518871:0:6555:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1788459873.519630:0:6555:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788459873.523666:0:6555:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000b38f5dc7) 00000020:00000080:3.0:1788459873.523692:0:6555:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788459873.523778:0:6555:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788459873.523786:0:6555:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5dfa74784542a94a 00000020:00000080:1.0:1788459873.524539:0:6555:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1788459873.526265:0:6555:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:3.0:1788459873.533331:0:6555:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:1.0:1788459873.538215:0:6555:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:1.0:1788459873.547102:0:6555:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:1.0:1788459873.564915:0:6555:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:1.0:1788459873.568364:0:6555:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:1.0:1788459873.577669:0:6555:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x5dfa74784542a951 00000020:00000080:2.0:1788459873.578922:0:6555:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788459873.578934:0:6555:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788459873.578960:0:6555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788459873.578963:0:6555:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788459873.578966:0:6555:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788459873.578971:0:6555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788459873.578972:0:6555:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788459873.578976:0:6555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788459873.578978:0:6555:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788459873.578980:0:6555:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788459873.578982:0:6555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788459873.578984:0:6555:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788459873.578986:0:6555:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788459873.578990:0:6555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788459873.578991:0:6555:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788459873.578994:0:6555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788459873.579037:0:6555:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:2.0:1788459873.579096:0:6555:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000532c7305 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0cf73fe6-82e2-434e-b670-631647721b2c:6555:1875336022197504:0@lo:502: 00000100:00100000:2.0:1788459873.579251:0:6555:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459873.579313:0:6555:0:(client.c:2716:ptlrpc_set_wait()) set 000000009953fd0d going to sleep for 11 seconds 00000100:00100000:0.0:1788459873.580018:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022197504 00000100:00100000:0.0:1788459873.580028:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022197504 00000100:00100000:0.0:1788459873.580084:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788459873.580092:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f48ff154 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+9:6555:x1875336022197504:12345-0@lo:502: 00000100:00100000:0.0:1788459873.580242:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f48ff154 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+9:6555:x1875336022197504:12345-0@lo:502: Request processed in 150us (990us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459873.580251:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788459873.581407:0:6555:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000532c7305 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0cf73fe6-82e2-434e-b670-631647721b2c:6555:1875336022197504:0@lo:502: 00000020:01000000:2.0:1788459873.581458:0:6555:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788459873.581466:0:6555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788459873.581468:0:6555:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:2.0:1788459873.581472:0:6555:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1788459873.581835:0:6510:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1788459873.581844:0:6510:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788459873.581867:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: 000000004da08286/0x5dfa74784542a904 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542a90b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459873.581877:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: 000000004da08286/0x5dfa74784542a904 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542a90b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788459873.581884:0:6510:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-mdtir-ffff8c4be2d81000 from 1 10000000:01000000:0.0:1788459873.581886:0:6510:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788459873.581932:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: 000000009aae6f4f/0x5dfa74784542a958 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459873.581940:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: 000000009aae6f4f/0x5dfa74784542a958 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459873.582756:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: 000000009aae6f4f/0x5dfa74784542a958 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788459873.582779:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e066d1af pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:6510:1875336022197632:0@lo:101: 00000100:00100000:0.0:1788459873.582862:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459873.582896:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a1af4287 going to sleep for 11 seconds 00000100:00100000:2.0:1788459873.583048:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022197632 00000100:00100000:2.0:1788459873.583056:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022197632 00000100:00100000:2.0:1788459873.583101:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788459873.583108:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000055ae93d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+9:6510:x1875336022197632:12345-0@lo:101: 00010000:00010000:2.0:1788459873.583120:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788459873.583135:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000071850f1d/0x5dfa74784542a95f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542a958 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459873.583221:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000071850f1d/0x5dfa74784542a95f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542a958 expref: 10 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459873.583232:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000071850f1d/0x5dfa74784542a95f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542a958 expref: 10 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459873.583240:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000071850f1d, rc 0) 00000100:00100000:2.0:1788459873.583282:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000055ae93d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+10:6510:x1875336022197632:12345-0@lo:101: Request processed in 174us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459873.583288:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788459873.583465:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e066d1af pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:6510:1875336022197632:0@lo:101: 00010000:00010000:1.0:1788459873.583480:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: 000000009aae6f4f/0x5dfa74784542a958 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542a95f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459873.583488:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: 000000009aae6f4f/0x5dfa74784542a958 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542a95f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788459873.585401:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009def55f3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:6510:1875336022197760:0@lo:256: 00000100:00100000:1.0:1788459873.585669:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459873.585754:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set 0000000049da44f5 going to sleep for 11 seconds 00000100:00100000:2.0:1788459873.585863:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022197760 00000100:00100000:2.0:1788459873.585871:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022197760 00000100:00100000:2.0:1788459873.586149:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788459873.586259:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002165b898 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+10:6510:x1875336022197760:12345-0@lo:256: 00000100:00100000:2.0:1788459873.586362:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002165b898 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+10:6510:x1875336022197760:12345-0@lo:256: Request processed in 107us (694us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788459873.586462:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009def55f3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:6510:1875336022197760:0@lo:256: 10000000:01000000:1.0:1788459873.587263:0:6510:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'lustre-mdtir' failed (-11). 00010000:00010000:1.0:1788459873.587273:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: 000000009aae6f4f/0x5dfa74784542a958 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542a95f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459873.587282:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: 000000009aae6f4f/0x5dfa74784542a958 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542a95f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788459873.587288:0:6510:0:(mgc_request.c:2375:mgc_process_log()) mgc192.168.206.105@tcp: IR log lustre-mdtir not ready yet: rc = -11 00010000:00010000:1.0:1788459873.587293:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: 000000009aae6f4f/0x5dfa74784542a958 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542a95f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459873.587300:0:6510:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: 000000009aae6f4f/0x5dfa74784542a958 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542a95f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459873.587317:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: 000000009aae6f4f/0x5dfa74784542a958 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5dfa74784542a95f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459873.587322:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mgc192.168.206.105@tcp lock: 000000009aae6f4f/0x5dfa74784542a958 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5dfa74784542a95f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459873.587430:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788459873.587455:0:6510:0:(mgc_request.c:2266:mgc_process_log()) Process log params-ffff8c4be2d81000 from 1 10000000:01000000:1.0:1788459873.587458:0:6510:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788459873.587493:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: 00000000d13efdbd/0x5dfa74784542a966 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459873.587500:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: 00000000d13efdbd/0x5dfa74784542a966 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459873.587509:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: 00000000d13efdbd/0x5dfa74784542a966 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788459873.587527:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009def55f3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:6510:1875336022197888:0@lo:101: 00000100:00100000:1.0:1788459873.587820:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459873.587861:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b664345b going to sleep for 11 seconds 00000100:00100000:0.0:1788459873.588046:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022197888 00000100:00100000:0.0:1788459873.588054:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022197888 00000100:00100000:0.0:1788459873.588101:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788459873.588109:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000002b138b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+11:6510:x1875336022197888:12345-0@lo:101: 00010000:00010000:0.0:1788459873.588121:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788459873.588135:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007170cb93/0x5dfa74784542a96d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542a966 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459873.588157:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007170cb93/0x5dfa74784542a96d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542a966 expref: 12 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459873.588167:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007170cb93/0x5dfa74784542a96d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542a966 expref: 12 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459873.588176:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007170cb93, rc 0) 00000100:00100000:0.0:1788459873.588218:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000002b138b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+12:6510:x1875336022197888:12345-0@lo:101: Request processed in 110us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459873.588225:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788459873.588273:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009def55f3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:6510:1875336022197888:0@lo:101: 00010000:00010000:0.0:1788459873.588289:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: 00000000d13efdbd/0x5dfa74784542a966 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542a96d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459873.588298:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: 00000000d13efdbd/0x5dfa74784542a966 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542a96d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788459873.588339:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002c4d0fad pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:6510:1875336022198016:0@lo:501: 00000100:00100000:0.0:1788459873.588377:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459873.588395:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set 000000008fbf7595 going to sleep for 11 seconds 00000100:00100000:0.0:1788459873.588408:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022198016 00000100:00100000:0.0:1788459873.588412:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022198016 00000100:00100000:0.0:1788459873.588429:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788459873.588434:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008f2cfeb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+12:6510:x1875336022198016:12345-0@lo:501: 00000100:00100000:0.0:1788459873.588832:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008f2cfeb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+12:6510:x1875336022198016:12345-0@lo:501: Request processed in 397us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459873.588840:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788459873.588906:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002c4d0fad pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:6510:1875336022198016:0@lo:501: 00000100:00100000:0.0:1788459873.588978:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002c4d0fad pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:6510:1875336022198144:0@lo:503: 00000100:00100000:0.0:1788459873.589017:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459873.589032:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set 000000008fbf7595 going to sleep for 11 seconds 00000100:00100000:0.0:1788459873.589046:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022198144 00000100:00100000:0.0:1788459873.589049:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022198144 00000100:00100000:0.0:1788459873.589066:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788459873.589071:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000034bf74c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+12:6510:x1875336022198144:12345-0@lo:503: 00000040:00080000:0.0:1788459873.589100:0:6528:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788459873.589136:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000034bf74c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+12:6510:x1875336022198144:12345-0@lo:503: Request processed in 64us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459873.589142:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788459873.589181:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002c4d0fad pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:6510:1875336022198144:0@lo:503: 00000100:00100000:2.0:1788459873.589486:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1788459873.590643:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788459873.590652:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: 000000009aae6f4f/0x5dfa74784542a958 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5dfa74784542a95f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459873.590663:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000009aae6f4f already unused, calling callback (000000000de01725) 10000000:00010000:3.0:1788459873.590666:0:6521:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: 000000009aae6f4f/0x5dfa74784542a958 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5dfa74784542a95f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459873.590675:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: 000000009aae6f4f/0x5dfa74784542a958 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x5dfa74784542a95f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788459873.590681:0:6521:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: 000000009aae6f4f/0x5dfa74784542a958 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x5dfa74784542a95f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788459873.590699:0:6521:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000040:00080000:1.0:1788459873.590981:0:6559:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00010000:00010000:3.0:1788459873.591166:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.206.105@tcp lock: 000000009aae6f4f/0x5dfa74784542a958 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5dfa74784542a95f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459873.591174:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788459873.591196:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: 000000009aae6f4f/0x5dfa74784542a958 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5dfa74784542a95f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459873.591202:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: 000000009aae6f4f/0x5dfa74784542a958 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5dfa74784542a95f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459873.591218:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788459873.591220:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788459873.591221:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788459873.591331:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000aad7bfed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0cf73fe6-82e2-434e-b670-631647721b2c:3660:1875336022198272:0@lo:103: 00000100:00100000:1.0:1788459873.591382:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459873.591463:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022198272 00000100:00100000:3.0:1788459873.591469:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022198272 00000100:00100000:3.0:1788459873.591511:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788459873.591517:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cda55a96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0cf73fe6-82e2-434e-b670-631647721b2c+11:3660:x1875336022198272:12345-0@lo:103: 00010000:00010000:3.0:1788459873.591529:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788459873.591540:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000071850f1d/0x5dfa74784542a95f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5dfa74784542a958 expref: 11 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459873.591563:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788459873.591594:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cda55a96 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0cf73fe6-82e2-434e-b670-631647721b2c+10:3660:x1875336022198272:12345-0@lo:103: Request processed in 77us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459873.591600:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788459873.591628:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000aad7bfed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0cf73fe6-82e2-434e-b670-631647721b2c:3660:1875336022198272:0@lo:103: 00000020:01000000:2.0:1788459873.592494:0:6510:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1788459873.592505:0:6510:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788459873.592821:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: 00000000d13efdbd/0x5dfa74784542a966 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542a96d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459873.592832:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: 00000000d13efdbd/0x5dfa74784542a966 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542a96d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788459873.592883:0:6510:0:(mgc_request.c:2423:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788459873.592886:0:6510:0:(mgc_request.c:424:config_log_add()) add config log lustre-client-ffff8c4be2d81000 10000000:01000000:2.0:1788459873.592889:0:6510:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-client-ffff8c4be2d81000 10000000:01000000:2.0:1788459873.592893:0:6510:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788459873.592911:0:6510:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-client-ffff8c4be2d81000 from 1 10000000:01000000:2.0:1788459873.592913:0:6510:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788459873.592992:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: 000000007051c647/0x5dfa74784542a974 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459873.593000:0:6510:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: 000000007051c647/0x5dfa74784542a974 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459873.593009:0:6510:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: 000000007051c647/0x5dfa74784542a974 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788459873.593026:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000532c7305 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:6510:1875336022198400:0@lo:101: 00000100:00100000:2.0:1788459873.593069:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459873.593099:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bf1df07f going to sleep for 11 seconds 00000100:00100000:3.0:1788459873.593181:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022198400 00000100:00100000:3.0:1788459873.593194:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022198400 00000100:00100000:3.0:1788459873.593232:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788459873.593239:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003cf219fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+10:6510:x1875336022198400:12345-0@lo:101: 00010000:00010000:3.0:1788459873.593250:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788459873.593258:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000defa2f28/0x5dfa74784542a97b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542a974 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459873.593276:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000defa2f28/0x5dfa74784542a97b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542a974 expref: 11 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459873.593284:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000defa2f28/0x5dfa74784542a97b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542a974 expref: 11 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459873.593291:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000defa2f28, rc 0) 00000100:00100000:3.0:1788459873.593328:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003cf219fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+11:6510:x1875336022198400:12345-0@lo:101: Request processed in 90us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459873.593333:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788459873.593414:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000532c7305 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:6510:1875336022198400:0@lo:101: 00010000:00010000:2.0:1788459873.593426:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: 000000007051c647/0x5dfa74784542a974 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542a97b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459873.593438:0:6510:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: 000000007051c647/0x5dfa74784542a974 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542a97b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788459873.593478:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000532c7305 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:6510:1875336022198528:0@lo:501: 00000100:00100000:2.0:1788459873.593499:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459873.593523:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bf1df07f going to sleep for 11 seconds 00000100:00100000:3.0:1788459873.593827:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022198528 00000100:00100000:3.0:1788459873.593832:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022198528 00000100:00100000:3.0:1788459873.593863:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788459873.593868:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007660a00c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+11:6510:x1875336022198528:12345-0@lo:501: 00000100:00100000:3.0:1788459873.594001:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007660a00c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+11:6510:x1875336022198528:12345-0@lo:501: Request processed in 133us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459873.594008:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788459873.594078:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000532c7305 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:6510:1875336022198528:0@lo:501: 00000100:00100000:1.0:1788459873.594106:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001ac418e9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:6510:1875336022198656:0@lo:503: 00000100:00100000:1.0:1788459873.594141:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459873.594173:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set 0000000024c1b164 going to sleep for 11 seconds 00000100:00100000:3.0:1788459873.594208:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022198656 00000100:00100000:3.0:1788459873.594212:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022198656 00000100:00100000:3.0:1788459873.594237:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788459873.594242:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000efb7dd90 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+11:6510:x1875336022198656:12345-0@lo:503: 00000100:00100000:3.0:1788459873.594310:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000efb7dd90 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+11:6510:x1875336022198656:12345-0@lo:503: Request processed in 68us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459873.594320:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788459873.594379:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001ac418e9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:6510:1875336022198656:0@lo:503: 00000100:00100000:1.0:1788459873.594807:0:6560:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001ac418e9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0cf73fe6-82e2-434e-b670-631647721b2c:6560:1875336022198784:0@lo:502: 00000100:00100000:1.0:1788459873.594840:0:6560:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459873.594860:0:6560:0:(client.c:2716:ptlrpc_set_wait()) set 0000000037348c5a going to sleep for 11 seconds 00000100:00100000:3.0:1788459873.595024:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022198784 00000100:00100000:3.0:1788459873.595029:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022198784 00000100:00100000:3.0:1788459873.595051:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788459873.595057:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a5e63257 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+11:6560:x1875336022198784:12345-0@lo:502: 00000100:00100000:3.0:1788459873.595133:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a5e63257 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+11:6560:x1875336022198784:12345-0@lo:502: Request processed in 76us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459873.595139:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788459873.595199:0:6560:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001ac418e9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0cf73fe6-82e2-434e-b670-631647721b2c:6560:1875336022198784:0@lo:502: 00000020:01000004:2.0:1788459873.595249:0:6560:0:(obd_mount.c:308:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1788459873.595264:0:6560:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000d5a142bf) 00000020:00000080:2.0:1788459873.595285:0:6560:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1788459873.595359:0:6560:0:(tgt_mount.c:167:server_get_mount()) get mount 000000005294716a from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788459873.595363:0:6560:0:(tgt_mount.c:201:server_put_mount()) put mount 000000005294716a from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788459873.595365:0:6560:0:(obd_mount.c:798:lustre_put_lsi()) put 000000005294716a 4 00010000:00080000:2.0:1788459873.595387:0:6560:0:(ldlm_lib.c:102:import_set_conn()) imp 000000009bf5dcd9@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.105@tcp at head 00010000:00010000:3.0:1788459873.598466:0:6560:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1788459873.598846:0:6560:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788459873.598887:0:6560:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788459873.598898:0:6560:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x5dfa74784542a989 00000100:00080000:3.0:1788459873.598907:0:6560:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788459873.598912:0:6560:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000009bf5dcd9 using connection 192.168.206.105@tcp/0@lo 00000100:00100000:3.0:1788459873.599115:0:6560:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000aad7bfed x1875336022198912/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788459873.599140:0:6560:0:(pinger.c:380:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788459873.599346:0:6560:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007ec9b997 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0cf73fe6-82e2-434e-b670-631647721b2c:6560:1875336022199040:0@lo:502: 00000100:00100000:3.0:1788459873.599417:0:6560:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459873.599461:0:6560:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bbb035de going to sleep for 11 seconds 00000100:00100000:0.0:1788459873.599697:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000aad7bfed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3658:1875336022198912:0@lo:38: 00000100:00100000:0.0:1788459873.599744:0:3658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459873.599875:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022198912 00000100:00100000:3.0:1788459873.599882:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022198912 00000100:00100000:3.0:1788459873.599918:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788459873.599934:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002c4d0fad pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3658:x1875336022198912:12345-0@lo:38: 00000100:00100000:3.0:1788459873.600004:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002c4d0fad pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3658:x1875336022198912:12345-0@lo:38: Request processed in 70us (260us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788459873.600011:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788459873.600093:0:3658:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788459873.600099:0:3658:0:(import.c:65:import_set_state_nolock()) 000000009bf5dcd9 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788459873.600108:0:3658:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788459873.600111:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000aad7bfed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3658:1875336022198912:0@lo:38: 00000100:00100000:3.0:1788459873.601058:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022199040 00000100:00100000:3.0:1788459873.601067:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022199040 00000100:00100000:3.0:1788459873.602669:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788459873.602684:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d140a122 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+11:6560:x1875336022199040:12345-0@lo:502: 00000100:00100000:3.0:1788459873.602857:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d140a122 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+11:6560:x1875336022199040:12345-0@lo:502: Request processed in 178us (3440us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459873.602866:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788459873.604071:0:6560:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007ec9b997 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0cf73fe6-82e2-434e-b670-631647721b2c:6560:1875336022199040:0@lo:502: 00000040:00080000:2.0:1788459873.604115:0:6560:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1788459873.606046:0:6510:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1788459873.606065:0:6510:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788459873.606084:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: 000000007051c647/0x5dfa74784542a974 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542a97b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459873.606097:0:6510:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: 000000007051c647/0x5dfa74784542a974 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542a97b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788459873.606165:0:6510:0:(tgt_mount.c:1239:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788459873.606168:0:6510:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788459873.606169:0:6510:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788459873.606176:0:6510:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:2.0:1788459873.606177:0:6510:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788459873.606179:0:6510:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788459873.606180:0:6510:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788459873.606181:0:6510:0:(tgt_mount.c:1250:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788459873.606182:0:6510:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788459873.606183:0:6510:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788459873.606184:0:6510:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788459873.606185:0:6510:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788459873.606189:0:6510:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1788459873.606191:0:6510:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788459873.606192:0:6510:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788459873.606193:0:6510:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788459873.606194:0:6510:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:2.0:1788459873.606195:0:6510:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788459873.606196:0:6510:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788459873.606197:0:6510:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788459873.606198:0:6510:0:(tgt_mount.c:1250:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788459873.606199:0:6510:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788459873.606199:0:6510:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788459873.606200:0:6510:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788459873.606201:0:6510:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788459873.606228:0:6510:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788459873.606243:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ddf1c329 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:6510:1875336022199168:0@lo:253: 00000100:00100000:2.0:1788459873.606309:0:6510:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459873.610811:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b0403228 going to sleep for 11 seconds 00000100:00100000:0.0:1788459873.612205:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022199168 00000100:00100000:0.0:1788459873.612216:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022199168 00000100:00100000:2.0:1788459873.612327:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788459873.612335:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007d718d07 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+11:6510:x1875336022199168:12345-0@lo:253: 20000000:01000000:2.0:1788459873.612363:0:6525:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788459873.612374:0:6525:0:(mgs_nids.c:475:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788459873.619835:0:6525:0:(mgs_nids.c:842:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788459873.619858:0:6525:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1788459873.620875:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007d718d07 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+11:6510:x1875336022199168:12345-0@lo:253: Request processed in 8535us (14561us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459873.620888:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788459873.621372:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ddf1c329 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:6510:1875336022199168:0@lo:253: 10000000:01000000:1.0:1788459873.621388:0:6510:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788459873.621391:0:6510:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788459873.621393:0:6510:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788459873.621394:0:6510:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788459873.621395:0:6510:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:1.0:1788459873.621396:0:6510:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:1.0:1788459873.621397:0:6510:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:1.0:1788459873.621398:0:6510:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788459873.621400:0:6510:0:(tgt_mount.c:1250:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788459873.621401:0:6510:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788459873.621402:0:6510:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788459873.621403:0:6510:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788459873.621405:0:6510:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788459873.621419:0:6510:0:(tgt_mount.c:2880:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:2.0:1788459873.621670:0:6549:0:(mgs_nids.c:739:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788459873.621687:0:6549:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788459873.621704:0:6549:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000850e7ff4/0x5dfa74784542a990 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459873.621730:0:6549:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000850e7ff4/0x5dfa74784542a990 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788459873.621738:0:6549:0:(mgs_nids.c:715:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000052488s 00010000:00010000:2.0:1788459873.621742:0:6549:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000850e7ff4/0x5dfa74784542a990 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459873.621747:0:6549:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000850e7ff4/0x5dfa74784542a990 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459873.621753:0:6549:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000850e7ff4/0x5dfa74784542a990 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459873.621758:0:6549:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000850e7ff4/0x5dfa74784542a990 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459873.621763:0:6549:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000850e7ff4 already unused, calling callback (000000003e0ee701) 00010000:00010000:2.0:1788459873.621766:0:6549:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000850e7ff4/0x5dfa74784542a990 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459873.621774:0:6549:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000850e7ff4/0x5dfa74784542a990 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459873.621786:0:6549:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000850e7ff4/0x5dfa74784542a990 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459873.621801:0:6549:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000850e7ff4/0x5dfa74784542a990 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459873.621817:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000850e7ff4/0x5dfa74784542a990 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:1.0:1788459873.630468:0:6510:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:1.0:1788459873.630628:0:6510:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1788459873.630829:0:6510:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:1.0:1788459873.631025:0:6510:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1788459873.631228:0:6510:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:1.0:1788459873.631383:0:6510:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:2.0:1788459873.633994:0:6510:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:2.0:1788459873.634184:0:6510:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:2.0:1788459873.634361:0:6510:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:2.0:1788459873.634514:0:6510:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:2.0:1788459873.634714:0:6510:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:2.0:1788459873.634896:0:6510:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:2.0:1788459873.640255:0:6510:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1788459873.662890:0:6510:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1788459873.663018:0:6565:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1788459873.663023:0:6565:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:0.0:1788459873.663462:0:6566:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1788459873.666025:0:6510:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1788459873.666133:0:6510:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788459873.666862:0:6510:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788459873.666878:0:6510:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788459873.667666:0:6510:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788459873.669044:0:6510:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788459873.669580:0:6510:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788459873.669610:0:6510:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1788459873.681597:0:6510:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1788459873.682014:0:6510:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00000040:00080000:0.0:1788459873.682923:0:6566:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00100000:10000000:1.0:1788459873.701697:0:6510:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1788459873.704874:0:6510:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00000040:00080000:1.0:1788459873.708821:0:6566:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788459873.708898:0:6566:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788459873.708903:0:6566:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:0.0:1788459873.712896:0:6510:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1788459873.713115:0:6510:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1788459873.713880:0:6510:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1788459873.714321:0:6510:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1788459873.714507:0:6510:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1788459873.714930:0:6510:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1788459873.715125:0:6510:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1788459873.715267:0:6510:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1788459873.715437:0:6510:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1788459873.716334:0:6510:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1788459873.716668:0:6510:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1788459873.716833:0:6510:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1788459873.717015:0:6510:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1788459873.717451:0:6510:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1788459873.718631:0:6510:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1788459873.718886:0:6510:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1788459873.719052:0:6510:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1788459873.720750:0:6510:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1788459873.720922:0:6510:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1788459873.721129:0:6510:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1788459873.721905:0:6510:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1788459873.722107:0:6510:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1788459873.722294:0:6510:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1788459873.722471:0:6510:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1788459873.722620:0:6510:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1788459873.722759:0:6510:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1788459873.722911:0:6510:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1788459873.725074:0:6510:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1788459873.725269:0:6510:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1788459873.725410:0:6510:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1788459873.725641:0:6510:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:2.0:1788459873.732657:0:6510:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788459873.732698:0:6510:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffba0a01c739b8 00100000:10000000:2.0:1788459873.732705:0:6510:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1788459873.733427:0:6510:0:(tgt_mount.c:2600:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1788459873.733450:0:6510:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1788459873.734151:0:6510:0:(tgt_mount.c:2486:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788459873.736448:0:6510:0:(tgt_mount.c:2501:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1788459874.065724:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788459875.089393:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788459876.113796:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788459877.139767:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788459878.161091:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788459878.884494:0:6811:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:1.0:1788459878.996307:0:8:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788459878.996316:0:8:0:(pinger.c:244:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788459878.996319:0:8:0:(import.c:65:import_set_state_nolock()) 000000009bf5dcd9 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788459878.996330:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000009bf5dcd9 using connection 192.168.206.105@tcp/0@lo 00000100:00100000:1.0:1788459878.996349:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000a114a590 x1875336022199424/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788459878.996380:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a114a590 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3658:1875336022199424:0@lo:38: 00000100:00100000:1.0:1788459878.996439:0:3658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459878.996518:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022199424 00000100:00100000:1.0:1788459878.996524:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022199424 00000100:00100000:1.0:1788459878.996549:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788459878.996554:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bb454667 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3658:x1875336022199424:12345-0@lo:38: 00010000:00080000:1.0:1788459878.996574:0:6535:0:(ldlm_lib.c:1461:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 176 last 0 00000020:00000080:1.0:1788459878.996603:0:6535:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x5dfa74784542a997 00000004:00100000:1.0:1788459878.996646:0:6535:0:(mdt_handler.c:7310:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788459878.997072:0:6535:0:(import.c:65:import_set_state_nolock()) 00000000c4be384b : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788459878.997125:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bb454667 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1875336022199424:12345-0@lo:38: Request processed in 570us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459878.997133:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788459878.997169:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000a114a590 x1875336022199424/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788459888 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788459878.997184:0:3658:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788459878.997189:0:3658:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788459878.997194:0:3658:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788459878.997196:0:3658:0:(import.c:65:import_set_state_nolock()) 000000009bf5dcd9 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788459878.997200:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a114a590 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3658:1875336022199424:0@lo:38: 00000100:00100000:2.0:1788459878.998725:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788459878.998742:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b3753907 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0cf73fe6-82e2-434e-b670-631647721b2c:3662:1875336022199296:0@lo:400: 00000100:00100000:2.0:1788459878.998808:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459878.999116:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022199296 00000100:00100000:3.0:1788459878.999124:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022199296 00000100:00100000:3.0:1788459878.999165:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788459878.999172:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c2ec6979 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+11:3662:x1875336022199296:12345-0@lo:400: 00000100:00100000:3.0:1788459878.999218:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c2ec6979 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+11:3662:x1875336022199296:12345-0@lo:400: Request processed in 46us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459878.999225:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788459878.999450:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b3753907 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0cf73fe6-82e2-434e-b670-631647721b2c:3662:1875336022199296:0@lo:400: 00010000:00010000:1.0:1788459879.188534:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788459879.507183:0:6530:0:(mgc_request.c:715:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788459879.507189:0:6530:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-mdtir-ffff8c4be2d81000 from 1 10000000:01000000:0.0:1788459879.507193:0:6530:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788459879.507232:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: 00000000118c0519/0x5dfa74784542a99e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459879.507245:0:6530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: 00000000118c0519/0x5dfa74784542a99e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459879.507255:0:6530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: 00000000118c0519/0x5dfa74784542a99e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788459879.507275:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000234d909b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022199552:0@lo:101: 00000100:00100000:0.0:1788459879.507332:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459879.507442:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b5e0ba5c going to sleep for 11 seconds 00000100:00100000:1.0:1788459879.515184:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022199552 00000100:00100000:1.0:1788459879.515197:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022199552 00000100:00100000:1.0:1788459879.515255:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788459879.515263:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003d68502c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+11:6530:x1875336022199552:12345-0@lo:101: 00010000:00010000:1.0:1788459879.515279:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788459879.515295:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ddbc28f9/0x5dfa74784542a9a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542a99e expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459879.515319:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ddbc28f9/0x5dfa74784542a9a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542a99e expref: 12 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459879.515329:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ddbc28f9/0x5dfa74784542a9a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542a99e expref: 12 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459879.515336:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ddbc28f9, rc 0) 00000100:00100000:1.0:1788459879.515415:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003d68502c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+12:6530:x1875336022199552:12345-0@lo:101: Request processed in 153us (8083us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459879.515422:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788459879.515615:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000234d909b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022199552:0@lo:101: 00010000:00010000:0.0:1788459879.515632:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: 00000000118c0519/0x5dfa74784542a99e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542a9a5 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459879.515641:0:6530:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: 00000000118c0519/0x5dfa74784542a99e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542a9a5 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788459879.516216:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000234d909b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022199680:0@lo:256: 00000100:00100000:0.0:1788459879.516262:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459879.516298:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b5e0ba5c going to sleep for 11 seconds 00000100:00100000:0.0:1788459879.516315:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022199680 00000100:00100000:0.0:1788459879.516319:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022199680 00000100:00100000:0.0:1788459879.516348:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788459879.516354:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a2a0a0d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+12:6530:x1875336022199680:12345-0@lo:256: 20000000:01000000:0.0:1788459879.516368:0:6526:0:(mgs_nids.c:1209:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788459879.516382:0:6526:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788459879.516385:0:6526:0:(mgs_nids.c:325:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1788459879.516451:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a2a0a0d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+12:6530:x1875336022199680:12345-0@lo:256: Request processed in 97us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459879.516458:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788459879.516488:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000234d909b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022199680:0@lo:256: 10000000:01000000:0.0:1788459879.517039:0:6530:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788459879.517046:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: 00000000118c0519/0x5dfa74784542a99e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542a9a5 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459879.517055:0:6530:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: 00000000118c0519/0x5dfa74784542a99e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542a9a5 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000004:0.0:1788459879.868639:0:6863:0:(tgt_mount.c:2486:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788459879.868907:0:6863:0:(tgt_mount.c:2501:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788459880.209249:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788459881.233199:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788459882.257550:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788459882.722445:0:6965:0:(tgt_mount.c:2486:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788459882.722604:0:6965:0:(tgt_mount.c:2501:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788459883.281523:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788459884.114040:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788459884.114059:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003521a457 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3660:1875336022199936:0@lo:400: 00000100:00100000:1.0:1788459884.114120:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459884.114176:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022199936 00000100:00100000:1.0:1788459884.114182:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022199936 00000100:00100000:1.0:1788459884.114221:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788459884.114227:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003be715fc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1875336022199936:12345-0@lo:400: 00000100:00100000:1.0:1788459884.114275:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003be715fc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1875336022199936:12345-0@lo:400: Request processed in 48us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459884.114282:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788459884.114319:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000003521a457 x1875336022199936/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788459900 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788459884.114330:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003521a457 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3660:1875336022199936:0@lo:400: 00000100:00100000:2.0:1788459884.114399:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a114a590 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0cf73fe6-82e2-434e-b670-631647721b2c:3662:1875336022199808:0@lo:400: 00000100:00100000:2.0:1788459884.114441:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459884.114969:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022199808 00000100:00100000:1.0:1788459884.114976:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022199808 00000100:00100000:1.0:1788459884.115004:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788459884.115009:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c0898631 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+12:3662:x1875336022199808:12345-0@lo:400: 00000100:00100000:1.0:1788459884.115049:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c0898631 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+12:3662:x1875336022199808:12345-0@lo:400: Request processed in 40us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459884.115055:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788459884.115086:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a114a590 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0cf73fe6-82e2-434e-b670-631647721b2c:3662:1875336022199808:0@lo:400: 00010000:00010000:1.0:1788459884.305268:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788459885.338753:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788459886.353190:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788459887.378216:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788459888.401147:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788459889.233087:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788459889.233109:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a114a590 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0cf73fe6-82e2-434e-b670-631647721b2c:3659:1875336022200064:0@lo:400: 00000100:00100000:1.0:1788459889.233172:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459889.233234:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003521a457 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875336022200192:0@lo:400: 00000100:00100000:1.0:1788459889.233259:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459889.233302:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022200064 00000100:00100000:1.0:1788459889.233308:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022200064 00000100:00100000:1.0:1788459889.233348:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788459889.233355:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d3dc0bb0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+12:3659:x1875336022200064:12345-0@lo:400: 00000100:00100000:1.0:1788459889.233395:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d3dc0bb0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+12:3659:x1875336022200064:12345-0@lo:400: Request processed in 41us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459889.233401:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788459889.233428:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022200192 00000100:00100000:1.0:1788459889.233431:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022200192 00000100:00100000:1.0:1788459889.233465:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788459889.233470:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003caa7612 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1875336022200192:12345-0@lo:400: 00000100:00100000:1.0:1788459889.233497:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003caa7612 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1875336022200192:12345-0@lo:400: Request processed in 27us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459889.233502:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788459889.233535:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000003521a457 x1875336022200192/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788459905 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788459889.233548:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003521a457 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875336022200192:0@lo:400: 00000100:00100000:1.0:1788459889.233568:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a114a590 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0cf73fe6-82e2-434e-b670-631647721b2c:3659:1875336022200064:0@lo:400: 00010000:00010000:1.0:1788459889.426147:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788459890.451207:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788459891.474148:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788459892.498195:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788459893.362188:0:7463:0:(obd_mount.c:1011:lmd_print()) mount data: 00000020:01000004:2.0:1788459893.362191:0:7463:0:(obd_mount.c:1014:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788459893.362193:0:7463:0:(obd_mount.c:1017:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788459893.362327:0:7463:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000063f701fb 00000020:01000004:2.0:1788459893.362342:0:7463:0:(tgt_mount.c:2642:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:2.0:1788459893.362351:0:7463:0:(obd_mount.c:308:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788459893.362363:0:7463:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (0000000095ba6eb7) 00000020:00000080:2.0:1788459893.362376:0:7463:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788459893.450891:0:7463:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:0.0:1788459893.451097:0:7463:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:0.0:1788459893.486500:0:7463:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788459893.486736:0:7463:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:0.0:1788459893.486746:0:7463:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788459893.486757:0:7463:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5dfa74784542a9b3 00000020:01000004:0.0:1788459893.486763:0:7463:0:(tgt_mount.c:2727:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:0.0:1788459893.486784:0:7463:0:(obd_mount.c:488:lustre_start_mgc()) mgc192.168.206.105@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788459893.486787:0:7463:0:(mgc_request.c:1379:mgc_set_info_async()) InitRecov mgc192.168.206.105@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788459893.486792:0:7463:0:(tgt_mount.c:1939:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:0.0:1788459893.486821:0:7463:0:(tgt_mount.c:1519:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.206.105@tcp, index=0001, flags=0x20061 00000020:01000004:0.0:1788459893.486824:0:7463:0:(tgt_mount.c:1239:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788459893.486826:0:7463:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788459893.486827:0:7463:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788459893.486828:0:7463:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:0.0:1788459893.486829:0:7463:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:0.0:1788459893.486831:0:7463:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:0.0:1788459893.486832:0:7463:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788459893.486833:0:7463:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788459893.486835:0:7463:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788459893.486836:0:7463:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788459893.486837:0:7463:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788459893.486840:0:7463:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:0.0:1788459893.486842:0:7463:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788459893.486843:0:7463:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788459893.486844:0:7463:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788459893.486845:0:7463:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:0.0:1788459893.486846:0:7463:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:0.0:1788459893.486847:0:7463:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:0.0:1788459893.486848:0:7463:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788459893.486849:0:7463:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788459893.486850:0:7463:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788459893.486851:0:7463:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788459893.486851:0:7463:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788459893.486875:0:7463:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1788459893.486890:0:7463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000234d909b pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:7463:1875336022200320:0@lo:253: 00000100:00100000:0.0:1788459893.486969:0:7463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459893.487012:0:7463:0:(client.c:2716:ptlrpc_set_wait()) set 000000009b631439 going to sleep for 11 seconds 00000100:00100000:3.0:1788459893.487116:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022200320 00000100:00100000:3.0:1788459893.487122:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022200320 00000100:00100000:3.0:1788459893.487167:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788459893.487174:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a1e76db4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+12:7463:x1875336022200320:12345-0@lo:253: 20000000:01000000:3.0:1788459893.487197:0:6528:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788459893.487201:0:6528:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:3.0:1788459893.487210:0:6528:0:(mgs_llog.c:875:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:3.0:1788459893.487213:0:6528:0:(mgs_llog.c:3618:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:3.0:1788459893.487244:0:6528:0:(mgs_llog.c:3178:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:3.0:1788459893.487427:0:6528:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788459893.487532:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1788459893.487547:0:6528:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788459893.487560:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:3.0:1788459893.487572:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:3.0:1788459893.487583:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:3.0:1788459893.487626:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:3.0:1788459893.487634:0:6528:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:3.0:1788459893.487660:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:3.0:1788459893.487666:0:6528:0:(mgs_llog.c:1545:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:3.0:1788459893.487678:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:3.0:1788459893.487694:0:6528:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:3.0:1788459893.487822:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:3.0:1788459893.487844:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:3.0:1788459893.487975:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:3.0:1788459893.487987:0:6528:0:(mgs_llog.c:1545:record_base_raw()) lcfg (null) 0xcf005 192.168.206.105@tcp (null) (null) (null) 00000040:00080000:3.0:1788459893.488000:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:3.0:1788459893.488006:0:6528:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788459893.488016:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:3.0:1788459893.488021:0:6528:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.206.105@tcp (null) (null) 00000040:00080000:3.0:1788459893.488033:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:3.0:1788459893.488037:0:6528:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1788459893.488048:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:3.0:1788459893.488061:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:3.0:1788459893.488071:0:6528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:3.0:1788459893.488318:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:3.0:1788459893.488330:0:6528:0:(mgs_llog.c:1545:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:3.0:1788459893.488343:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:3.0:1788459893.488370:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:3.0:1788459893.488390:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:3.0:1788459893.488397:0:6528:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:3.0:1788459893.488411:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:3.0:1788459893.488444:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:3.0:1788459893.488451:0:6528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:3.0:1788459893.488713:0:6528:0:(mgs_llog.c:3315:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1788459893.488721:0:6528:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:1.0:1788459893.489673:0:7469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:3.0:1788459893.490234:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1788459893.490260:0:6528:0:(mgs_llog.c:3361:mgs_write_log_mdc_to_lmv()) add nid 192.168.206.105@tcp for mdt 20000000:01000000:3.0:1788459893.490262:0:6528:0:(mgs_llog.c:1545:record_base_raw()) lcfg (null) 0xcf005 192.168.206.105@tcp (null) (null) (null) 00000040:00080000:3.0:1788459893.490278:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1788459893.490284:0:6528:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1788459893.490297:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1788459893.490303:0:6528:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.206.105@tcp (null) (null) 00000040:00080000:3.0:1788459893.490318:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1788459893.490326:0:6528:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:3.0:1788459893.490339:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:3.0:1788459893.490355:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:3.0:1788459893.490401:0:6528:0:(mgs_llog.c:3441:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:3.0:1788459893.490408:0:6528:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:1.0:1788459893.491278:0:7470:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:3.0:1788459893.491457:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1788459893.491477:0:6528:0:(mgs_llog.c:3499:mgs_write_log_osp_to_mdt()) add nid 192.168.206.105@tcp for mdt 20000000:01000000:3.0:1788459893.491478:0:6528:0:(mgs_llog.c:1545:record_base_raw()) lcfg (null) 0xcf005 192.168.206.105@tcp (null) (null) (null) 00000040:00080000:3.0:1788459893.491512:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1788459893.491519:0:6528:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788459893.491532:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1788459893.491538:0:6528:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.206.105@tcp (null) (null) 00000040:00080000:3.0:1788459893.491550:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1788459893.491556:0:6528:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:3.0:1788459893.491577:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1788459893.491595:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:3.0:1788459893.491615:0:6528:0:(mgs_llog.c:5258:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788459893.491618:0:6528:0:(mgs_llog.c:4754:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788459893.491621:0:6528:0:(mgs_llog.c:4187:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788459893.491736:0:6528:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788459893.491739:0:6528:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788459893.498461:0:7471:0:(mgs_llog.c:1082:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:1.0:1788459893.498508:0:7471:0:(mgs_llog.c:1082:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:1.0:1788459893.498525:0:7471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1788459893.498813:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1788459893.498841:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1788459893.498866:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1788459893.498879:0:6528:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788459893.498882:0:6528:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788459893.499779:0:7472:0:(mgs_llog.c:1082:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1788459893.499806:0:7472:0:(mgs_llog.c:1082:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1788459893.499822:0:7472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1788459893.500204:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:3.0:1788459893.500228:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:3.0:1788459893.500244:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:3.0:1788459893.500256:0:6528:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1788459893.500259:0:6528:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788459893.500863:0:7473:0:(mgs_llog.c:1082:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1788459893.500884:0:7473:0:(mgs_llog.c:1082:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1788459893.500898:0:7473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:3.0:1788459893.501212:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:3.0:1788459893.501234:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:3.0:1788459893.501248:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:3.0:1788459893.501261:0:6528:0:(mgs_llog.c:5258:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788459893.501264:0:6528:0:(mgs_llog.c:4754:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788459893.501269:0:6528:0:(mgs_llog.c:5078:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1788459893.501274:0:6528:0:(mgs_llog.c:1385:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1788459893.501597:0:7474:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:3.0:1788459893.501787:0:6528:0:(mgs_llog.c:1456:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788459893.514886:0:6528:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788459893.515066:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000071850f1d/0x5dfa74784542a9ba lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459893.515086:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000090767814/0x5dfa74784542a8ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542a8e8 expref: 12 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459893.515092:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000f96bd10d/0x5dfa74784542a90b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542a904 expref: 12 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459893.515097:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000defa2f28/0x5dfa74784542a97b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542a974 expref: 12 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459893.515102:0:6528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000071850f1d/0x5dfa74784542a9ba lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459893.515142:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000defa2f28/0x5dfa74784542a97b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5dfa74784542a974 expref: 12 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459893.515156:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000defa2f28/0x5dfa74784542a97b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5dfa74784542a974 expref: 12 pid: 6528 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788459893.515168:0:6528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b7b076c1 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6528:1875336022200448:0@lo:104: 00000100:00100000:2.0:1788459893.515226:0:6528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788459893.515307:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000f96bd10d/0x5dfa74784542a90b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5dfa74784542a904 expref: 12 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459893.515315:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000f96bd10d/0x5dfa74784542a90b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5dfa74784542a904 expref: 12 pid: 6526 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788459893.515322:0:6528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000d0a4161 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6528:1875336022200576:0@lo:104: 00000100:00100000:2.0:1788459893.515344:0:6528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788459893.515368:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000090767814/0x5dfa74784542a8ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5dfa74784542a8e8 expref: 12 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459893.515376:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000090767814/0x5dfa74784542a8ef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5dfa74784542a8e8 expref: 12 pid: 6526 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788459893.515384:0:6528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004865996c pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6528:1875336022200704:0@lo:104: 00000100:00100000:2.0:1788459893.515411:0:6528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459893.515420:0:6528:0:(client.c:2716:ptlrpc_set_wait()) set 00000000aa23c402 going to sleep for 11 seconds 00000100:00100000:3.0:1788459893.515486:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022200448 00000100:00100000:3.0:1788459893.515494:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022200448 00000100:00100000:3.0:1788459893.515523:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022200576 00000100:00100000:3.0:1788459893.515526:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022200576 00000100:00100000:3.0:1788459893.515544:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022200704 00000100:00100000:3.0:1788459893.515547:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022200704 00000100:00100000:3.0:1788459893.515561:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788459893.515567:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000029d32195 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0cf73fe6-82e2-434e-b670-631647721b2c+5:6528:x1875336022200448:12345-0@lo:104: 00010000:00010000:3.0:1788459893.515578:0:6516:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.206.105@tcp lock: 000000007051c647/0x5dfa74784542a974 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542a97b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459893.515632:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788459893.515637:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000029d32195 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0cf73fe6-82e2-434e-b670-631647721b2c+5:6528:x1875336022200448:12345-0@lo:104: Request processed in 72us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459893.515818:0:6528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b7b076c1 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6528:1875336022200448:0@lo:104: 00000100:00100000:3.0:1788459893.515856:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788459893.515873:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788459893.515879:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cf9acdfb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0cf73fe6-82e2-434e-b670-631647721b2c+4:6528:x1875336022200576:12345-0@lo:104: 00010000:00010000:3.0:1788459893.515886:0:6516:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.206.105@tcp lock: 000000004da08286/0x5dfa74784542a904 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542a90b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459893.516030:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788459893.516035:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cf9acdfb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0cf73fe6-82e2-434e-b670-631647721b2c+4:6528:x1875336022200576:12345-0@lo:104: Request processed in 157us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459893.516040:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788459893.516052:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788459893.516058:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000b6a96c9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0cf73fe6-82e2-434e-b670-631647721b2c+3:6528:x1875336022200704:12345-0@lo:104: 00010000:00010000:3.0:1788459893.516064:0:6516:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.206.105@tcp lock: 00000000631cf243/0x5dfa74784542a8e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542a8ef expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459893.516091:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:0.0:1788459893.516132:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788459893.516143:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: 000000007051c647/0x5dfa74784542a974 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542a97b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459893.516150:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007051c647 already unused, calling callback (000000000de01725) 10000000:00010000:0.0:1788459893.516153:0:6522:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: 000000007051c647/0x5dfa74784542a974 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5dfa74784542a97b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459893.516160:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: 000000007051c647/0x5dfa74784542a974 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5dfa74784542a97b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788459893.516165:0:6522:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: 000000007051c647/0x5dfa74784542a974 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5dfa74784542a97b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788459893.516170:0:6522:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788459893.516197:0:6522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.206.105@tcp lock: 000000007051c647/0x5dfa74784542a974 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542a97b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459893.516203:0:6522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788459893.516215:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: 000000007051c647/0x5dfa74784542a974 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542a97b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459893.516221:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: 000000007051c647/0x5dfa74784542a974 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542a97b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459893.516233:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788459893.516235:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: 000000004da08286/0x5dfa74784542a904 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542a90b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459893.516241:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004da08286 already unused, calling callback (000000000de01725) 10000000:00010000:0.0:1788459893.516242:0:6522:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: 000000004da08286/0x5dfa74784542a904 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5dfa74784542a90b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459893.516259:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: 000000004da08286/0x5dfa74784542a904 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5dfa74784542a90b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788459893.516264:0:6522:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: 000000004da08286/0x5dfa74784542a904 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5dfa74784542a90b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788459893.516269:0:6522:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788459893.516282:0:6522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.206.105@tcp lock: 000000004da08286/0x5dfa74784542a904 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542a90b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459893.516288:0:6522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788459893.516300:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: 000000004da08286/0x5dfa74784542a904 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542a90b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459893.516306:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: 000000004da08286/0x5dfa74784542a904 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542a90b expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459893.516315:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788459893.516317:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: 00000000631cf243/0x5dfa74784542a8e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542a8ef expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459893.516321:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000631cf243 already unused, calling callback (000000000de01725) 10000000:00010000:0.0:1788459893.516323:0:6522:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: 00000000631cf243/0x5dfa74784542a8e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5dfa74784542a8ef expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459893.516329:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: 00000000631cf243/0x5dfa74784542a8e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5dfa74784542a8ef expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788459893.516334:0:6522:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: 00000000631cf243/0x5dfa74784542a8e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5dfa74784542a8ef expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788459893.516346:0:6522:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788459893.516360:0:6522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.206.105@tcp lock: 00000000631cf243/0x5dfa74784542a8e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542a8ef expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459893.516367:0:6522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788459893.516371:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: 00000000631cf243/0x5dfa74784542a8e8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542a8ef expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459893.516376:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: 00000000631cf243/0x5dfa74784542a8e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542a8ef expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459893.516388:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788459893.516389:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788459893.516391:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788459893.516402:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002b41d8bf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0cf73fe6-82e2-434e-b670-631647721b2c:3660:1875336022201088:0@lo:103: 00000100:00100000:0.0:1788459893.516433:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459893.516465:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788459893.516471:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000697ceff6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0cf73fe6-82e2-434e-b670-631647721b2c:3660:1875336022200960:0@lo:103: 00000100:00100000:0.0:1788459893.516491:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788459893.516817:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788459893.516835:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000575a059d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0cf73fe6-82e2-434e-b670-631647721b2c:3662:1875336022200832:0@lo:103: 00000100:00100000:1.0:1788459893.516863:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459893.516913:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022201088 00000100:00100000:1.0:1788459893.516918:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022201088 00010000:00010000:1.0:1788459893.516938:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000090767814/0x5dfa74784542a8ef lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542a8e8 expref: 13 pid: 6526 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788459893.516978:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022200960 00000100:00100000:1.0:1788459893.516981:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022200960 00010000:00010000:1.0:1788459893.516992:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000f96bd10d/0x5dfa74784542a90b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542a904 expref: 14 pid: 6526 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788459893.517002:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022200832 00000100:00100000:1.0:1788459893.517004:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022200832 00010000:00010000:1.0:1788459893.517011:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000defa2f28/0x5dfa74784542a97b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542a974 expref: 15 pid: 6528 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788459893.517037:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788459893.517043:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005bf90e5e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0cf73fe6-82e2-434e-b670-631647721b2c+15:3660:x1875336022201088:12345-0@lo:103: 00010000:00010000:1.0:1788459893.517054:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788459893.517058:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000090767814/0x5dfa74784542a8ef lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542a8e8 expref: 15 pid: 6526 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459893.517065:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000090767814/0x5dfa74784542a8ef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5dfa74784542a8e8 expref: 15 pid: 6526 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459893.517080:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788459893.517108:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005bf90e5e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0cf73fe6-82e2-434e-b670-631647721b2c+15:3660:x1875336022201088:12345-0@lo:103: Request processed in 65us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459893.517113:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788459893.517126:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788459893.517130:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c009ef10 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0cf73fe6-82e2-434e-b670-631647721b2c+14:3660:x1875336022200960:12345-0@lo:103: 00010000:00010000:1.0:1788459893.517136:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788459893.517139:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000f96bd10d/0x5dfa74784542a90b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542a904 expref: 14 pid: 6526 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459893.517145:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000f96bd10d/0x5dfa74784542a90b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5dfa74784542a904 expref: 14 pid: 6526 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459893.517153:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788459893.517169:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c009ef10 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0cf73fe6-82e2-434e-b670-631647721b2c+14:3660:x1875336022200960:12345-0@lo:103: Request processed in 39us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459893.517174:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788459893.517183:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788459893.517193:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a114a590 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0cf73fe6-82e2-434e-b670-631647721b2c+13:3662:x1875336022200832:12345-0@lo:103: 00010000:00010000:1.0:1788459893.517199:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788459893.517202:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000defa2f28/0x5dfa74784542a97b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542a974 expref: 13 pid: 6528 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459893.517210:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000defa2f28/0x5dfa74784542a97b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5dfa74784542a974 expref: 13 pid: 6528 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459893.517217:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000defa2f28/0x5dfa74784542a97b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5dfa74784542a974 expref: 13 pid: 6528 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459893.517227:0:6519:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000071850f1d/0x5dfa74784542a9ba lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459893.517234:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000071850f1d/0x5dfa74784542a9ba lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459893.517245:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000071850f1d/0x5dfa74784542a9ba lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459893.517251:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000071850f1d/0x5dfa74784542a9ba lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459893.517255:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000071850f1d/0x5dfa74784542a9ba lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459893.517260:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000071850f1d/0x5dfa74784542a9ba lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459893.517265:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000071850f1d already unused, calling callback (000000003e0ee701) 00010000:00010000:1.0:1788459893.517268:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000071850f1d/0x5dfa74784542a9ba lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459893.517280:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000071850f1d/0x5dfa74784542a9ba lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459893.517287:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000071850f1d/0x5dfa74784542a9ba lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459893.517296:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788459893.517319:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a114a590 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0cf73fe6-82e2-434e-b670-631647721b2c+12:3662:x1875336022200832:12345-0@lo:103: Request processed in 127us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459893.517325:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788459893.517349:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000575a059d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0cf73fe6-82e2-434e-b670-631647721b2c:3662:1875336022200832:0@lo:103: 00000100:00100000:1.0:1788459893.517370:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000697ceff6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0cf73fe6-82e2-434e-b670-631647721b2c:3660:1875336022200960:0@lo:103: 00000100:00100000:1.0:1788459893.517376:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002b41d8bf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0cf73fe6-82e2-434e-b670-631647721b2c:3660:1875336022201088:0@lo:103: 00000100:00100000:3.0:1788459893.517583:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000b6a96c9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0cf73fe6-82e2-434e-b670-631647721b2c+3:6528:x1875336022200704:12345-0@lo:104: Request processed in 39us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459893.517599:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1788459893.517911:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f96bd10d/0x5dfa74784542a90b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5dfa74784542a904 expref: 11 pid: 6526 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788459893.517923:0:6528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000d0a4161 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6528:1875336022200576:0@lo:104: 00010000:00010000:2.0:1788459893.517979:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000090767814/0x5dfa74784542a8ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5dfa74784542a8e8 expref: 10 pid: 6526 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788459893.517987:0:6528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004865996c pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6528:1875336022200704:0@lo:104: 00010000:00010000:2.0:1788459893.518004:0:6528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000071850f1d/0x5dfa74784542a9ba lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459893.518012:0:6528:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000071850f1d/0x5dfa74784542a9ba lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459893.518023:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000071850f1d/0x5dfa74784542a9ba lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459893.518028:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000071850f1d/0x5dfa74784542a9ba lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788459893.518043:0:6528:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00010000:00010000:0.0:1788459893.521114:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788459893.526050:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a1e76db4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+9:7463:x1875336022200320:12345-0@lo:253: Request processed in 38870us (39075us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459893.526064:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788459893.526164:0:7463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000234d909b pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:7463:1875336022200320:0@lo:253: 10000000:01000000:0.0:1788459893.526178:0:7463:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1788459893.526181:0:7463:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788459893.526183:0:7463:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788459893.526185:0:7463:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788459893.526186:0:7463:0:(tgt_mount.c:1242:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:0.0:1788459893.526187:0:7463:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:0.0:1788459893.526188:0:7463:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:0.0:1788459893.526189:0:7463:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788459893.526203:0:7463:0:(tgt_mount.c:1260:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788459893.526204:0:7463:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788459893.526206:0:7463:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788459893.526222:0:7463:0:(tgt_mount.c:115:server_register_mount()) register mount 0000000063f701fb from lustre-MDT0001 10000000:01000000:0.0:1788459893.526249:0:7463:0:(mgc_request.c:2423:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1788459893.526252:0:7463:0:(mgc_request.c:424:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1788459893.526257:0:7463:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8c4bc438f000 10000000:01000000:0.0:1788459893.526261:0:7463:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788459893.526276:0:7463:0:(mgc_request_server.c:106:mgc_fs_setup()) mgc192.168.206.105@tcp: setup lustre-MDT0001-osd 00000040:01000000:0.0:1788459893.539850:0:7463:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.206.105@tcp ctxt 1 is initialized 00000040:01000000:0.0:1788459893.558019:0:7463:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.206.105@tcp ctxt 0 is initialized 10000000:01000000:0.0:1788459893.558036:0:7463:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-sptlrpc-ffff8c4bc438f000 from 1 10000000:01000000:0.0:1788459893.558040:0:7463:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788459893.558075:0:7463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: 00000000cf865e43/0x5dfa74784542a9c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459893.558086:0:7463:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: 00000000cf865e43/0x5dfa74784542a9c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459893.558096:0:7463:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: 00000000cf865e43/0x5dfa74784542a9c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788459893.558117:0:7463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000234d909b pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:7463:1875336022201216:0@lo:101: 00000100:00100000:0.0:1788459893.558180:0:7463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459893.558320:0:7463:0:(client.c:2716:ptlrpc_set_wait()) set 0000000077df8f07 going to sleep for 11 seconds 00000100:00100000:1.0:1788459893.558360:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022201216 00000100:00100000:1.0:1788459893.558367:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022201216 00000100:00100000:1.0:1788459893.558410:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788459893.558418:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008604a6a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+9:7463:x1875336022201216:12345-0@lo:101: 00010000:00010000:1.0:1788459893.558431:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788459893.558443:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bf380738/0x5dfa74784542a9c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542a9c1 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459893.558463:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bf380738/0x5dfa74784542a9c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542a9c1 expref: 10 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459893.558473:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bf380738/0x5dfa74784542a9c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542a9c1 expref: 10 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459893.558493:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bf380738, rc 0) 00000100:00100000:1.0:1788459893.558540:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008604a6a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+10:7463:x1875336022201216:12345-0@lo:101: Request processed in 124us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459893.558547:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788459893.558633:0:7463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000234d909b pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:7463:1875336022201216:0@lo:101: 00010000:00010000:0.0:1788459893.558653:0:7463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: 00000000cf865e43/0x5dfa74784542a9c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542a9c8 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459893.558662:0:7463:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: 00000000cf865e43/0x5dfa74784542a9c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542a9c8 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788459893.558755:0:7463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000234d909b pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:7463:1875336022201344:0@lo:501: 00000100:00100000:0.0:1788459893.558783:0:7463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459893.558808:0:7463:0:(client.c:2716:ptlrpc_set_wait()) set 0000000077df8f07 going to sleep for 11 seconds 00000100:00100000:1.0:1788459893.558938:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022201344 00000100:00100000:1.0:1788459893.558988:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022201344 00000100:00100000:1.0:1788459893.559013:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788459893.559019:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005e1ae71d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+10:7463:x1875336022201344:12345-0@lo:501: 00000100:00100000:1.0:1788459893.559076:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005e1ae71d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+10:7463:x1875336022201344:12345-0@lo:501: Request processed in 57us (293us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788459893.559083:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788459893.559390:0:7463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000234d909b pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:7463:1875336022201344:0@lo:501: 10000000:01000000:0.0:1788459893.559406:0:7463:0:(mgc_request_server.c:748:mgc_llog_local_copy()) mgc192.168.206.105@tcp: no remote llog for lustre-sptlrpc, check MGS config 00000100:00100000:0.0:1788459893.559439:0:7463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000234d909b pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:7463:1875336022201472:0@lo:501: 00000100:00100000:0.0:1788459893.559464:0:7463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459893.559524:0:7463:0:(client.c:2716:ptlrpc_set_wait()) set 0000000077df8f07 going to sleep for 11 seconds 00000100:00100000:1.0:1788459893.559555:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022201472 00000100:00100000:1.0:1788459893.559560:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022201472 00000100:00100000:1.0:1788459893.559591:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788459893.559596:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003ec99a48 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+10:7463:x1875336022201472:12345-0@lo:501: 00000100:00100000:1.0:1788459893.559991:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003ec99a48 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+10:7463:x1875336022201472:12345-0@lo:501: Request processed in 393us (524us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788459893.559999:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788459893.560123:0:7463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000234d909b pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:7463:1875336022201472:0@lo:501: 10000000:01000000:0.0:1788459893.560159:0:7463:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788459893.560217:0:7463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: 00000000cf865e43/0x5dfa74784542a9c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542a9c8 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459893.560226:0:7463:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: 00000000cf865e43/0x5dfa74784542a9c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542a9c8 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788459893.560236:0:7463:0:(mgc_request.c:206:do_config_log_add()) do adding config log params-ffff8c4bc438f000 10000000:01000000:0.0:1788459893.560242:0:7463:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788459893.560280:0:7463:0:(mgc_request_server.c:106:mgc_fs_setup()) mgc192.168.206.105@tcp: setup lustre-MDT0001-osd 00000040:01000000:0.0:1788459893.560348:0:7463:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.206.105@tcp ctxt 1 is initialized 00000040:01000000:0.0:1788459893.560356:0:7463:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.206.105@tcp ctxt 0 is initialized 10000000:01000000:0.0:1788459893.560363:0:7463:0:(mgc_request.c:206:do_config_log_add()) do adding config log nodemap-ffff8c4bcec50000 10000000:01000000:0.0:1788459893.560366:0:7463:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1788459893.560392:0:7463:0:(mgc_request.c:2266:mgc_process_log()) Process log nodemap-ffff8c4bcec50000 from 1 10000000:01000000:0.0:1788459893.560395:0:7463:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788459893.560419:0:7463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: 0000000064cedf76/0x5dfa74784542a9cf lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459893.560432:0:7463:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: 0000000064cedf76/0x5dfa74784542a9cf lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459893.560440:0:7463:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: 0000000064cedf76/0x5dfa74784542a9cf lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788459893.560453:0:7463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000234d909b pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:7463:1875336022201600:0@lo:101: 00000100:00100000:0.0:1788459893.560483:0:7463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459893.560515:0:7463:0:(client.c:2716:ptlrpc_set_wait()) set 000000009b579a49 going to sleep for 11 seconds 00000100:00100000:3.0:1788459893.560571:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022201600 00000100:00100000:3.0:1788459893.560577:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022201600 00000100:00100000:3.0:1788459893.560739:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788459893.560748:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000093d0bc63 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+10:7463:x1875336022201600:12345-0@lo:101: 00010000:00010000:3.0:1788459893.560757:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788459893.560768:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000089fc84e5/0x5dfa74784542a9d6 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542a9cf expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459893.560786:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000089fc84e5/0x5dfa74784542a9d6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542a9cf expref: 11 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459893.560795:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000089fc84e5/0x5dfa74784542a9d6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542a9cf expref: 11 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459893.560803:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000089fc84e5, rc 0) 00000100:00100000:3.0:1788459893.560844:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000093d0bc63 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+11:7463:x1875336022201600:12345-0@lo:101: Request processed in 98us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459893.560850:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788459893.560904:0:7463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000234d909b pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:7463:1875336022201600:0@lo:101: 00010000:00010000:0.0:1788459893.560916:0:7463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: 0000000064cedf76/0x5dfa74784542a9cf lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542a9d6 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459893.560923:0:7463:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: 0000000064cedf76/0x5dfa74784542a9cf lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542a9d6 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788459893.560936:0:7463:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788459893.561186:0:7463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: 0000000064cedf76/0x5dfa74784542a9cf lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542a9d6 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459893.561195:0:7463:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: 0000000064cedf76/0x5dfa74784542a9cf lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542a9d6 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788459893.561202:0:7463:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-barrier-ffff8c4bc438f000 10000000:01000000:0.0:1788459893.561207:0:7463:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788459893.561237:0:7463:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-barrier-ffff8c4bc438f000 from 1 10000000:01000000:0.0:1788459893.561240:0:7463:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788459893.561255:0:7463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: 000000009aae6f4f/0x5dfa74784542a9dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459893.561265:0:7463:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: 000000009aae6f4f/0x5dfa74784542a9dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459893.561272:0:7463:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: 000000009aae6f4f/0x5dfa74784542a9dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788459893.561283:0:7463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000234d909b pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:7463:1875336022201728:0@lo:101: 00000100:00100000:0.0:1788459893.561311:0:7463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459893.561380:0:7463:0:(client.c:2716:ptlrpc_set_wait()) set 000000009b579a49 going to sleep for 11 seconds 00000100:00100000:2.0:1788459893.561438:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022201728 00000100:00100000:2.0:1788459893.561444:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022201728 00000100:00100000:2.0:1788459893.561512:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788459893.561518:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f9de06a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+11:7463:x1875336022201728:12345-0@lo:101: 00010000:00010000:2.0:1788459893.561526:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788459893.561533:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000071850f1d/0x5dfa74784542a9e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542a9dd expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459893.561548:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000071850f1d/0x5dfa74784542a9e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542a9dd expref: 12 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459893.561555:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000071850f1d/0x5dfa74784542a9e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542a9dd expref: 12 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459893.561563:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000071850f1d, rc 0) 00000100:00100000:2.0:1788459893.561743:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f9de06a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+12:7463:x1875336022201728:12345-0@lo:101: Request processed in 225us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459893.561750:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788459893.561822:0:7463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000234d909b pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:7463:1875336022201728:0@lo:101: 00010000:00010000:0.0:1788459893.561833:0:7463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: 000000009aae6f4f/0x5dfa74784542a9dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542a9e4 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459893.561840:0:7463:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: 000000009aae6f4f/0x5dfa74784542a9dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542a9e4 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788459893.561850:0:7463:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788459893.561863:0:7463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: 000000009aae6f4f/0x5dfa74784542a9dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542a9e4 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459893.561869:0:7463:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: 000000009aae6f4f/0x5dfa74784542a9dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542a9e4 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788459893.561875:0:7463:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1788459893.561879:0:7463:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788459893.561897:0:7463:0:(mgc_request_server.c:106:mgc_fs_setup()) mgc192.168.206.105@tcp: setup lustre-MDT0001-osd 00000040:01000000:0.0:1788459893.562091:0:7463:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.206.105@tcp ctxt 1 is initialized 00000040:01000000:0.0:1788459893.562098:0:7463:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.206.105@tcp ctxt 0 is initialized 10000000:01000000:0.0:1788459893.562110:0:7463:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-mdtir-ffff8c4bc438f000 10000000:01000000:0.0:1788459893.562115:0:7463:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788459893.562148:0:7463:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:0.0:1788459893.562151:0:7463:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788459893.562166:0:7463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: 0000000090767814/0x5dfa74784542a9eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459893.562173:0:7463:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: 0000000090767814/0x5dfa74784542a9eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459893.562180:0:7463:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: 0000000090767814/0x5dfa74784542a9eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788459893.562192:0:7463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000234d909b pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:7463:1875336022201856:0@lo:101: 00000100:00100000:0.0:1788459893.562219:0:7463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459893.562272:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022201856 00000100:00100000:3.0:1788459893.562277:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022201856 00000100:00100000:0.0:1788459893.562284:0:7463:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b4089c29 going to sleep for 11 seconds 00000100:00100000:3.0:1788459893.562310:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788459893.562316:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003b1dc1e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+12:7463:x1875336022201856:12345-0@lo:101: 00010000:00010000:3.0:1788459893.562324:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788459893.562332:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002ed03483/0x5dfa74784542a9f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542a9eb expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459893.562347:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002ed03483/0x5dfa74784542a9f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542a9eb expref: 13 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459893.562361:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002ed03483/0x5dfa74784542a9f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542a9eb expref: 13 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459893.562368:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002ed03483, rc 0) 00000100:00100000:3.0:1788459893.562406:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003b1dc1e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+13:7463:x1875336022201856:12345-0@lo:101: Request processed in 90us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459893.562411:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788459893.562484:0:7463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000234d909b pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:7463:1875336022201856:0@lo:101: 00010000:00010000:0.0:1788459893.562495:0:7463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: 0000000090767814/0x5dfa74784542a9eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542a9f2 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459893.562501:0:7463:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: 0000000090767814/0x5dfa74784542a9eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542a9f2 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788459893.562548:0:7463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000234d909b pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:7463:1875336022201984:0@lo:501: 00000100:00100000:0.0:1788459893.562570:0:7463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459893.562758:0:7463:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b4089c29 going to sleep for 11 seconds 00000100:00100000:2.0:1788459893.562794:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022201984 00000100:00100000:2.0:1788459893.562800:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022201984 00000100:00100000:2.0:1788459893.562831:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788459893.562837:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ef6e6f72 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+13:7463:x1875336022201984:12345-0@lo:501: 00000100:00100000:2.0:1788459893.563169:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ef6e6f72 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+13:7463:x1875336022201984:12345-0@lo:501: Request processed in 331us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459893.563176:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788459893.563212:0:7463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000234d909b pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:7463:1875336022201984:0@lo:501: 00000100:00100000:0.0:1788459893.563240:0:7463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000234d909b pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:7463:1875336022202112:0@lo:503: 00000100:00100000:0.0:1788459893.563286:0:7463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459893.563390:0:7463:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b4089c29 going to sleep for 11 seconds 00000100:00100000:3.0:1788459893.563420:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022202112 00000100:00100000:3.0:1788459893.563425:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022202112 00000100:00100000:3.0:1788459893.563486:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788459893.563493:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ba6a91ba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+13:7463:x1875336022202112:12345-0@lo:503: 00000100:00100000:3.0:1788459893.563573:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ba6a91ba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+13:7463:x1875336022202112:12345-0@lo:503: Request processed in 81us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459893.563580:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788459893.565206:0:7463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000234d909b pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:7463:1875336022202112:0@lo:503: 00000040:00080000:0.0:1788459893.565765:0:7463:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788459893.565857:0:7463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000234d909b pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:7463:1875336022202240:0@lo:502: 00000100:00100000:0.0:1788459893.565921:0:7463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459893.566724:0:7463:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b4089c29 going to sleep for 11 seconds 00000100:00100000:1.0:1788459893.567289:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022202240 00000100:00100000:1.0:1788459893.567298:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022202240 00000100:00100000:1.0:1788459893.567344:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788459893.567352:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004f2718fd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+13:7463:x1875336022202240:12345-0@lo:502: 00000100:00100000:1.0:1788459893.567498:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004f2718fd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+13:7463:x1875336022202240:12345-0@lo:502: Request processed in 147us (1578us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459893.567505:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788459893.567576:0:7463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000234d909b pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:7463:1875336022202240:0@lo:502: 00000040:00080000:3.0:1788459893.567845:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788459893.567876:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:3.0:1788459893.568044:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:3.0:1788459893.568059:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:3.0:1788459893.568562:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:3.0:1788459893.568579:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:3.0:1788459893.568593:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:3.0:1788459893.568607:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:3.0:1788459893.568623:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:3.0:1788459893.568654:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:3.0:1788459893.568668:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:3.0:1788459893.568682:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:3.0:1788459893.568711:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:3.0:1788459893.568749:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:3.0:1788459893.568767:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:3.0:1788459893.568781:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:3.0:1788459893.568794:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:3.0:1788459893.568806:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:3.0:1788459893.568818:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:3.0:1788459893.568830:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:3.0:1788459893.568842:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:3.0:1788459893.568854:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:3.0:1788459893.568867:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:3.0:1788459893.568989:0:7463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a7c9811e pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:7463:1875336022202368:0@lo:502: 00000100:00100000:3.0:1788459893.569072:0:7463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459893.569114:0:7463:0:(client.c:2716:ptlrpc_set_wait()) set 00000000db5fdb2b going to sleep for 11 seconds 00000100:00100000:1.0:1788459893.569605:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022202368 00000100:00100000:1.0:1788459893.569619:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022202368 00000100:00100000:1.0:1788459893.569670:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788459893.569678:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003e8059d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+13:7463:x1875336022202368:12345-0@lo:502: 00000100:00100000:1.0:1788459893.569799:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003e8059d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+13:7463:x1875336022202368:12345-0@lo:502: Request processed in 121us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459893.569806:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788459893.570657:0:7463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a7c9811e pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:7463:1875336022202368:0@lo:502: 00000040:00080000:3.0:1788459893.570771:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:3.0:1788459893.570794:0:7463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:0.0:1788459893.574032:0:7475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788459893.574046:0:7475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788459893.574048:0:7475:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1788459893.574053:0:7475:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:0.0:1788459893.574056:0:7475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788459893.574435:0:7475:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (000000004298fac9) 00000020:00000080:0.0:1788459893.574455:0:7475:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:0.0:1788459893.574463:0:7475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788459893.575400:0:7475:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788459893.575411:0:7475:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5dfa74784542aa00 00000020:00000080:0.0:1788459893.577016:0:7475:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1788459893.577026:0:7475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788459893.577031:0:7475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788459893.577033:0:7475:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1788459893.577036:0:7475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788459893.577041:0:7475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788459893.577042:0:7475:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:0.0:1788459893.577046:0:7475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788459893.577057:0:7475:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (0000000073d3fcdc) 00000020:00000080:0.0:1788459893.577075:0:7475:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:0.0:1788459893.577079:0:7475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788459893.577081:0:7475:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:0.0:1788459893.577083:0:7475:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:0.0:1788459893.577090:0:7475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788459893.577160:0:7475:0:(tgt_mount.c:167:server_get_mount()) get mount 0000000063f701fb from lustre-MDT0001, refs=2 00000020:00000080:0.0:1788459893.577179:0:7475:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (000000008c9b23b9) 00000020:00000080:0.0:1788459893.577189:0:7475:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:0.0:1788459893.577237:0:7475:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788459893.577242:0:7475:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5dfa74784542aa15 00000020:00000080:0.0:1788459893.577504:0:7475:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:0.0:1788459893.577511:0:7475:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788459893.577515:0:7475:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x5dfa74784542aa1c 00080000:01000000:0.0:1788459893.577522:0:7475:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788459893.577525:0:7475:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5dfa74784542aa23 00080000:10000000:1.0:1788459893.579616:0:7475:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:1.0:1788459893.579874:0:7475:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:1.0:1788459893.752899:0:7475:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:1.0:1788459893.760218:0:7475:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:1.0:1788459893.764177:0:7475:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1788459893.764521:0:7475:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788459893.795838:0:7475:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1788459893.795851:0:7475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788459893.795856:0:7475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788459893.795859:0:7475:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1788459893.795863:0:7475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788459893.795867:0:7475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788459893.795869:0:7475:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1788459893.795871:0:7475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788459893.795876:0:7475:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.105@tcp to nid 0x20000c0a8ce69 (192.168.206.105@tcp) 00000020:00000080:3.0:1788459893.795902:0:7475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788459893.795915:0:7475:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (000000009b10e916) 00000020:00000080:3.0:1788459893.795935:0:7475:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1788459893.795979:0:7475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788459893.798885:0:7475:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1788459893.798896:0:7475:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788459893.798915:0:7475:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5dfa74784542aa31 00010000:00080000:3.0:1788459893.798968:0:7475:0:(ldlm_lib.c:102:import_set_conn()) imp 000000000365a6f0@lustre-MDT0000-osp-MDT0001: add connection 192.168.206.105@tcp at head 00010000:00010000:3.0:1788459893.804569:0:7475:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:1.0:1788459893.813557:0:7475:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788459893.813570:0:7475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1788459893.813618:0:7475:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788459893.813639:0:7475:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5dfa74784542aa38 00000100:00080000:1.0:1788459893.813648:0:7475:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788459893.813653:0:7475:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 000000000365a6f0 using connection 192.168.206.105@tcp/0@lo 00000100:00100000:1.0:1788459893.813696:0:7475:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000003521a457 x1875336022202496/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788459893.813724:0:7475:0:(pinger.c:380:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788459893.813767:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003521a457 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1875336022202496:0@lo:38: 00000020:01000000:1.0:1788459893.813775:0:7475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788459893.813778:0:7475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788459893.813780:0:7475:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1788459893.813782:0:7475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788459893.813785:0:7475:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1788459893.813786:0:7475:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788459893.813787:0:7475:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788459893.813794:0:7475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788459893.813796:0:7475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788459893.813797:0:7475:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788459893.813800:0:7475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788459893.813803:0:7475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788459893.813804:0:7475:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1788459893.813808:0:7475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788459893.813826:0:3658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:01000000:1.0:1788459893.813834:0:7475:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788459893.813848:0:7475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00100000:1.0:1788459893.813865:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022202496 00000100:00100000:1.0:1788459893.813870:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022202496 00000100:00100000:1.0:1788459893.813896:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788459893.813901:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004865996c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3658:x1875336022202496:12345-0@lo:38: 00010000:00080000:1.0:1788459893.813922:0:6538:0:(ldlm_lib.c:1461:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 190 last 0 00000020:00000080:1.0:1788459893.813975:0:6538:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5dfa74784542aa3f 00000004:00100000:1.0:1788459893.813989:0:6538:0:(mdt_handler.c:7310:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1788459893.813994:0:6538:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000020:00000080:1.0:1788459893.814053:0:7475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788459893.814056:0:7475:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1788459893.814060:0:7475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788459893.814063:0:7475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788459893.814064:0:7475:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788459893.814067:0:7475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788459893.814069:0:7475:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788459893.814090:0:7475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788459893.814093:0:7475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788459893.814094:0:7475:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788459893.814096:0:7475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000100:00100000:1.0:1788459893.814416:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a7c9811e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875336022202624:0@lo:400: 00000020:01000000:2.0:1788459893.814450:0:7463:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 00000100:00100000:1.0:1788459893.814452:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:2.0:1788459893.814461:0:7463:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1788459893.814473:0:7463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: 0000000090767814/0x5dfa74784542a9eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542a9f2 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459893.814482:0:7463:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: 0000000090767814/0x5dfa74784542a9eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542a9f2 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788459893.814490:0:7463:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-mdtir-ffff8c4bc438f000 from 1 10000000:01000000:2.0:1788459893.814493:0:7463:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00000100:00100000:3.0:1788459893.814539:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022202624 00000100:00100000:3.0:1788459893.814545:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022202624 00000100:00100000:3.0:1788459893.814586:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788459893.814592:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000539a6708 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1875336022202624:12345-0@lo:400: 00000100:00100000:3.0:1788459893.814638:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000539a6708 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1875336022202624:12345-0@lo:400: Request processed in 47us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459893.814645:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1788459893.814705:0:7463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: 000000007c713e88/0x5dfa74784542aa46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459893.814720:0:7463:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: 000000007c713e88/0x5dfa74784542aa46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459893.814728:0:7463:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: 000000007c713e88/0x5dfa74784542aa46 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788459893.814742:0:7463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000d0a4161 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:7463:1875336022202752:0@lo:101: 00000100:00100000:1.0:1788459893.814771:0:7463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459893.814799:0:7463:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ce06bb4f going to sleep for 11 seconds 00010000:00080000:1.0:1788459893.814827:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000a7c9811e x1875336022202624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788459909 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788459893.814839:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022202752 00000100:00100000:1.0:1788459893.814839:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a7c9811e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875336022202624:0@lo:400: 00000100:00100000:2.0:1788459893.814843:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022202752 00000100:00100000:3.0:1788459893.815214:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788459893.815224:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002afe47a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+13:7463:x1875336022202752:12345-0@lo:101: 00010000:00010000:3.0:1788459893.815234:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788459893.815246:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005bc554f3/0x5dfa74784542aa4d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542aa46 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459893.815265:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005bc554f3/0x5dfa74784542aa4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542aa46 expref: 14 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459893.815274:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005bc554f3/0x5dfa74784542aa4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542aa46 expref: 14 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459893.815281:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005bc554f3, rc 0) 00000100:00100000:3.0:1788459893.815321:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002afe47a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+14:7463:x1875336022202752:12345-0@lo:101: Request processed in 101us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459893.815327:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788459893.815390:0:7463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000d0a4161 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:7463:1875336022202752:0@lo:101: 00010000:00010000:2.0:1788459893.815403:0:7463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: 000000007c713e88/0x5dfa74784542aa46 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542aa4d expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459893.815411:0:7463:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: 000000007c713e88/0x5dfa74784542aa46 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542aa4d expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788459893.815971:0:7463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000d0a4161 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:7463:1875336022202880:0@lo:256: 00000100:00100000:1.0:1788459893.818055:0:7463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459893.818097:0:7463:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c90caf1d going to sleep for 11 seconds 00000100:00100000:2.0:1788459893.818392:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022202880 00000100:00100000:2.0:1788459893.818400:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022202880 00000100:00100000:2.0:1788459893.818459:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788459893.818467:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001d4de6cc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+14:7463:x1875336022202880:12345-0@lo:256: 20000000:01000000:2.0:1788459893.818489:0:6525:0:(mgs_nids.c:1209:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788459893.818513:0:6525:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788459893.818516:0:6525:0:(mgs_nids.c:325:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1788459893.818620:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001d4de6cc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+14:7463:x1875336022202880:12345-0@lo:256: Request processed in 154us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459893.818629:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788459893.818870:0:7463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000d0a4161 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:7463:1875336022202880:0@lo:256: 10000000:01000000:1.0:1788459893.819491:0:7463:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788459893.819509:0:7463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: 000000007c713e88/0x5dfa74784542aa46 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542aa4d expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459893.819520:0:7463:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: 000000007c713e88/0x5dfa74784542aa46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542aa4d expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788459893.819528:0:7463:0:(mgc_request.c:2266:mgc_process_log()) Process log params-ffff8c4bc438f000 from 1 10000000:01000000:1.0:1788459893.819531:0:7463:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788459893.819562:0:7463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: 0000000046c1cbfc/0x5dfa74784542aa54 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459893.819594:0:7463:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: 0000000046c1cbfc/0x5dfa74784542aa54 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459893.819602:0:7463:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: 0000000046c1cbfc/0x5dfa74784542aa54 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788459893.819623:0:7463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008a88aee7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:7463:1875336022203008:0@lo:101: 00000100:00100000:1.0:1788459893.819662:0:7463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459893.819713:0:7463:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ce06bb4f going to sleep for 11 seconds 00000100:00100000:3.0:1788459893.819751:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022203008 00000100:00100000:3.0:1788459893.819757:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022203008 00000100:00100000:3.0:1788459893.819796:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788459893.819811:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008781b858 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+14:7463:x1875336022203008:12345-0@lo:101: 00010000:00010000:3.0:1788459893.819821:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788459893.819830:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000de1dcc27/0x5dfa74784542aa5b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542aa54 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459893.819848:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000de1dcc27/0x5dfa74784542aa5b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542aa54 expref: 15 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459893.819859:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000de1dcc27/0x5dfa74784542aa5b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542aa54 expref: 15 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459893.819867:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000de1dcc27, rc 0) 00000100:00100000:3.0:1788459893.820555:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008781b858 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+15:7463:x1875336022203008:12345-0@lo:101: Request processed in 743us (890us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459893.820564:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788459893.823049:0:7463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008a88aee7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:7463:1875336022203008:0@lo:101: 00010000:00010000:2.0:1788459893.823075:0:7463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: 0000000046c1cbfc/0x5dfa74784542aa54 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542aa5b expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459893.823086:0:7463:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: 0000000046c1cbfc/0x5dfa74784542aa54 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542aa5b expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788459893.823185:0:7463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b7b076c1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:7463:1875336022203136:0@lo:501: 00000100:00100000:2.0:1788459893.823236:0:7463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459893.823270:0:7463:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c2c12000 going to sleep for 11 seconds 00000100:00100000:3.0:1788459893.826177:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022203136 00000100:00100000:3.0:1788459893.826190:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022203136 00000100:00100000:3.0:1788459893.826236:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788459893.826245:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000079e0350f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+15:7463:x1875336022203136:12345-0@lo:501: 00000100:00100000:3.0:1788459893.826384:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000079e0350f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+15:7463:x1875336022203136:12345-0@lo:501: Request processed in 140us (3148us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459893.826392:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788459893.826499:0:7463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b7b076c1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:7463:1875336022203136:0@lo:501: 00000100:00100000:0.0:1788459893.826545:0:7463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009696debd pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:7463:1875336022203264:0@lo:503: 00000100:00100000:0.0:1788459893.826590:0:7463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459893.826631:0:7463:0:(client.c:2716:ptlrpc_set_wait()) set 0000000046981dd8 going to sleep for 11 seconds 00000100:00100000:3.0:1788459893.827216:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022203264 00000100:00100000:3.0:1788459893.827221:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022203264 00000100:00100000:3.0:1788459893.827254:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788459893.827261:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000079a8ff8f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+15:7463:x1875336022203264:12345-0@lo:503: 00000040:00080000:3.0:1788459893.827296:0:6528:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788459893.827336:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000079a8ff8f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+15:7463:x1875336022203264:12345-0@lo:503: Request processed in 75us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459893.827351:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:2.0:1788459893.827415:0:6538:0:(import.c:65:import_set_state_nolock()) 00000000a97716db : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788459893.827435:0:7463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009696debd pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:7463:1875336022203264:0@lo:503: 00000100:00100000:2.0:1788459893.827465:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004865996c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3658:x1875336022202496:12345-0@lo:38: Request processed in 13563us (13639us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459893.827473:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788459893.827537:0:3658:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788459893.827544:0:3658:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1788459893.827550:0:3658:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1788459893.827555:0:3658:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788459893.827557:0:3658:0:(import.c:65:import_set_state_nolock()) 000000000365a6f0 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788459893.827575:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003521a457 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1875336022202496:0@lo:38: 00000040:00080000:0.0:1788459893.827651:0:7463:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788459893.827712:0:7463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:0.0:1788459893.827792:0:7463:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788459893.829354:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dfd9dedb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022203392:0@lo:41: 00000100:00100000:1.0:1788459893.829412:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459893.829698:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022203392 00000100:00100000:3.0:1788459893.829705:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022203392 00000100:00100000:3.0:1788459893.829767:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788459893.829775:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003521a457 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3662:x1875336022203392:12345-0@lo:41: 00000004:00000024:3.0:1788459893.829804:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:3.0:1788459893.829857:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003521a457 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3662:x1875336022203392:12345-0@lo:41: Request processed in 83us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459893.829864:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788459893.830084:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dfd9dedb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022203392:0@lo:41: 00000040:00080000:3.0:1788459893.831361:0:7480:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:0.0:1788459893.831496:0:7463:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1788459893.831510:0:7463:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788459893.831532:0:7463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: 0000000046c1cbfc/0x5dfa74784542aa54 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542aa5b expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459893.831543:0:7463:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: 0000000046c1cbfc/0x5dfa74784542aa54 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542aa5b expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788459893.831591:0:7463:0:(mgc_request.c:2423:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788459893.831594:0:7463:0:(mgc_request.c:424:config_log_add()) add config log lustre-client-ffff8c4bc438f000 10000000:01000000:0.0:1788459893.831613:0:7463:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-client-ffff8c4bc438f000 10000000:01000000:0.0:1788459893.831619:0:7463:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788459893.831637:0:7463:0:(mgc_request_server.c:106:mgc_fs_setup()) mgc192.168.206.105@tcp: setup lustre-MDT0001-osd 00000040:01000000:0.0:1788459893.831727:0:7463:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.206.105@tcp ctxt 1 is initialized 00000040:01000000:0.0:1788459893.831743:0:7463:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.206.105@tcp ctxt 0 is initialized 10000000:01000000:0.0:1788459893.831753:0:7463:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-client-ffff8c4bc438f000 from 1 10000000:01000000:0.0:1788459893.831756:0:7463:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788459893.831796:0:7463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: 00000000d7909833/0x5dfa74784542aa62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459893.831805:0:7463:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: 00000000d7909833/0x5dfa74784542aa62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459893.831814:0:7463:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: 00000000d7909833/0x5dfa74784542aa62 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788459893.831832:0:7463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009696debd pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:7463:1875336022203520:0@lo:101: 00000100:00100000:0.0:1788459893.831896:0:7463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459893.832223:0:7463:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b4089c29 going to sleep for 11 seconds 00000100:00100000:1.0:1788459893.836551:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022203520 00000100:00100000:1.0:1788459893.836567:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022203520 00000100:00100000:1.0:1788459893.836639:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788459893.836648:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c3eb8c36 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+15:7463:x1875336022203520:12345-0@lo:101: 00010000:00010000:1.0:1788459893.836664:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788459893.836679:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000037c8c1d1/0x5dfa74784542aa69 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542aa62 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459893.836717:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000037c8c1d1/0x5dfa74784542aa69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542aa62 expref: 16 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459893.837032:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000037c8c1d1/0x5dfa74784542aa69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542aa62 expref: 16 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459893.837040:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000037c8c1d1, rc 0) 00000100:00100000:1.0:1788459893.837117:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c3eb8c36 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+16:7463:x1875336022203520:12345-0@lo:101: Request processed in 470us (5221us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459893.837124:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788459893.837227:0:7463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009696debd pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:7463:1875336022203520:0@lo:101: 00010000:00010000:0.0:1788459893.837243:0:7463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: 00000000d7909833/0x5dfa74784542aa62 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542aa69 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459893.837252:0:7463:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: 00000000d7909833/0x5dfa74784542aa62 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542aa69 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788459893.837332:0:7463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009696debd pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:7463:1875336022203648:0@lo:501: 00000100:00100000:0.0:1788459893.837365:0:7463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459893.837402:0:7463:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b4089c29 going to sleep for 11 seconds 00000100:00100000:1.0:1788459893.838283:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022203648 00000100:00100000:1.0:1788459893.838292:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022203648 00000100:00100000:1.0:1788459893.838336:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788459893.838344:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000259cc4b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+16:7463:x1875336022203648:12345-0@lo:501: 00000100:00100000:1.0:1788459893.838631:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000259cc4b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+16:7463:x1875336022203648:12345-0@lo:501: Request processed in 287us (1265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459893.838638:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788459893.838776:0:7463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009696debd pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:7463:1875336022203648:0@lo:501: 00000100:00100000:0.0:1788459893.838825:0:7463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009696debd pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:7463:1875336022203776:0@lo:503: 00000100:00100000:0.0:1788459893.838865:0:7463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459893.839061:0:7463:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b4089c29 going to sleep for 11 seconds 00000100:00100000:1.0:1788459893.840033:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022203776 00000100:00100000:1.0:1788459893.840041:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022203776 00000100:00100000:1.0:1788459893.840081:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788459893.840088:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cf36c661 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+16:7463:x1875336022203776:12345-0@lo:503: 00000100:00100000:1.0:1788459893.840208:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cf36c661 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+16:7463:x1875336022203776:12345-0@lo:503: Request processed in 121us (1343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459893.840216:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788459893.841226:0:7463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009696debd pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:7463:1875336022203776:0@lo:503: 00000040:00080000:0.0:1788459893.841512:0:7463:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788459893.841581:0:7463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009696debd pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:7463:1875336022203904:0@lo:502: 00000100:00100000:0.0:1788459893.841650:0:7463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459893.841696:0:7463:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b4089c29 going to sleep for 11 seconds 00000100:00100000:1.0:1788459893.841897:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022203904 00000100:00100000:1.0:1788459893.841904:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022203904 00000100:00100000:1.0:1788459893.841938:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788459893.841969:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c023a89e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+16:7463:x1875336022203904:12345-0@lo:502: 00000100:00100000:1.0:1788459893.842066:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c023a89e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+16:7463:x1875336022203904:12345-0@lo:502: Request processed in 98us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459893.842078:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788459893.843496:0:7463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009696debd pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:7463:1875336022203904:0@lo:502: 00000040:00080000:0.0:1788459893.843749:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1788459893.843778:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1788459893.843793:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1788459893.843837:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1788459893.843850:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1788459893.843862:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1788459893.843873:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1788459893.845087:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1788459893.845121:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1788459893.845138:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1788459893.845154:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1788459893.845170:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1788459893.845184:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1788459893.845197:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1788459893.845210:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1788459893.845223:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1788459893.845238:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1788459893.845252:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1788459893.845265:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1788459893.845297:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1788459893.845321:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1788459893.845334:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1788459893.845346:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1788459893.845359:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1788459893.845372:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1788459893.845386:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1788459893.845399:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1788459893.845413:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:0.0:1788459893.845452:0:7463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009696debd pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:7463:1875336022204032:0@lo:502: 00000100:00100000:0.0:1788459893.845519:0:7463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459893.845551:0:7463:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b4089c29 going to sleep for 11 seconds 00000100:00100000:2.0:1788459893.845608:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022204032 00000100:00100000:2.0:1788459893.845615:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022204032 00000100:00100000:2.0:1788459893.845658:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788459893.845666:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000044ad5154 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+16:7463:x1875336022204032:12345-0@lo:502: 00000100:00100000:2.0:1788459893.845813:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000044ad5154 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+16:7463:x1875336022204032:12345-0@lo:502: Request processed in 147us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459893.845821:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788459893.849316:0:7463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009696debd pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:7463:1875336022204032:0@lo:502: 00000040:00080000:0.0:1788459893.849410:0:7463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1788459893.849423:0:7463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1788459893.850537:0:7481:0:(obd_mount.c:308:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1788459893.850570:0:7481:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (000000007d053024) 00000020:00000080:3.0:1788459893.850590:0:7481:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1788459893.850677:0:7481:0:(tgt_mount.c:167:server_get_mount()) get mount 0000000063f701fb from lustre-MDT0001, refs=3 00000020:01000004:3.0:1788459893.850692:0:7481:0:(tgt_mount.c:201:server_put_mount()) put mount 0000000063f701fb from lustre-MDT0001, refs=3 00000020:01000004:3.0:1788459893.850695:0:7481:0:(obd_mount.c:798:lustre_put_lsi()) put 0000000063f701fb 3 00010000:00080000:3.0:1788459893.850724:0:7481:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000813aa12a@lustre-MDT0000-lwp-MDT0001: add connection 192.168.206.105@tcp at head 00010000:00010000:3.0:1788459893.852286:0:7481:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:3.0:1788459893.852443:0:7481:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1788459893.852484:0:7481:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788459893.852495:0:7481:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x5dfa74784542aa77 00000100:00080000:3.0:1788459893.852503:0:7481:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788459893.852507:0:7481:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 00000000813aa12a using connection 192.168.206.105@tcp/0@lo 00000100:00100000:3.0:1788459893.852535:0:7481:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000005436df5 x1875336022204160/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788459893.852561:0:7481:0:(pinger.c:380:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788459893.852860:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000005436df5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1875336022204160:0@lo:38: 00000100:00100000:1.0:1788459893.852934:0:3658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459893.853516:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022204160 00000100:00100000:2.0:1788459893.853524:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022204160 00000100:00100000:2.0:1788459893.853562:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788459893.853568:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005d94e9e3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3658:x1875336022204160:12345-0@lo:38: 00010000:00080000:2.0:1788459893.853591:0:6534:0:(ldlm_lib.c:1461:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 190 last 0 00000020:00000080:2.0:1788459893.853631:0:6534:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x5dfa74784542aa7e 00000004:00100000:2.0:1788459893.853645:0:6534:0:(mdt_handler.c:7310:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788459893.853670:0:6534:0:(import.c:65:import_set_state_nolock()) 00000000177cc87b : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788459893.853745:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005d94e9e3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1875336022204160:12345-0@lo:38: Request processed in 165us (801us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459893.853753:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788459893.853790:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000005436df5 x1875336022204160/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788459903 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788459893.853801:0:3658:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788459893.853807:0:3658:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1788459893.853813:0:3658:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788459893.853817:0:3658:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788459893.853819:0:3658:0:(import.c:65:import_set_state_nolock()) 00000000813aa12a lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788459893.853823:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000005436df5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1875336022204160:0@lo:38: 40000000:00080000:1.0:1788459893.856072:0:7482:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000040:00080000:3.0:1788459893.856209:0:7481:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:2.0:1788459893.856461:0:7463:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1788459893.856474:0:7463:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788459893.856485:0:7463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: 00000000d7909833/0x5dfa74784542aa62 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542aa69 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459893.856506:0:7463:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: 00000000d7909833/0x5dfa74784542aa62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542aa69 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788459893.856558:0:7463:0:(tgt_mount.c:1239:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788459893.856560:0:7463:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788459893.856562:0:7463:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788459893.856562:0:7463:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:2.0:1788459893.856563:0:7463:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788459893.856565:0:7463:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788459893.856566:0:7463:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788459893.856567:0:7463:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788459893.856568:0:7463:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788459893.856569:0:7463:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788459893.856571:0:7463:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788459893.856574:0:7463:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:2.0:1788459893.856576:0:7463:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788459893.856578:0:7463:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788459893.856579:0:7463:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788459893.856579:0:7463:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:2.0:1788459893.856580:0:7463:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788459893.856581:0:7463:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788459893.856582:0:7463:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788459893.856583:0:7463:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788459893.856584:0:7463:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788459893.856584:0:7463:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788459893.856585:0:7463:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788459893.856623:0:7463:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1788459893.856640:0:7463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e507f064 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:7463:1875336022204288:0@lo:253: 00000100:00100000:2.0:1788459893.856720:0:7463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459893.856997:0:7463:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ccc98275 going to sleep for 11 seconds 00000100:00100000:3.0:1788459893.857851:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022204288 00000100:00100000:3.0:1788459893.857860:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022204288 00000100:00100000:3.0:1788459893.857912:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788459893.857921:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b69cda62 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+16:7463:x1875336022204288:12345-0@lo:253: 20000000:01000000:3.0:1788459893.857972:0:6525:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788459893.857984:0:6525:0:(mgs_nids.c:475:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:1.0:1788459893.860032:0:6513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1788459893.860103:0:6525:0:(mgs_nids.c:842:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788459893.860123:0:6525:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:1.0:1788459893.860223:0:6549:0:(mgs_nids.c:739:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788459893.860228:0:6549:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788459893.860245:0:6549:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000098e8e391/0x5dfa74784542aa85 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459893.860261:0:6549:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000ddbc28f9/0x5dfa74784542a9a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542a99e expref: 16 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459893.860268:0:6549:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000005bc554f3/0x5dfa74784542aa4d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542aa46 expref: 16 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459893.860274:0:6549:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000098e8e391/0x5dfa74784542aa85 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459893.860309:0:6549:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000005bc554f3/0x5dfa74784542aa4d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5dfa74784542aa46 expref: 16 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459893.860322:0:6549:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000005bc554f3/0x5dfa74784542aa4d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5dfa74784542aa46 expref: 16 pid: 6526 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788459893.860334:0:6549:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002737a0de pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6549:1875336022204416:0@lo:104: 00000100:00100000:1.0:1788459893.860388:0:6549:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788459893.860445:0:6549:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000ddbc28f9/0x5dfa74784542a9a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5dfa74784542a99e expref: 16 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459893.860467:0:6549:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000ddbc28f9/0x5dfa74784542a9a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5dfa74784542a99e expref: 16 pid: 6525 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788459893.860475:0:6549:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001a8ffae8 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6549:1875336022204544:0@lo:104: 00000100:00100000:1.0:1788459893.860498:0:6549:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459893.860516:0:6549:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c7ce8c3e going to sleep for 11 seconds 00000100:00100000:1.0:1788459893.860539:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022204416 00000100:00100000:1.0:1788459893.860545:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022204416 00000100:00100000:1.0:1788459893.860573:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022204544 00000100:00100000:1.0:1788459893.860576:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022204544 00000100:00100000:1.0:1788459893.860588:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788459893.860595:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fd3e612a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0cf73fe6-82e2-434e-b670-631647721b2c+4:6549:x1875336022204416:12345-0@lo:104: 00010000:00010000:1.0:1788459893.860611:0:6516:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.206.105@tcp lock: 000000007c713e88/0x5dfa74784542aa46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542aa4d expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459893.860654:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788459893.860659:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fd3e612a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0cf73fe6-82e2-434e-b670-631647721b2c+4:6549:x1875336022204416:12345-0@lo:104: Request processed in 66us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459893.860665:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788459893.860679:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788459893.860698:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ecf8a93a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0cf73fe6-82e2-434e-b670-631647721b2c+3:6549:x1875336022204544:12345-0@lo:104: 00010000:00010000:1.0:1788459893.860705:0:6516:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.206.105@tcp lock: 00000000118c0519/0x5dfa74784542a99e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542a9a5 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459893.860818:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788459893.860823:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ecf8a93a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0cf73fe6-82e2-434e-b670-631647721b2c+3:6549:x1875336022204544:12345-0@lo:104: Request processed in 126us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459893.860837:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1788459893.860853:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788459893.860857:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: 000000007c713e88/0x5dfa74784542aa46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542aa4d expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459893.860864:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007c713e88 already unused, calling callback (000000000de01725) 10000000:00010000:1.0:1788459893.860867:0:6521:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: 000000007c713e88/0x5dfa74784542aa46 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5dfa74784542aa4d expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459893.860873:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: 000000007c713e88/0x5dfa74784542aa46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5dfa74784542aa4d expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788459893.861723:0:6521:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: 000000007c713e88/0x5dfa74784542aa46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5dfa74784542aa4d expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788459893.861805:0:6521:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788459893.861841:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.206.105@tcp lock: 000000007c713e88/0x5dfa74784542aa46 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542aa4d expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459893.861848:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788459893.861864:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: 000000007c713e88/0x5dfa74784542aa46 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542aa4d expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459893.861871:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: 000000007c713e88/0x5dfa74784542aa46 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542aa4d expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459893.861967:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788459893.861971:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: 00000000118c0519/0x5dfa74784542a99e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542a9a5 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459893.861990:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000118c0519 already unused, calling callback (000000000de01725) 10000000:00010000:1.0:1788459893.861992:0:6521:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: 00000000118c0519/0x5dfa74784542a99e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5dfa74784542a9a5 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459893.861999:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: 00000000118c0519/0x5dfa74784542a99e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5dfa74784542a9a5 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788459893.862004:0:6521:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: 00000000118c0519/0x5dfa74784542a99e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5dfa74784542a9a5 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788459893.862009:0:6521:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788459893.862024:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.206.105@tcp lock: 00000000118c0519/0x5dfa74784542a99e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542a9a5 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459893.862029:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788459893.862033:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: 00000000118c0519/0x5dfa74784542a99e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542a9a5 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459893.862039:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: 00000000118c0519/0x5dfa74784542a99e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542a9a5 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459893.862057:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788459893.862058:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788459893.862060:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788459893.862070:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788459893.862084:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b031a40d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0cf73fe6-82e2-434e-b670-631647721b2c:3659:1875336022204672:0@lo:103: 00000100:00100000:1.0:1788459893.862122:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459893.862144:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022204672 00000100:00100000:2.0:1788459893.862149:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022204672 00000100:00100000:1.0:1788459893.862154:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788459893.862158:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000008a88aee7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0cf73fe6-82e2-434e-b670-631647721b2c:3659:1875336022204800:0@lo:103: 00010000:00010000:2.0:1788459893.862169:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000005bc554f3/0x5dfa74784542aa4d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542aa46 expref: 17 pid: 6526 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788459893.862184:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459893.867060:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b69cda62 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+17:7463:x1875336022204288:12345-0@lo:253: Request processed in 9134us (10333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459893.867075:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788459893.870290:0:7463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e507f064 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:7463:1875336022204288:0@lo:253: 10000000:01000000:2.0:1788459893.870308:0:7463:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1788459893.870312:0:7463:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788459893.870313:0:7463:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788459893.870315:0:7463:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788459893.870316:0:7463:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:2.0:1788459893.870317:0:7463:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788459893.870318:0:7463:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788459893.870319:0:7463:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788459893.870320:0:7463:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788459893.870322:0:7463:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788459893.870323:0:7463:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788459893.870324:0:7463:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788459893.870339:0:7463:0:(tgt_mount.c:2880:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1788459893.870851:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022204800 00000100:00100000:3.0:1788459893.870859:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022204800 00010000:00010000:3.0:1788459893.870895:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000ddbc28f9/0x5dfa74784542a9a5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542a99e expref: 17 pid: 6525 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788459893.870920:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788459893.870927:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b3753907 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0cf73fe6-82e2-434e-b670-631647721b2c+17:3659:x1875336022204672:12345-0@lo:103: 00010000:00010000:3.0:1788459893.870941:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788459893.870961:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000005bc554f3/0x5dfa74784542aa4d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542aa46 expref: 17 pid: 6526 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459893.870972:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000005bc554f3/0x5dfa74784542aa4d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5dfa74784542aa46 expref: 17 pid: 6526 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459893.870991:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788459893.871051:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b3753907 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0cf73fe6-82e2-434e-b670-631647721b2c+17:3659:x1875336022204672:12345-0@lo:103: Request processed in 125us (8928us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459893.871058:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788459893.871075:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788459893.871093:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001ac418e9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0cf73fe6-82e2-434e-b670-631647721b2c+16:3659:x1875336022204800:12345-0@lo:103: 00010000:00010000:3.0:1788459893.871100:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788459893.871104:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000ddbc28f9/0x5dfa74784542a9a5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542a99e expref: 16 pid: 6525 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459893.871112:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000ddbc28f9/0x5dfa74784542a9a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5dfa74784542a99e expref: 16 pid: 6525 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459893.871123:0:6518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000098e8e391/0x5dfa74784542aa85 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459893.871131:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000098e8e391/0x5dfa74784542aa85 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788459893.871146:0:6518:0:(mgs_nids.c:715:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.010918397s 00010000:00010000:3.0:1788459893.871150:0:6518:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000098e8e391/0x5dfa74784542aa85 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459893.871156:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000098e8e391/0x5dfa74784542aa85 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459893.871163:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000098e8e391/0x5dfa74784542aa85 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459893.871168:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000098e8e391/0x5dfa74784542aa85 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459893.871174:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000098e8e391 already unused, calling callback (000000003e0ee701) 00010000:00010000:3.0:1788459893.871177:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000098e8e391/0x5dfa74784542aa85 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459893.871184:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000098e8e391/0x5dfa74784542aa85 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459893.871201:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000098e8e391/0x5dfa74784542aa85 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459893.871210:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788459893.871234:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001ac418e9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0cf73fe6-82e2-434e-b670-631647721b2c+16:3659:x1875336022204800:12345-0@lo:103: Request processed in 142us (9049us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459893.871240:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788459893.871654:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000008a88aee7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0cf73fe6-82e2-434e-b670-631647721b2c:3659:1875336022204800:0@lo:103: 00000100:00100000:1.0:1788459893.871664:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b031a40d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0cf73fe6-82e2-434e-b670-631647721b2c:3659:1875336022204672:0@lo:103: 00010000:00010000:1.0:1788459893.871710:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005bc554f3/0x5dfa74784542aa4d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5dfa74784542aa46 expref: 15 pid: 6526 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788459893.871722:0:6549:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002737a0de pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6549:1875336022204416:0@lo:104: 00010000:00010000:1.0:1788459893.871732:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ddbc28f9/0x5dfa74784542a9a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5dfa74784542a99e expref: 14 pid: 6525 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788459893.871751:0:6549:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001a8ffae8 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6549:1875336022204544:0@lo:104: 00010000:00010000:1.0:1788459893.871763:0:6549:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000098e8e391/0x5dfa74784542aa85 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459893.871771:0:6549:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000098e8e391/0x5dfa74784542aa85 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459893.871776:0:6549:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000098e8e391/0x5dfa74784542aa85 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459893.871781:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000098e8e391/0x5dfa74784542aa85 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:3.0:1788459893.882238:0:7463:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:3.0:1788459893.882409:0:7463:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1788459893.882598:0:7463:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1788459893.884312:0:7463:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1788459893.884526:0:7463:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1788459893.887247:0:7463:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:2.0:1788459893.889359:0:7463:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1788459893.889591:0:7463:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:2.0:1788459893.889791:0:7463:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:2.0:1788459893.889965:0:7463:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:2.0:1788459893.890137:0:7463:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:2.0:1788459893.890311:0:7463:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:0.0:1788459893.897870:0:7463:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000040:01000000:0.0:1788459893.898216:0:7487:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:0.0:1788459893.898263:0:7487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009696debd pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7487:1875336022204928:0@lo:700: 00000100:00100000:0.0:1788459893.898334:0:7487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459893.898376:0:7487:0:(client.c:2716:ptlrpc_set_wait()) set 000000008e50451c going to sleep for 11 seconds 00000040:01000000:1.0:1788459893.898539:0:7463:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:1.0:1788459893.898854:0:7488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001a8ffae8 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7488:1875336022205056:0@lo:1000: 00000100:00100000:1.0:1788459893.898889:0:7488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459893.898914:0:7488:0:(client.c:2716:ptlrpc_set_wait()) set 000000009d80a84d going to sleep for 11 seconds 00000040:01000000:0.0:1788459893.899301:0:7463:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:0.0:1788459893.899673:0:7463:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:2.0:1788459893.900023:0:7486:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:2.0:1788459893.900027:0:7486:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000100:00100000:3.0:1788459893.900316:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022204928 00000100:00100000:3.0:1788459893.900326:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022204928 00000100:00100000:3.0:1788459893.900371:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788459893.900378:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e7216142 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7487:x1875336022204928:12345-0@lo:700: 00000100:00100000:3.0:1788459893.900456:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022205056 00000100:00100000:3.0:1788459893.900459:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022205056 00000100:00100000:3.0:1788459893.900496:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788459893.900501:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002737a0de pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7488:x1875336022205056:12345-0@lo:1000: 00000004:00000080:0.0:1788459893.900523:0:7463:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788459893.900530:0:7463:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000100:00100000:3.0:1788459893.900580:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002737a0de pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7488:x1875336022205056:12345-0@lo:1000: Request processed in 80us (1691us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459893.900588:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:00080000:0.0:1788459893.900713:0:7463:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788459893.901613:0:7463:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788459893.902167:0:7463:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788459893.902201:0:7463:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:0.0:1788459893.902368:0:7463:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788459893.902999:0:7488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001a8ffae8 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7488:1875336022205056:0@lo:1000: 00000040:01000000:1.0:1788459893.903047:0:7488:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:1.0:1788459893.903081:0:7488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001a8ffae8 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7488:1875336022205184:0@lo:700: 00000100:00100000:1.0:1788459893.903142:0:7488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459893.903187:0:7488:0:(client.c:2716:ptlrpc_set_wait()) set 000000007b2d3c01 going to sleep for 11 seconds 00000100:00100000:3.0:1788459893.903191:0:6542:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022205184 00000100:00100000:3.0:1788459893.903197:0:6542:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022205184 00000100:00100000:3.0:1788459893.903243:0:6542:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788459893.903257:0:6542:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b031a40d pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7488:x1875336022205184:12345-0@lo:700: 00000100:00100000:3.0:1788459893.903309:0:6542:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b031a40d pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7488:x1875336022205184:12345-0@lo:700: Request processed in 54us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459893.903316:0:6542:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788459893.903383:0:7488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001a8ffae8 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7488:1875336022205184:0@lo:700: 00000100:00100000:1.0:1788459893.903427:0:7488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001a8ffae8 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7488:1875336022205312:0@lo:900: 00000100:00100000:1.0:1788459893.903451:0:7488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459893.903475:0:7488:0:(client.c:2716:ptlrpc_set_wait()) set 000000007b2d3c01 going to sleep for 11 seconds 00000100:00100000:2.0:1788459893.903496:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022205312 00000100:00100000:2.0:1788459893.903501:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022205312 00000100:00100000:2.0:1788459893.903533:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788459893.903538:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008a88aee7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7488:x1875336022205312:12345-0@lo:900: 00000100:00100000:2.0:1788459893.903599:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008a88aee7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7488:x1875336022205312:12345-0@lo:900: Request processed in 60us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459893.903606:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788459893.903653:0:7488:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000001a8ffae8 x1875336022205312/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788459909 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788459893.903665:0:7488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001a8ffae8 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7488:1875336022205312:0@lo:900: 00000100:00100000:3.0:1788459893.903754:0:7488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005232add0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7488:1875336022205440:0@lo:1000: 00000100:00100000:3.0:1788459893.903784:0:7488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459893.903808:0:7488:0:(client.c:2716:ptlrpc_set_wait()) set 0000000059a8f883 going to sleep for 11 seconds 00080000:10000000:0.0:1788459893.903853:0:7463:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000100:00100000:2.0:1788459893.904243:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022205440 00000100:00100000:2.0:1788459893.904249:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022205440 00000100:00100000:2.0:1788459893.904290:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788459893.904296:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000094ad042 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7488:x1875336022205440:12345-0@lo:1000: 00000100:00100000:2.0:1788459893.904360:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000094ad042 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7488:x1875336022205440:12345-0@lo:1000: Request processed in 65us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459893.904367:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788459893.904421:0:7488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005232add0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7488:1875336022205440:0@lo:1000: 00000004:00080000:1.0:1788459893.904459:0:7488:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 0000000094b34c7b with version 0 00000020:00100000:1.0:1788459893.904472:0:7488:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1788459893.904477:0:7488:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000009def55f3 x1875336022205696/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788459893.904489:0:7488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009def55f3 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7488:1875336022205696:0@lo:1000: 00000100:00100000:1.0:1788459893.904514:0:7488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459893.904540:0:7488:0:(client.c:2716:ptlrpc_set_wait()) set 000000009d80a84d going to sleep for 11 seconds 00000100:00100000:3.0:1788459893.904585:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022205696 00000100:00100000:3.0:1788459893.904590:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022205696 00000100:00100000:3.0:1788459893.904630:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788459893.904636:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c00b2f49 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7488:x1875336022205696:12345-0@lo:1000: 00100000:10000000:0.0:1788459893.906117:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1788459893.906317:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1788459893.906465:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1788459893.906612:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1788459893.906789:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1788459893.907023:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1788459893.907155:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1788459893.907295:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1788459893.907452:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1788459893.907582:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1788459893.907759:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1788459893.907892:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1788459893.909860:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1788459893.910065:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1788459893.910206:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1788459893.910341:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1788459893.910653:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1788459893.910801:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1788459893.910974:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1788459893.911133:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1788459893.911262:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1788459893.911395:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1788459893.911524:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1788459893.911663:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1788459893.911818:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1788459893.911972:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1788459893.912119:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1788459893.912253:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1788459893.912377:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00000001:00080000:0.0:1788459893.916442:0:6513:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000100:00100000:3.0:1788459893.916709:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c00b2f49 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7488:x1875336022205696:12345-0@lo:1000: Request processed in 12070us (12191us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788459893.916723:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 40000000:02000000:2.0:1788459893.916794:0:6540:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00100000:10000000:1.0:1788459893.919203:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1788459893.919458:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1788459893.919671:0:7463:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1788459893.919917:0:7463:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000004:00080000:0.0:1788459893.922122:0:7488:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:0.0:1788459893.922133:0:7488:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788459893.922150:0:7488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009def55f3 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7488:1875336022205696:0@lo:1000: 00000100:00100000:0.0:1788459893.922246:0:7488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000237c7f8f pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7488:1875336022205824:0@lo:1000: 00000100:00100000:0.0:1788459893.922301:0:7488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459893.922353:0:7488:0:(client.c:2716:ptlrpc_set_wait()) set 0000000083488407 going to sleep for 11 seconds 00000100:00100000:3.0:1788459893.923720:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022205824 00000100:00100000:3.0:1788459893.923740:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022205824 00000100:00100000:3.0:1788459893.923797:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788459893.923806:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005b06292b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7488:x1875336022205824:12345-0@lo:1000: 00000100:00100000:3.0:1788459893.923907:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005b06292b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7488:x1875336022205824:12345-0@lo:1000: Request processed in 102us (1606us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459893.923914:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788459893.923984:0:7488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000237c7f8f pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7488:1875336022205824:0@lo:1000: 00000040:00080000:3.0:1788459893.924005:0:7488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:3.0:1788459893.924050:0:7488:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000bcd902b3 with version 1 00000004:00080000:1.0:1788459893.924269:0:7478:0:(osp_trans.c:1336:osp_get_next_request()) ou 0000000003677d35 version 1 rpc_version 1 00000020:00100000:1.0:1788459893.924292:0:7478:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1788459893.924298:0:7478:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000009def55f3 x1875336022206080/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788459893.924314:0:7478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009def55f3 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7478:1875336022206080:0@lo:1000: 00000100:00100000:1.0:1788459893.924343:0:7478:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459893.924375:0:7478:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f9418b88 going to sleep for 11 seconds 00000100:00100000:1.0:1788459893.926017:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022206080 00000100:00100000:1.0:1788459893.926029:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022206080 00000040:00080000:3.0:1788459893.926053:0:7488:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000100:00100000:1.0:1788459893.926075:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788459893.926081:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001a8ffae8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7478:x1875336022206080:12345-0@lo:1000: 00000004:00080000:3.0:1788459893.926114:0:7488:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000100:00100000:2.0:1788459893.933838:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e7216142 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7487:x1875336022204928:12345-0@lo:700: Request processed in 33454us (35497us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459893.933857:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788459893.934302:0:7487:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000009696debd x1875336022204928/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788459909 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788459893.934316:0:7487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009696debd pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7487:1875336022204928:0@lo:700: 40000000:02000000:0.0:1788459893.934329:0:7487:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00000001:00080000:2.0:1788459893.948511:0:6513:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:1.0:1788459893.949232:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001a8ffae8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7478:x1875336022206080:12345-0@lo:1000: Request processed in 23148us (24884us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788459893.949244:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:2.0:1788459893.949529:0:7478:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:2.0:1788459893.949535:0:7478:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1788459893.949550:0:7478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009def55f3 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7478:1875336022206080:0@lo:1000: 00000001:00080000:1.0:1788459893.951506:0:7463:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788459893.951541:0:7463:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffba0a01c539b8 00100000:10000000:1.0:1788459893.951548:0:7463:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:1.0:1788459893.953023:0:7463:0:(tgt_mount.c:2600:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788459893.953041:0:7463:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:1.0:1788459893.954070:0:7463:0:(tgt_mount.c:2486:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788459893.957493:0:7463:0:(tgt_mount.c:2501:is_cmd_supported()) ioctl cmd=41009432 00000040:00080000:0.0:1788459893.989198:0:7487:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788459894.009738:0:7487:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788459894.009812:0:7487:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 1, retries 0 00000004:00080000:1.0:1788459894.009817:0:7487:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:1.0:1788459894.546301:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788459895.571759:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788459896.604820:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788459897.617207:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788459898.322590:0:7733:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788459898.644109:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788459898.961071:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000edffde57 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3662:1875336022206336:0@lo:400: 00000100:00100000:2.0:1788459898.961134:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459898.961324:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000eb986399 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022206464:0@lo:400: 00000100:00100000:1.0:1788459898.961356:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459898.962104:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788459898.962113:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ed90f10c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1875336022206592:0@lo:400: 00000100:00100000:1.0:1788459898.962162:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022206464 00000100:00100000:1.0:1788459898.962170:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022206464 00000100:00100000:1.0:1788459898.962228:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788459898.962237:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009def55f3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022206464:12345-0@lo:400: 00000100:00100000:1.0:1788459898.962302:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009def55f3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022206464:12345-0@lo:400: Request processed in 66us (945us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459898.962309:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788459898.965143:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788459898.965159:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e507f064 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0cf73fe6-82e2-434e-b670-631647721b2c:3662:1875336022206208:0@lo:400: 00000100:00100000:2.0:1788459898.965219:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459898.965260:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459898.965298:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000eb986399 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022206464:0@lo:400: 00000100:00100000:2.0:1788459898.965331:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022206336 00000100:00100000:2.0:1788459898.965336:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022206336 00000100:00100000:2.0:1788459898.965375:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022206592 00000100:00100000:3.0:1788459898.965382:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788459898.965386:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022206592 00000100:00100000:3.0:1788459898.965392:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000020c2b953 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1875336022206336:12345-0@lo:400: 00000100:00100000:2.0:1788459898.965401:0:6534:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788459898.965408:0:6534:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1788459898.965421:0:6533:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788459898.965427:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788459898.965433:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d97f4547 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1875336022206592:12345-0@lo:400: 00000100:00100000:3.0:1788459898.965444:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000020c2b953 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1875336022206336:12345-0@lo:400: Request processed in 55us (4312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459898.965451:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788459898.965460:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d97f4547 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1875336022206592:12345-0@lo:400: Request processed in 29us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459898.965480:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788459898.965573:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000edffde57 x1875336022206336/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788459914 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788459898.965596:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000edffde57 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3662:1875336022206336:0@lo:400: 00010000:00080000:2.0:1788459898.965618:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000ed90f10c x1875336022206592/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788459914 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788459898.965626:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ed90f10c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1875336022206592:0@lo:400: 00000100:00100000:1.0:1788459898.966562:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022206208 00000100:00100000:1.0:1788459898.966572:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022206208 00000100:00100000:1.0:1788459898.966652:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788459898.966671:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d4a65874 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+14:3662:x1875336022206208:12345-0@lo:400: 00000100:00100000:1.0:1788459898.966739:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d4a65874 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+14:3662:x1875336022206208:12345-0@lo:400: Request processed in 72us (1521us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459898.966753:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788459898.966868:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e507f064 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0cf73fe6-82e2-434e-b670-631647721b2c:3662:1875336022206208:0@lo:400: 00000100:00100000:3.0:1788459898.968533:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788459898.968553:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a3096815 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022206720:0@lo:41: 00000100:00100000:3.0:1788459898.968734:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459898.968785:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022206720 00000100:00100000:3.0:1788459898.968791:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022206720 00000100:00100000:3.0:1788459898.968830:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788459898.968838:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fe40b86c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022206720:12345-0@lo:41: 00000004:00000024:3.0:1788459898.968869:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:3.0:1788459898.968909:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fe40b86c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022206720:12345-0@lo:41: Request processed in 73us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459898.968916:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788459898.969230:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a3096815 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022206720:0@lo:41: 00000020:00000004:3.0:1788459899.310924:0:7786:0:(tgt_mount.c:2486:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788459899.311849:0:7786:0:(tgt_mount.c:2501:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788459899.665217:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788459899.985057:0:6530:0:(mgc_request.c:715:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788459899.985064:0:6530:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-mdtir-ffff8c4bc438f000 from 4 10000000:01000000:1.0:1788459899.985069:0:6530:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788459899.985127:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: 0000000098e8e391/0x5dfa74784542aa8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459899.985139:0:6530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: 0000000098e8e391/0x5dfa74784542aa8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459899.985149:0:6530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: 0000000098e8e391/0x5dfa74784542aa8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788459899.985168:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ed110ed3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022206848:0@lo:101: 00000100:00100000:1.0:1788459899.985237:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459899.985281:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f9418b88 going to sleep for 11 seconds 00000100:00100000:2.0:1788459899.985393:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022206848 00000100:00100000:2.0:1788459899.985401:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022206848 00000100:00100000:2.0:1788459899.985451:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788459899.985458:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b17f5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+14:6530:x1875336022206848:12345-0@lo:101: 00010000:00010000:2.0:1788459899.985472:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788459899.985485:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004da08286/0x5dfa74784542aa93 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542aa8c expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459899.985506:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004da08286/0x5dfa74784542aa93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542aa8c expref: 15 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459899.985530:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004da08286/0x5dfa74784542aa93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542aa8c expref: 15 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459899.985538:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004da08286, rc 0) 00000100:00100000:2.0:1788459899.985586:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b17f5680 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+15:6530:x1875336022206848:12345-0@lo:101: Request processed in 129us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459899.985593:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788459899.985680:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ed110ed3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022206848:0@lo:101: 00010000:00010000:1.0:1788459899.985694:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: 0000000098e8e391/0x5dfa74784542aa8c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542aa93 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459899.985712:0:6530:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: 0000000098e8e391/0x5dfa74784542aa8c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542aa93 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788459899.985753:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ed110ed3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022206976:0@lo:256: 00000100:00100000:1.0:1788459899.985801:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459899.985822:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f9418b88 going to sleep for 11 seconds 00000100:00100000:2.0:1788459899.985992:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022206976 00000100:00100000:2.0:1788459899.985997:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022206976 00000100:00100000:2.0:1788459899.986028:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788459899.986034:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000ca08fa2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+15:6530:x1875336022206976:12345-0@lo:256: 20000000:01000000:2.0:1788459899.986047:0:6528:0:(mgs_nids.c:1209:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788459899.986075:0:6528:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788459899.986079:0:6528:0:(mgs_nids.c:325:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1788459899.986158:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000ca08fa2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+15:6530:x1875336022206976:12345-0@lo:256: Request processed in 124us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459899.986165:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788459899.986304:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ed110ed3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022206976:0@lo:256: 10000000:01000000:1.0:1788459899.986349:0:6530:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788459899.986355:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: 0000000098e8e391/0x5dfa74784542aa8c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542aa93 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459899.986364:0:6530:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: 0000000098e8e391/0x5dfa74784542aa8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542aa93 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788459899.986375:0:6530:0:(mgc_request.c:715:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788459899.986377:0:6530:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-client-ffff8c4be2d81000 from 21 10000000:01000000:1.0:1788459899.986380:0:6530:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788459899.986394:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: 00000000f96bd10d/0x5dfa74784542aa9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459899.986401:0:6530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: 00000000f96bd10d/0x5dfa74784542aa9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459899.986408:0:6530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: 00000000f96bd10d/0x5dfa74784542aa9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788459899.986418:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ed110ed3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022207104:0@lo:101: 00000100:00100000:1.0:1788459899.986442:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459899.986471:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set 00000000db5fdb2b going to sleep for 11 seconds 00000100:00100000:3.0:1788459899.986551:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022207104 00000100:00100000:3.0:1788459899.986556:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022207104 00000100:00100000:3.0:1788459899.986588:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788459899.986594:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cac4887c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+15:6530:x1875336022207104:12345-0@lo:101: 00010000:00010000:3.0:1788459899.986607:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788459899.986616:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000055c9d627/0x5dfa74784542aaa1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542aa9a expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459899.986631:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000055c9d627/0x5dfa74784542aaa1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542aa9a expref: 16 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459899.986639:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000055c9d627/0x5dfa74784542aaa1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542aa9a expref: 16 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459899.986646:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000055c9d627, rc 0) 00000100:00100000:3.0:1788459899.986688:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cac4887c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+16:6530:x1875336022207104:12345-0@lo:101: Request processed in 95us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459899.986694:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788459899.986725:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ed110ed3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022207104:0@lo:101: 00010000:00010000:3.0:1788459899.986735:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: 00000000f96bd10d/0x5dfa74784542aa9a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542aaa1 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459899.986741:0:6530:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: 00000000f96bd10d/0x5dfa74784542aa9a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542aaa1 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788459899.986769:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a3096815 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022207232:0@lo:501: 00000100:00100000:3.0:1788459899.986793:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459899.986808:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b80665d9 going to sleep for 11 seconds 00000100:00100000:3.0:1788459899.986819:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022207232 00000100:00100000:3.0:1788459899.986822:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022207232 00000100:00100000:3.0:1788459899.986842:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788459899.986861:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aff4b32e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+16:6530:x1875336022207232:12345-0@lo:501: 00000100:00100000:3.0:1788459899.986992:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aff4b32e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+16:6530:x1875336022207232:12345-0@lo:501: Request processed in 132us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459899.986999:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788459899.987028:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a3096815 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022207232:0@lo:501: 00000100:00100000:3.0:1788459899.987167:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a3096815 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022207360:0@lo:503: 00000100:00100000:3.0:1788459899.987207:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459899.987227:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b80665d9 going to sleep for 11 seconds 00000100:00100000:3.0:1788459899.987238:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022207360 00000100:00100000:3.0:1788459899.987242:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022207360 00000100:00100000:3.0:1788459899.987263:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788459899.987268:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006061c655 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+16:6530:x1875336022207360:12345-0@lo:503: 00000100:00100000:3.0:1788459899.987341:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006061c655 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+16:6530:x1875336022207360:12345-0@lo:503: Request processed in 72us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459899.987347:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788459899.987385:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a3096815 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022207360:0@lo:503: 00000100:00100000:3.0:1788459899.987546:0:7817:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a3096815 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0cf73fe6-82e2-434e-b670-631647721b2c:7817:1875336022207488:0@lo:502: 00000100:00100000:3.0:1788459899.987578:0:7817:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459899.987598:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022207488 00000100:00100000:3.0:1788459899.987601:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022207488 00000100:00100000:3.0:1788459899.987621:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788459899.987626:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000d16e8d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+16:7817:x1875336022207488:12345-0@lo:502: 00000100:00100000:3.0:1788459899.987705:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000d16e8d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+16:7817:x1875336022207488:12345-0@lo:502: Request processed in 79us (127us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459899.987713:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788459899.987740:0:7817:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a679fef7 going to sleep for 11 seconds 00000100:00100000:3.0:1788459899.987756:0:7817:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a3096815 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0cf73fe6-82e2-434e-b670-631647721b2c:7817:1875336022207488:0@lo:502: 00000100:00100000:3.0:1788459899.987790:0:7817:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a3096815 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0cf73fe6-82e2-434e-b670-631647721b2c:7817:1875336022207616:0@lo:502: 00000100:00100000:3.0:1788459899.987821:0:7817:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459899.987839:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022207616 00000100:00100000:2.0:1788459899.987981:0:7817:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a679fef7 going to sleep for 11 seconds 00000100:00100000:3.0:1788459899.988171:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022207616 00000100:00100000:3.0:1788459899.988274:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788459899.988282:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002ea0d0da pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+16:7817:x1875336022207616:12345-0@lo:502: 00000100:00100000:3.0:1788459899.988358:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002ea0d0da pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+16:7817:x1875336022207616:12345-0@lo:502: Request processed in 77us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459899.988365:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788459899.988435:0:7817:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a3096815 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0cf73fe6-82e2-434e-b670-631647721b2c:7817:1875336022207616:0@lo:502: 00000040:00080000:0.0:1788459899.988457:0:7817:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:2.0:1788459899.991435:0:6530:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1788459899.991451:0:6530:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788459899.991460:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: 00000000f96bd10d/0x5dfa74784542aa9a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542aaa1 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459899.991473:0:6530:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: 00000000f96bd10d/0x5dfa74784542aa9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542aaa1 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788459899.991485:0:6530:0:(mgc_request.c:715:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788459899.991488:0:6530:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-mdtir-ffff8c4be2d81000 from 4 10000000:01000000:2.0:1788459899.991505:0:6530:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788459899.991539:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: 00000000631cf243/0x5dfa74784542aaa8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459899.991547:0:6530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: 00000000631cf243/0x5dfa74784542aaa8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459899.991557:0:6530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: 00000000631cf243/0x5dfa74784542aaa8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788459899.991577:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e507f064 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022207744:0@lo:101: 00000100:00100000:2.0:1788459899.991630:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459899.991755:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f2eb5053 going to sleep for 11 seconds 00000100:00100000:3.0:1788459899.992298:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022207744 00000100:00100000:3.0:1788459899.992307:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022207744 00000100:00100000:3.0:1788459899.992341:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788459899.992349:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a60b9111 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+16:6530:x1875336022207744:12345-0@lo:101: 00010000:00010000:3.0:1788459899.992361:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788459899.992372:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009fa3949e/0x5dfa74784542aaaf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542aaa8 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459899.992393:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009fa3949e/0x5dfa74784542aaaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542aaa8 expref: 17 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459899.992403:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009fa3949e/0x5dfa74784542aaaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542aaa8 expref: 17 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459899.992411:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009fa3949e, rc 0) 00000100:00100000:3.0:1788459899.992450:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a60b9111 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+17:6530:x1875336022207744:12345-0@lo:101: Request processed in 102us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459899.992457:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788459899.993310:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e507f064 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022207744:0@lo:101: 00010000:00010000:2.0:1788459899.993328:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: 00000000631cf243/0x5dfa74784542aaa8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542aaaf expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459899.993337:0:6530:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: 00000000631cf243/0x5dfa74784542aaa8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542aaaf expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788459899.993405:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e507f064 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022207872:0@lo:256: 00000100:00100000:2.0:1788459899.993444:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459899.993471:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f2eb5053 going to sleep for 11 seconds 00000100:00100000:3.0:1788459899.993551:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022207872 00000100:00100000:3.0:1788459899.993556:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022207872 00000100:00100000:3.0:1788459899.993588:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788459899.993595:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e9dd00e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+17:6530:x1875336022207872:12345-0@lo:256: 20000000:01000000:3.0:1788459899.993608:0:6528:0:(mgs_nids.c:1209:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788459899.993622:0:6528:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788459899.993626:0:6528:0:(mgs_nids.c:325:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1788459899.993715:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e9dd00e1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+17:6530:x1875336022207872:12345-0@lo:256: Request processed in 120us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459899.993722:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788459899.993752:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e507f064 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022207872:0@lo:256: 10000000:01000000:3.0:1788459899.993791:0:6530:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788459899.993796:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: 00000000631cf243/0x5dfa74784542aaa8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542aaaf expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459899.993804:0:6530:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: 00000000631cf243/0x5dfa74784542aaa8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542aaaf expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788459899.993812:0:6530:0:(mgc_request.c:715:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788459899.993814:0:6530:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1788459899.993816:0:6530:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788459899.993833:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: 00000000e8c9e6b8/0x5dfa74784542aab6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459899.993838:0:6530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: 00000000e8c9e6b8/0x5dfa74784542aab6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459899.993845:0:6530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: 00000000e8c9e6b8/0x5dfa74784542aab6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788459899.993883:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dee03deb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022208000:0@lo:101: 00000100:00100000:3.0:1788459899.993906:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459899.993920:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set 000000003545f783 going to sleep for 11 seconds 00000100:00100000:3.0:1788459899.993931:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022208000 00000100:00100000:3.0:1788459899.993934:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022208000 00000100:00100000:3.0:1788459899.993972:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788459899.993978:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005fab8fef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+17:6530:x1875336022208000:12345-0@lo:101: 00010000:00010000:3.0:1788459899.993985:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788459899.993993:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004860670d/0x5dfa74784542aabd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542aab6 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459899.994008:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004860670d/0x5dfa74784542aabd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542aab6 expref: 18 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459899.994015:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004860670d/0x5dfa74784542aabd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542aab6 expref: 18 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459899.994023:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004860670d, rc 0) 00000100:00100000:3.0:1788459899.994373:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005fab8fef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+18:6530:x1875336022208000:12345-0@lo:101: Request processed in 72us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459899.994380:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788459899.994411:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dee03deb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022208000:0@lo:101: 00010000:00010000:3.0:1788459899.994423:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: 00000000e8c9e6b8/0x5dfa74784542aab6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542aabd expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459899.994429:0:6530:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: 00000000e8c9e6b8/0x5dfa74784542aab6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542aabd expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788459899.994468:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dee03deb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022208128:0@lo:501: 00000100:00100000:3.0:1788459899.994494:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459899.994563:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set 000000003545f783 going to sleep for 11 seconds 00000100:00100000:0.0:1788459900.000172:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022208128 00000100:00100000:0.0:1788459900.000186:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022208128 00000100:00100000:0.0:1788459900.000247:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788459900.000256:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000002b26b9e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+18:6530:x1875336022208128:12345-0@lo:501: 00000100:00100000:0.0:1788459900.001257:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000002b26b9e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+18:6530:x1875336022208128:12345-0@lo:501: Request processed in 999us (6759us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459900.001267:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788459900.001321:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dee03deb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022208128:0@lo:501: 00000100:00100000:0.0:1788459900.001374:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009696debd pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022208256:0@lo:503: 00000100:00100000:0.0:1788459900.001498:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459900.001524:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set 000000002703b595 going to sleep for 11 seconds 00000100:00100000:1.0:1788459900.001595:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022208256 00000100:00100000:1.0:1788459900.001600:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022208256 00000100:00100000:1.0:1788459900.001640:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788459900.001646:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000362acc96 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+18:6530:x1875336022208256:12345-0@lo:503: 00000100:00100000:1.0:1788459900.001746:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000362acc96 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+18:6530:x1875336022208256:12345-0@lo:503: Request processed in 100us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459900.001753:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788459900.002110:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009696debd pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022208256:0@lo:503: 00000100:00100000:0.0:1788459900.009762:0:7819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009696debd pname:cluuid:pid:xid:nid:opc:job llog_process_th:0cf73fe6-82e2-434e-b670-631647721b2c:7819:1875336022208384:0@lo:502: 00000100:00100000:0.0:1788459900.009839:0:7819:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459900.009887:0:7819:0:(client.c:2716:ptlrpc_set_wait()) set 000000005d8f472e going to sleep for 11 seconds 00000100:00100000:1.0:1788459900.009913:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022208384 00000100:00100000:1.0:1788459900.009922:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022208384 00000100:00100000:1.0:1788459900.010003:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788459900.010011:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005baf2358 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+18:7819:x1875336022208384:12345-0@lo:502: 00000100:00100000:1.0:1788459900.010197:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005baf2358 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+18:7819:x1875336022208384:12345-0@lo:502: Request processed in 187us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459900.010282:0:7819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009696debd pname:cluuid:pid:xid:nid:opc:job llog_process_th:0cf73fe6-82e2-434e-b670-631647721b2c:7819:1875336022208384:0@lo:502: 00000020:01000000:2.0:1788459900.010311:0:7819:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788459900.010322:0:7819:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788459900.010324:0:7819:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1788459900.010328:0:7819:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788459900.010331:0:7819:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.105@tcp to nid 0x20000c0a8ce69 (192.168.206.105@tcp) 00000020:00000080:2.0:1788459900.010362:0:7819:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788459900.010375:0:7819:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (000000004c310239) 00000020:00000080:2.0:1788459900.010393:0:7819:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:2.0:1788459900.010399:0:7819:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788459900.010480:0:7819:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1788459900.010485:0:7819:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788459900.010492:0:7819:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5dfa74784542aacb 00010000:00080000:2.0:1788459900.010519:0:7819:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000a25e1d93@lustre-MDT0001-osp-MDT0000: add connection 192.168.206.105@tcp at head 00010000:00010000:2.0:1788459900.016275:0:7819:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000100:00100000:1.0:1788459900.017746:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000020:00000080:0.0:1788459900.029542:0:7819:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788459900.029557:0:7819:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1788459900.029609:0:7819:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788459900.029629:0:7819:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5dfa74784542aad2 00000100:00080000:0.0:1788459900.029640:0:7819:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788459900.029645:0:7819:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 00000000a25e1d93 using connection 192.168.206.105@tcp/0@lo 00000100:00100000:0.0:1788459900.029690:0:7819:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000003808b6d9 x1875336022208512/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788459900.029716:0:7819:0:(pinger.c:380:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:0.0:1788459900.029774:0:7819:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:3.0:1788459900.030083:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009488cc47 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3662:1875336022208640:0@lo:400: 00000100:00100000:3.0:1788459900.030144:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459900.030178:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001b5bfec5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3660:1875336022208896:0@lo:400: 00000100:00100000:3.0:1788459900.030208:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022208640 00000100:00100000:3.0:1788459900.030215:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022208640 00000100:00100000:1.0:1788459900.030224:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459900.030258:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022208896 00000100:00100000:1.0:1788459900.030262:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788459900.030263:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022208896 00000100:00100000:1.0:1788459900.030272:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b6bb37df pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022208768:0@lo:400: 00000100:00100000:3.0:1788459900.030288:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788459900.030299:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002c7a54f5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1875336022208640:12345-0@lo:400: 00000100:00100000:1.0:1788459900.030305:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459900.030335:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022208768 00000100:00100000:1.0:1788459900.030339:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022208768 00000100:00100000:3.0:1788459900.030358:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002c7a54f5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1875336022208640:12345-0@lo:400: Request processed in 61us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459900.030366:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788459900.030371:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788459900.030379:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000075f5db61 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022208768:12345-0@lo:400: 00000100:00100000:3.0:1788459900.030385:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788459900.030393:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006d6e1476 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1875336022208896:12345-0@lo:400: 00000100:00100000:1.0:1788459900.030420:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000075f5db61 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022208768:12345-0@lo:400: Request processed in 42us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459900.030427:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788459900.030431:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006d6e1476 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1875336022208896:12345-0@lo:400: Request processed in 38us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459900.030439:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788459900.030466:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b6bb37df pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022208768:0@lo:400: 00010000:00080000:3.0:1788459900.030476:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000009488cc47 x1875336022208640/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788459916 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1788459900.030482:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000001b5bfec5 x1875336022208896/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788459916 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788459900.030498:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009488cc47 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3662:1875336022208640:0@lo:400: 00000100:00100000:1.0:1788459900.030501:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001b5bfec5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3660:1875336022208896:0@lo:400: 00000100:00100000:2.0:1788459900.030691:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003808b6d9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1875336022208512:0@lo:38: 00000100:00100000:2.0:1788459900.030727:0:3658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459900.031320:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022208512 00000100:00100000:3.0:1788459900.031327:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022208512 00000100:00100000:3.0:1788459900.031351:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788459900.031363:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ed90f10c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3658:x1875336022208512:12345-0@lo:38: 00010000:00080000:3.0:1788459900.031385:0:6538:0:(ldlm_lib.c:1461:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 197 last 0 00000020:00000080:3.0:1788459900.031414:0:6538:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5dfa74784542aad9 00000004:00100000:3.0:1788459900.031428:0:6538:0:(mdt_handler.c:7310:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1788459900.031433:0:6538:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:2.0:1788459900.031865:0:7823:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@00000000edffde57 x1875336022209024/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788459900.031876:0:7823:0:(client.c:2716:ptlrpc_set_wait()) set 000000007c8e0227 going to sleep for 0 seconds 00000020:01000000:0.0:1788459900.032201:0:7819:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788459900.032211:0:7819:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788459900.032213:0:7819:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1788459900.032216:0:7819:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788459900.032220:0:7819:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788459900.032221:0:7819:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788459900.032224:0:7819:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788459900.032226:0:7819:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788459900.032248:0:7819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000079797c8c pname:cluuid:pid:xid:nid:opc:job llog_process_th:0cf73fe6-82e2-434e-b670-631647721b2c:7819:1875336022209152:0@lo:502: 00000100:00100000:0.0:1788459900.032304:0:7819:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459900.032343:0:7819:0:(client.c:2716:ptlrpc_set_wait()) set 000000000a5ab4bc going to sleep for 11 seconds 00000100:00100000:1.0:1788459900.032478:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022209152 00000100:00100000:1.0:1788459900.032484:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022209152 00000100:00100000:1.0:1788459900.032522:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788459900.032529:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a4a05597 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+18:7819:x1875336022209152:12345-0@lo:502: 00000100:00100000:1.0:1788459900.032631:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a4a05597 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+18:7819:x1875336022209152:12345-0@lo:502: Request processed in 103us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459900.032639:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788459900.033702:0:7819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000079797c8c pname:cluuid:pid:xid:nid:opc:job llog_process_th:0cf73fe6-82e2-434e-b670-631647721b2c:7819:1875336022209152:0@lo:502: 00000020:01000000:0.0:1788459900.033733:0:7819:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788459900.033739:0:7819:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788459900.033741:0:7819:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788459900.033745:0:7819:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:1.0:1788459900.037148:0:6530:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1788459900.037165:0:6530:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788459900.037174:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: 00000000e8c9e6b8/0x5dfa74784542aab6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542aabd expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459900.037185:0:6530:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: 00000000e8c9e6b8/0x5dfa74784542aab6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542aabd expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788459900.037194:0:6530:0:(mgc_request.c:715:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788459900.037196:0:6530:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-sptlrpc-ffff8c4be2d81000 from 1 10000000:01000000:1.0:1788459900.037199:0:6530:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788459900.037246:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: 00000000d6d6476d/0x5dfa74784542aae0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459900.037253:0:6530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: 00000000d6d6476d/0x5dfa74784542aae0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459900.037262:0:6530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: 00000000d6d6476d/0x5dfa74784542aae0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788459900.037284:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001666a3fa pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022209280:0@lo:101: 00000100:00100000:1.0:1788459900.037342:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459900.037383:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b348f23e going to sleep for 11 seconds 00000100:00100000:0.0:1788459900.037433:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022209280 00000100:00100000:0.0:1788459900.037440:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022209280 00000100:00100000:0.0:1788459900.037491:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788459900.037499:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009274f1aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+18:6530:x1875336022209280:12345-0@lo:101: 00010000:00010000:0.0:1788459900.037510:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788459900.037520:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005b9e5407/0x5dfa74784542aae7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542aae0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459900.037540:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005b9e5407/0x5dfa74784542aae7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542aae0 expref: 19 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459900.037549:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005b9e5407/0x5dfa74784542aae7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542aae0 expref: 19 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459900.037556:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005b9e5407, rc 0) 00000100:00100000:0.0:1788459900.037623:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009274f1aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+19:6530:x1875336022209280:12345-0@lo:101: Request processed in 125us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459900.037630:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788459900.037770:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001666a3fa pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022209280:0@lo:101: 00010000:00010000:2.0:1788459900.037784:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: 00000000d6d6476d/0x5dfa74784542aae0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542aae7 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459900.037792:0:6530:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: 00000000d6d6476d/0x5dfa74784542aae0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542aae7 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788459900.037824:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000eb986399 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022209408:0@lo:501: 00000100:00100000:2.0:1788459900.037923:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459900.037975:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set 000000008148b3f0 going to sleep for 11 seconds 00000100:00100000:1.0:1788459900.038030:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022209408 00000100:00100000:1.0:1788459900.038035:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022209408 00000100:00100000:1.0:1788459900.038078:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788459900.038085:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d462f1b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+19:6530:x1875336022209408:12345-0@lo:501: 00000100:00100000:1.0:1788459900.038162:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d462f1b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+19:6530:x1875336022209408:12345-0@lo:501: Request processed in 78us (239us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788459900.038169:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788459900.038196:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000eb986399 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022209408:0@lo:501: 10000000:01000000:1.0:1788459900.038208:0:6530:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788459900.038213:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: 00000000d6d6476d/0x5dfa74784542aae0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542aae7 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459900.038219:0:6530:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: 00000000d6d6476d/0x5dfa74784542aae0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542aae7 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788459900.050510:0:6538:0:(import.c:65:import_set_state_nolock()) 000000004b0a44fd : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788459900.050606:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ed90f10c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3658:x1875336022208512:12345-0@lo:38: Request processed in 19241us (19877us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459900.050617:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788459900.050680:0:3658:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788459900.050688:0:3658:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788459900.050695:0:3658:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1788459900.050700:0:3658:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788459900.050702:0:3658:0:(import.c:65:import_set_state_nolock()) 00000000a25e1d93 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1788459900.050713:0:3658:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000007c8e0227): req@00000000edffde57 x1875336022209024/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788459900.050735:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003808b6d9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1875336022208512:0@lo:38: 00000100:00100000:3.0:1788459900.050783:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788459900.050792:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009488cc47 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022209536:0@lo:41: 00000100:00100000:3.0:1788459900.050825:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459900.053039:0:7823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459900.053195:0:7823:0:(client.c:2716:ptlrpc_set_wait()) set 000000007c8e0227 going to sleep for 11 seconds 00000100:00100000:0.0:1788459900.053255:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022209536 00000100:00100000:0.0:1788459900.053263:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022209536 00000100:00100000:0.0:1788459900.053295:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022209024 00000100:00100000:0.0:1788459900.053298:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022209024 00000100:00100000:0.0:1788459900.053311:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788459900.053318:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008c201ebc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3662:x1875336022209536:12345-0@lo:41: 00000004:00000024:0.0:1788459900.053346:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1788459900.053398:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008c201ebc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3662:x1875336022209536:12345-0@lo:41: Request processed in 80us (2572us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459900.053405:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788459900.053421:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788459900.053426:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000020f02df6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7823:x1875336022209024:12345-0@lo:1000: 00000100:00100000:0.0:1788459900.053483:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000020f02df6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7823:x1875336022209024:12345-0@lo:1000: Request processed in 57us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459900.053490:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788459900.053524:0:7823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000edffde57 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7823:1875336022209024:0@lo:1000: 00000040:01000000:0.0:1788459900.053553:0:7823:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1788459900.053587:0:7823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000079797c8c pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7823:1875336022209664:0@lo:1000: 00000100:00100000:0.0:1788459900.053616:0:7823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459900.053630:0:7823:0:(client.c:2716:ptlrpc_set_wait()) set 000000005d8f472e going to sleep for 11 seconds 00000100:00100000:0.0:1788459900.053640:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022209664 00000100:00100000:0.0:1788459900.053644:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022209664 00000100:00100000:0.0:1788459900.053671:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788459900.053677:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000e90ab12 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7823:x1875336022209664:12345-0@lo:1000: 00000100:00100000:0.0:1788459900.053773:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000e90ab12 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7823:x1875336022209664:12345-0@lo:1000: Request processed in 97us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459900.053780:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788459900.053803:0:7823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000079797c8c pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7823:1875336022209664:0@lo:1000: 00000100:00100000:0.0:1788459900.053835:0:7823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000079797c8c pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7823:1875336022209792:0@lo:700: 00000100:00100000:0.0:1788459900.053930:0:7823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459900.053984:0:7823:0:(client.c:2716:ptlrpc_set_wait()) set 000000008e50451c going to sleep for 11 seconds 00000100:00100000:3.0:1788459900.054126:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009488cc47 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022209536:0@lo:41: 00000100:00100000:1.0:1788459900.054215:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022209792 00000100:00100000:1.0:1788459900.054219:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022209792 00000100:00100000:1.0:1788459900.054252:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788459900.055357:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b3b4e06c pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7823:x1875336022209792:12345-0@lo:700: 00000100:00100000:1.0:1788459900.055433:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b3b4e06c pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7823:x1875336022209792:12345-0@lo:700: Request processed in 1175us (1503us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459900.055441:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788459900.056181:0:7823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000079797c8c pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7823:1875336022209792:0@lo:700: 00000100:00100000:0.0:1788459900.056310:0:7823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000079797c8c pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7823:1875336022209920:0@lo:1000: 00000100:00100000:0.0:1788459900.056349:0:7823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459900.056371:0:7823:0:(client.c:2716:ptlrpc_set_wait()) set 0000000041e2734d going to sleep for 11 seconds 00000100:00100000:0.0:1788459900.056438:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022209920 00000100:00100000:0.0:1788459900.056443:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022209920 00000100:00100000:0.0:1788459900.056483:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788459900.056490:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000443c81a8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7823:x1875336022209920:12345-0@lo:1000: 00000100:00100000:0.0:1788459900.056551:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000443c81a8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7823:x1875336022209920:12345-0@lo:1000: Request processed in 61us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459900.056557:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788459900.056582:0:7823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000079797c8c pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7823:1875336022209920:0@lo:1000: 00000004:00080000:0.0:1788459900.056620:0:7823:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 000000008e50451c with version 0 00000020:00100000:0.0:1788459900.056633:0:7823:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788459900.056639:0:7823:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000079797c8c x1875336022210176/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788459900.056663:0:7823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000079797c8c pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7823:1875336022210176:0@lo:1000: 00000100:00100000:0.0:1788459900.056687:0:7823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459900.056710:0:7823:0:(client.c:2716:ptlrpc_set_wait()) set 0000000032a38468 going to sleep for 11 seconds 00000100:00100000:0.0:1788459900.056723:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022210176 00000100:00100000:0.0:1788459900.056726:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022210176 00000100:00100000:0.0:1788459900.056743:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788459900.056748:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b0700d1d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7823:x1875336022210176:12345-0@lo:1000: 00000001:00080000:0.0:1788459900.064218:0:7465:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:0.0:1788459900.064232:0:7465:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788459900.065312:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b0700d1d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7823:x1875336022210176:12345-0@lo:1000: Request processed in 8559us (8620us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788459900.065325:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:0.0:1788459900.065429:0:7823:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:0.0:1788459900.065433:0:7823:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788459900.065446:0:7823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000079797c8c pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7823:1875336022210176:0@lo:1000: 00000100:00100000:0.0:1788459900.065528:0:7823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000079797c8c pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7823:1875336022210304:0@lo:1000: 00000100:00100000:0.0:1788459900.065562:0:7823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459900.065591:0:7823:0:(client.c:2716:ptlrpc_set_wait()) set 00000000318c415d going to sleep for 11 seconds 00000100:00100000:3.0:1788459900.065638:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022210304 00000100:00100000:3.0:1788459900.065646:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022210304 00000100:00100000:3.0:1788459900.065698:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788459900.065712:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003808b6d9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7823:x1875336022210304:12345-0@lo:1000: 00000100:00100000:3.0:1788459900.065784:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003808b6d9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7823:x1875336022210304:12345-0@lo:1000: Request processed in 74us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459900.065790:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788459900.066048:0:7823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000079797c8c pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7823:1875336022210304:0@lo:1000: 00000040:00080000:0.0:1788459900.066134:0:7823:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:0.0:1788459900.066160:0:7823:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 000000009434473a with version 1 00000004:00080000:3.0:1788459900.066291:0:7820:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000f21af26c version 1 rpc_version 1 00000020:00100000:3.0:1788459900.066309:0:7820:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1788459900.066315:0:7820:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000009488cc47 x1875336022210560/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788459900.066328:0:7820:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009488cc47 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7820:1875336022210560:0@lo:1000: 00000100:00100000:3.0:1788459900.066357:0:7820:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459900.066382:0:7820:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a679fef7 going to sleep for 11 seconds 00000100:00100000:1.0:1788459900.066423:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022210560 00000100:00100000:1.0:1788459900.066428:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022210560 00000100:00100000:1.0:1788459900.066460:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788459900.066466:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001b5bfec5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7820:x1875336022210560:12345-0@lo:1000: 00000040:00080000:0.0:1788459900.073208:0:7823:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788459900.073328:0:7823:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788459900.073333:0:7823:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:00080000:0.0:1788459900.080138:0:7465:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:1.0:1788459900.083268:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001b5bfec5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7820:x1875336022210560:12345-0@lo:1000: Request processed in 16796us (16904us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788459900.083291:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000004:00080000:1.0:1788459900.083348:0:7820:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:1.0:1788459900.083352:0:7820:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788459900.083367:0:7820:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009488cc47 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7820:1875336022210560:0@lo:1000: 00010000:00010000:3.0:1788459900.689564:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788459901.714982:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788459902.057828:0:7892:0:(tgt_mount.c:2486:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788459902.058063:0:7892:0:(tgt_mount.c:2501:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788459902.738075:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788459903.065874:0:7941:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff596271b0 20000000:00000080:0.0:1788459903.065891:0:7941:0:(mgs_handler.c:1172:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8c4bf6d43400 uarg=0000000000000000 20000000:01000000:0.0:1788459903.065924:0:7941:0:(mgs_llog.c:6198:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1788459903.065930:0:7941:0:(mgs_llog.c:4653:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1788459903.065935:0:7941:0:(mgs_llog.c:1385:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1788459903.068365:0:7941:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:0.0:1788459903.068382:0:7941:0:(mgs_llog.c:4126:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1788459903.075369:0:7941:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788459903.076226:0:7941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788459903.076264:0:7941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1788459903.076283:0:7941:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1788459903.076299:0:7941:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788459903.076316:0:7941:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000194c07b1/0x5dfa74784542aaee lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459903.076332:0:7941:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000007170cb93/0x5dfa74784542a96d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542a966 expref: 18 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459903.076340:0:7941:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000de1dcc27/0x5dfa74784542aa5b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542aa54 expref: 18 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459903.076346:0:7941:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000194c07b1/0x5dfa74784542aaee lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459903.076382:0:7941:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000de1dcc27/0x5dfa74784542aa5b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5dfa74784542aa54 expref: 18 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459903.076396:0:7941:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000de1dcc27/0x5dfa74784542aa5b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5dfa74784542aa54 expref: 18 pid: 6528 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788459903.076408:0:7941:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000079797c8c pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7941:1875336022210688:0@lo:104: 00000100:00100000:0.0:1788459903.076464:0:7941:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788459903.076528:0:7941:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000007170cb93/0x5dfa74784542a96d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5dfa74784542a966 expref: 18 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459903.076536:0:7941:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000007170cb93/0x5dfa74784542a96d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5dfa74784542a966 expref: 18 pid: 6528 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788459903.076544:0:7941:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000237c7f8f pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7941:1875336022210816:0@lo:104: 00000100:00100000:0.0:1788459903.076579:0:7941:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459903.076606:0:7941:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b06027b9 going to sleep for 11 seconds 00000100:00100000:2.0:1788459903.076701:0:6516:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788459903.076728:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022210688 00000100:00100000:2.0:1788459903.076739:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022210688 00000100:00100000:2.0:1788459903.076771:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022210816 00000100:00100000:2.0:1788459903.076774:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022210816 00000100:00100000:2.0:1788459903.076786:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788459903.076792:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009696debd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0cf73fe6-82e2-434e-b670-631647721b2c+4:7941:x1875336022210688:12345-0@lo:104: 00010000:00010000:2.0:1788459903.076802:0:6516:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.206.105@tcp lock: 0000000046c1cbfc/0x5dfa74784542aa54 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542aa5b expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459903.076852:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788459903.076857:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009696debd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0cf73fe6-82e2-434e-b670-631647721b2c+4:7941:x1875336022210688:12345-0@lo:104: Request processed in 66us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459903.076864:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788459903.076879:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788459903.076884:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f5e6914d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0cf73fe6-82e2-434e-b670-631647721b2c+3:7941:x1875336022210816:12345-0@lo:104: 00010000:00010000:2.0:1788459903.076890:0:6516:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.206.105@tcp lock: 00000000d13efdbd/0x5dfa74784542a966 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542a96d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459903.076918:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788459903.076923:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f5e6914d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0cf73fe6-82e2-434e-b670-631647721b2c+3:7941:x1875336022210816:12345-0@lo:104: Request processed in 40us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459903.076928:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1788459903.076992:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788459903.076997:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: 0000000046c1cbfc/0x5dfa74784542aa54 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542aa5b expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459903.077005:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000046c1cbfc already unused, calling callback (000000000de01725) 10000000:00010000:2.0:1788459903.077008:0:6521:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: 0000000046c1cbfc/0x5dfa74784542aa54 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5dfa74784542aa5b expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459903.077026:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: 0000000046c1cbfc/0x5dfa74784542aa54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5dfa74784542aa5b expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788459903.077033:0:6521:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: 0000000046c1cbfc/0x5dfa74784542aa54 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5dfa74784542aa5b expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788459903.077038:0:6521:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788459903.077063:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.206.105@tcp lock: 0000000046c1cbfc/0x5dfa74784542aa54 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542aa5b expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459903.077069:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788459903.077087:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: 0000000046c1cbfc/0x5dfa74784542aa54 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542aa5b expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459903.077094:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: 0000000046c1cbfc/0x5dfa74784542aa54 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542aa5b expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459903.077107:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788459903.077109:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: 00000000d13efdbd/0x5dfa74784542a966 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542a96d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459903.077113:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d13efdbd already unused, calling callback (000000000de01725) 10000000:00010000:2.0:1788459903.077115:0:6521:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: 00000000d13efdbd/0x5dfa74784542a966 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5dfa74784542a96d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459903.077120:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: 00000000d13efdbd/0x5dfa74784542a966 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5dfa74784542a96d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788459903.077126:0:6521:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: 00000000d13efdbd/0x5dfa74784542a966 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5dfa74784542a96d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788459903.077137:0:6521:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788459903.077149:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.206.105@tcp lock: 00000000d13efdbd/0x5dfa74784542a966 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542a96d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459903.077155:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788459903.077166:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: 00000000d13efdbd/0x5dfa74784542a966 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542a96d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459903.077171:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: 00000000d13efdbd/0x5dfa74784542a966 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542a96d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459903.077182:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788459903.077184:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788459903.077185:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788459903.077192:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788459903.077202:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000029d32195 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0cf73fe6-82e2-434e-b670-631647721b2c:3661:1875336022210944:0@lo:103: 00000100:00100000:2.0:1788459903.077229:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459903.077251:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cf9acdfb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0cf73fe6-82e2-434e-b670-631647721b2c:3659:1875336022211072:0@lo:103: 00000100:00100000:2.0:1788459903.077271:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459903.077317:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022210944 00000100:00100000:2.0:1788459903.077321:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022210944 00010000:00010000:2.0:1788459903.077336:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000de1dcc27/0x5dfa74784542aa5b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542aa54 expref: 19 pid: 6528 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788459903.077354:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022211072 00000100:00100000:2.0:1788459903.077357:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022211072 00010000:00010000:2.0:1788459903.077366:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000007170cb93/0x5dfa74784542a96d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542a966 expref: 20 pid: 6528 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788459903.077389:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788459903.077395:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000076f748f0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0cf73fe6-82e2-434e-b670-631647721b2c+20:3661:x1875336022210944:12345-0@lo:103: 00010000:00010000:2.0:1788459903.077404:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788459903.077408:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000de1dcc27/0x5dfa74784542aa5b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542aa54 expref: 20 pid: 6528 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459903.077415:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000de1dcc27/0x5dfa74784542aa5b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5dfa74784542aa54 expref: 20 pid: 6528 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459903.077428:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788459903.077452:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000076f748f0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0cf73fe6-82e2-434e-b670-631647721b2c+20:3661:x1875336022210944:12345-0@lo:103: Request processed in 58us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459903.077458:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788459903.077488:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788459903.077494:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000b6a96c9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0cf73fe6-82e2-434e-b670-631647721b2c+19:3659:x1875336022211072:12345-0@lo:103: 00010000:00010000:2.0:1788459903.077499:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788459903.077503:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000007170cb93/0x5dfa74784542a96d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542a966 expref: 19 pid: 6528 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459903.077510:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000007170cb93/0x5dfa74784542a96d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5dfa74784542a966 expref: 19 pid: 6528 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459903.077521:0:6519:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000194c07b1/0x5dfa74784542aaee lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459903.077527:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000194c07b1/0x5dfa74784542aaee lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 7941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459903.077547:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000194c07b1/0x5dfa74784542aaee lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459903.077554:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000194c07b1/0x5dfa74784542aaee lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459903.077559:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000194c07b1/0x5dfa74784542aaee lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459903.077564:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000194c07b1/0x5dfa74784542aaee lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459903.077569:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000194c07b1 already unused, calling callback (000000003e0ee701) 00010000:00010000:2.0:1788459903.077572:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000194c07b1/0x5dfa74784542aaee lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459903.077578:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000194c07b1/0x5dfa74784542aaee lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459903.077584:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000194c07b1/0x5dfa74784542aaee lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459903.077593:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788459903.077618:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000b6a96c9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0cf73fe6-82e2-434e-b670-631647721b2c+19:3659:x1875336022211072:12345-0@lo:103: Request processed in 125us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459903.077624:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788459903.077667:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cf9acdfb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0cf73fe6-82e2-434e-b670-631647721b2c:3659:1875336022211072:0@lo:103: 00000100:00100000:2.0:1788459903.077689:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000029d32195 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0cf73fe6-82e2-434e-b670-631647721b2c:3661:1875336022210944:0@lo:103: 00010000:00010000:0.0:1788459903.077863:0:7941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000de1dcc27/0x5dfa74784542aa5b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5dfa74784542aa54 expref: 18 pid: 6528 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788459903.077874:0:7941:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000079797c8c pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7941:1875336022210688:0@lo:104: 00010000:00010000:0.0:1788459903.077882:0:7941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007170cb93/0x5dfa74784542a96d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5dfa74784542a966 expref: 17 pid: 6528 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788459903.077888:0:7941:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000237c7f8f pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7941:1875336022210816:0@lo:104: 00010000:00010000:0.0:1788459903.077902:0:7941:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000194c07b1/0x5dfa74784542aaee lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459903.077910:0:7941:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000194c07b1/0x5dfa74784542aaee lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459903.077915:0:7941:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000194c07b1/0x5dfa74784542aaee lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459903.077920:0:7941:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000194c07b1/0x5dfa74784542aaee lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7941 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459903.079457:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788459903.762240:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788459904.081101:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788459904.081124:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b6bb37df pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022211200:0@lo:41: 00000100:00100000:0.0:1788459904.081181:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459904.081275:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022211200 00000100:00100000:3.0:1788459904.081282:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022211200 00000100:00100000:3.0:1788459904.081330:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788459904.081338:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000237c7f8f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022211200:12345-0@lo:41: 00000004:00000024:3.0:1788459904.081366:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:3.0:1788459904.081405:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000237c7f8f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022211200:12345-0@lo:41: Request processed in 69us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459904.081412:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788459904.081494:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b6bb37df pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022211200:0@lo:41: 00010000:00010000:0.0:1788459904.785738:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788459905.105647:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000079797c8c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022211328:0@lo:41: 00000100:00100000:0.0:1788459905.114384:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459905.114485:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022211328 00000100:00100000:0.0:1788459905.114505:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022211328 00000100:00100000:0.0:1788459905.114566:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788459905.114574:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000234d909b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1875336022211328:12345-0@lo:41: 00000004:00000024:0.0:1788459905.114611:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1788459905.114678:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000234d909b pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1875336022211328:12345-0@lo:41: Request processed in 106us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459905.114685:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788459905.114746:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000079797c8c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022211328:0@lo:41: 00000100:00100000:1.0:1788459905.118536:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000af9dc86d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022211712:0@lo:400: 00000100:00100000:1.0:1788459905.118610:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459905.118683:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788459905.118702:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cf9acdfb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3660:1875336022211584:0@lo:400: 00000100:00100000:1.0:1788459905.118746:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459905.118780:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022211584 00000100:00100000:1.0:1788459905.118787:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022211584 00000100:00100000:1.0:1788459905.118829:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788459905.118836:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000085975a1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1875336022211584:12345-0@lo:400: 00000100:00100000:1.0:1788459905.118880:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000085975a1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1875336022211584:12345-0@lo:400: Request processed in 44us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459905.118887:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1788459905.118924:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000cf9acdfb x1875336022211584/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788459921 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788459905.118937:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cf9acdfb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3660:1875336022211584:0@lo:400: 00000100:00100000:1.0:1788459905.118979:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000edffde57 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875336022211840:0@lo:400: 00000100:00100000:1.0:1788459905.119002:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459905.119025:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788459905.119030:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000029d32195 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0cf73fe6-82e2-434e-b670-631647721b2c:3661:1875336022211456:0@lo:400: 00000100:00100000:1.0:1788459905.119062:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459905.119088:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022211840 00000100:00100000:1.0:1788459905.119091:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022211840 00000100:00100000:1.0:1788459905.119114:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788459905.119119:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000017c4a3ae pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1875336022211840:12345-0@lo:400: 00000100:00100000:1.0:1788459905.119150:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000017c4a3ae pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1875336022211840:12345-0@lo:400: Request processed in 31us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459905.119156:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788459905.119170:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022211456 00000100:00100000:1.0:1788459905.119173:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022211456 00000100:00100000:1.0:1788459905.119194:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788459905.119199:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d2b4e715 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+17:3661:x1875336022211456:12345-0@lo:400: 00000100:00100000:1.0:1788459905.119223:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d2b4e715 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+17:3661:x1875336022211456:12345-0@lo:400: Request processed in 24us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459905.119229:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788459905.119260:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000029d32195 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0cf73fe6-82e2-434e-b670-631647721b2c:3661:1875336022211456:0@lo:400: 00010000:00080000:1.0:1788459905.119268:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000edffde57 x1875336022211840/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788459921 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788459905.119275:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000edffde57 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875336022211840:0@lo:400: 00000100:00100000:2.0:1788459905.119584:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022211712 00000100:00100000:2.0:1788459905.119589:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022211712 00000100:00100000:2.0:1788459905.119635:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788459905.119790:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005bc3e04c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022211712:12345-0@lo:400: 00000100:00100000:2.0:1788459905.119851:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005bc3e04c pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022211712:12345-0@lo:400: Request processed in 66us (1242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459905.119857:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788459905.123881:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000af9dc86d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022211712:0@lo:400: 00010000:00010000:2.0:1788459905.809242:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788459906.833333:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788459907.858077:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788459908.883278:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788459909.205164:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dee03deb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022211968:0@lo:41: 00000100:00100000:3.0:1788459909.205231:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459909.206235:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022211968 00000100:00100000:3.0:1788459909.206246:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022211968 00000100:00100000:3.0:1788459909.206297:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788459909.206306:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a3096815 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022211968:12345-0@lo:41: 00000004:00000024:3.0:1788459909.206339:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:3.0:1788459909.206471:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a3096815 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022211968:12345-0@lo:41: Request processed in 166us (1240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459909.206478:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788459909.206523:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dee03deb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022211968:0@lo:41: 10000000:01000000:3.0:1788459909.715698:0:6530:0:(mgc_request.c:715:do_requeue()) updating log params 10000000:01000000:3.0:1788459909.715781:0:6530:0:(mgc_request.c:2266:mgc_process_log()) Process log params-ffff8c4bc438f000 from 1 10000000:01000000:3.0:1788459909.715786:0:6530:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788459909.715896:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: 000000005bc554f3/0x5dfa74784542aaf5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459909.715909:0:6530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: 000000005bc554f3/0x5dfa74784542aaf5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459909.715920:0:6530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: 000000005bc554f3/0x5dfa74784542aaf5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788459909.715969:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dee03deb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022212096:0@lo:101: 00000100:00100000:3.0:1788459909.716034:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459909.716082:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set 0000000071e3ccdf going to sleep for 11 seconds 00000100:00100000:0.0:1788459909.716160:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022212096 00000100:00100000:0.0:1788459909.716168:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022212096 00000100:00100000:0.0:1788459909.716372:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788459909.716385:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000181673a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+17:6530:x1875336022212096:12345-0@lo:101: 00010000:00010000:0.0:1788459909.716399:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788459909.716412:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004ca2b0e6/0x5dfa74784542aafc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542aaf5 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459909.716434:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004ca2b0e6/0x5dfa74784542aafc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542aaf5 expref: 18 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459909.716444:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004ca2b0e6/0x5dfa74784542aafc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542aaf5 expref: 18 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459909.716452:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004ca2b0e6, rc 0) 00000100:00100000:0.0:1788459909.716654:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000181673a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+18:6530:x1875336022212096:12345-0@lo:101: Request processed in 272us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459909.716661:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788459909.716879:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dee03deb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022212096:0@lo:101: 00010000:00010000:3.0:1788459909.716894:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: 000000005bc554f3/0x5dfa74784542aaf5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542aafc expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459909.716903:0:6530:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: 000000005bc554f3/0x5dfa74784542aaf5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542aafc expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788459909.717010:0:6530:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788459909.717042:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dee03deb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022212224:0@lo:501: 00000100:00100000:3.0:1788459909.717071:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459909.717103:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set 0000000071e3ccdf going to sleep for 11 seconds 00000100:00100000:0.0:1788459909.717169:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022212224 00000100:00100000:0.0:1788459909.717181:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022212224 00000100:00100000:0.0:1788459909.717369:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788459909.717380:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000041183690 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+18:6530:x1875336022212224:12345-0@lo:501: 00000100:00100000:0.0:1788459909.717934:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000041183690 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+18:6530:x1875336022212224:12345-0@lo:501: Request processed in 556us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459909.717963:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788459909.720094:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dee03deb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022212224:0@lo:501: 00000100:00100000:3.0:1788459909.720144:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dee03deb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022212352:0@lo:503: 00000100:00100000:3.0:1788459909.720207:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459909.720466:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set 0000000071e3ccdf going to sleep for 11 seconds 00000100:00100000:3.0:1788459909.720487:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022212352 00000100:00100000:3.0:1788459909.720492:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022212352 00000100:00100000:3.0:1788459909.720546:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788459909.720557:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005d4faac7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+18:6530:x1875336022212352:12345-0@lo:503: 00000100:00100000:3.0:1788459909.720674:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005d4faac7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+18:6530:x1875336022212352:12345-0@lo:503: Request processed in 122us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459909.720683:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788459909.720743:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dee03deb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022212352:0@lo:503: 00000040:00080000:3.0:1788459909.721135:0:6530:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788459909.721208:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dee03deb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022212480:0@lo:502: 00000100:00100000:3.0:1788459909.721267:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459909.721286:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set 0000000071e3ccdf going to sleep for 11 seconds 00000100:00100000:3.0:1788459909.721301:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022212480 00000100:00100000:3.0:1788459909.721305:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022212480 00000100:00100000:3.0:1788459909.721328:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788459909.721333:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000932de526 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+18:6530:x1875336022212480:12345-0@lo:502: 00000100:00100000:3.0:1788459909.721405:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000932de526 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+18:6530:x1875336022212480:12345-0@lo:502: Request processed in 71us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459909.721412:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788459909.721450:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dee03deb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022212480:0@lo:502: 00000040:00080000:3.0:1788459909.721619:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1788459909.721651:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000100:00100000:3.0:1788459909.721672:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dee03deb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022212608:0@lo:502: 00000100:00100000:3.0:1788459909.721706:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459909.721721:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set 0000000071e3ccdf going to sleep for 11 seconds 00000100:00100000:3.0:1788459909.721734:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022212608 00000100:00100000:3.0:1788459909.721738:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022212608 00000100:00100000:3.0:1788459909.721763:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788459909.721769:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b76854cd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+18:6530:x1875336022212608:12345-0@lo:502: 00000100:00100000:3.0:1788459909.721840:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b76854cd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+18:6530:x1875336022212608:12345-0@lo:502: Request processed in 71us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459909.721847:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788459909.721888:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dee03deb pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022212608:0@lo:502: 00000040:00080000:3.0:1788459909.721929:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1788459909.721937:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1788459909.722160:0:8279:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788459909.722177:0:8279:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788459909.722179:0:8279:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788459909.722186:0:8279:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c4bc438f000 00000020:00000080:3.0:1788459909.722189:0:8279:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788459909.722220:0:8279:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788459909.722223:0:8279:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788459909.722224:0:8279:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788459909.722227:0:8279:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 4 count 4 00000020:01000000:3.0:1788459909.722254:0:6530:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788459909.722262:0:6530:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788459909.722270:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2e00/0x5dfa74784542aaf5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542aafc expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459909.722281:0:6530:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2e00/0x5dfa74784542aaf5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542aafc expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788459909.722298:0:6530:0:(mgc_request.c:715:do_requeue()) updating log params 10000000:01000000:3.0:1788459909.722300:0:6530:0:(mgc_request.c:2266:mgc_process_log()) Process log params-ffff8c4be2d81000 from 1 10000000:01000000:3.0:1788459909.722303:0:6530:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788459909.722325:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2800/0x5dfa74784542ab03 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459909.722333:0:6530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2800/0x5dfa74784542ab03 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459909.722341:0:6530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2800/0x5dfa74784542ab03 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788459909.722354:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf2fe8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022212736:0@lo:101: 00000100:00100000:3.0:1788459909.722382:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459909.722397:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bfac3fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1788459909.722409:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022212736 00000100:00100000:3.0:1788459909.722413:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022212736 00000100:00100000:3.0:1788459909.722440:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788459909.722446:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd0a6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+18:6530:x1875336022212736:12345-0@lo:101: 00010000:00010000:3.0:1788459909.722454:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788459909.722465:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4bc29d3c00/0x5dfa74784542ab0a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542ab03 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459909.722482:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bc29d3c00/0x5dfa74784542ab0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542ab03 expref: 19 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459909.722492:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4bc29d3c00/0x5dfa74784542ab0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542ab03 expref: 19 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459909.722509:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc29d3c00, rc 0) 00000100:00100000:3.0:1788459909.722539:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd0a6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+19:6530:x1875336022212736:12345-0@lo:101: Request processed in 93us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459909.722545:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788459909.722579:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf2fe8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022212736:0@lo:101: 00010000:00010000:3.0:1788459909.722590:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2800/0x5dfa74784542ab03 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ab0a expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459909.722611:0:6530:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2800/0x5dfa74784542ab03 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542ab0a expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788459909.722638:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf2fe8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022212864:0@lo:501: 00000100:00100000:3.0:1788459909.722663:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459909.722677:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bfac3fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1788459909.722688:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022212864 00000100:00100000:3.0:1788459909.722691:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022212864 00000100:00100000:3.0:1788459909.722710:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788459909.722716:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd0a6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+19:6530:x1875336022212864:12345-0@lo:501: 00000100:00100000:3.0:1788459909.722785:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd0a6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+19:6530:x1875336022212864:12345-0@lo:501: Request processed in 69us (121us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459909.722791:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788459909.722820:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf2fe8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022212864:0@lo:501: 00000100:00100000:3.0:1788459909.722841:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf2fe8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022212992:0@lo:503: 00000100:00100000:3.0:1788459909.723503:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459909.723620:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bfac3fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1788459909.726025:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022212992 00000100:00100000:0.0:1788459909.726039:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022212992 00000100:00100000:0.0:1788459909.726134:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788459909.726144:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd0a6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+19:6530:x1875336022212992:12345-0@lo:503: 00000100:00100000:0.0:1788459909.726491:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd0a6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+19:6530:x1875336022212992:12345-0@lo:503: Request processed in 348us (2987us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459909.726499:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788459909.726586:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf2fe8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022212992:0@lo:503: 00000100:00100000:3.0:1788459909.726810:0:8280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf2fe8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0cf73fe6-82e2-434e-b670-631647721b2c:8280:1875336022213120:0@lo:502: 00000100:00100000:3.0:1788459909.726855:0:8280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459909.727352:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022213120 00000100:00100000:2.0:1788459909.727358:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022213120 00000100:00100000:2.0:1788459909.727387:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788459909.727394:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd0a6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+19:8280:x1875336022213120:12345-0@lo:502: 00000100:00100000:2.0:1788459909.727609:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd0a6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+19:8280:x1875336022213120:12345-0@lo:502: Request processed in 204us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459909.727616:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788459909.727673:0:8280:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bfac3f480 going to sleep for 11 seconds 00000100:00100000:2.0:1788459909.727689:0:8280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf2fe8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0cf73fe6-82e2-434e-b670-631647721b2c:8280:1875336022213120:0@lo:502: 00000020:01000000:2.0:1788459909.727775:0:8280:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788459909.727785:0:8280:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788459909.727787:0:8280:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788459909.728631:0:8280:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c4be2d81000 00000020:00000080:2.0:1788459909.728636:0:8280:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788459909.728676:0:8280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4394e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0cf73fe6-82e2-434e-b670-631647721b2c:8280:1875336022213248:0@lo:502: 00000100:00100000:2.0:1788459909.728868:0:8280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459909.728905:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022213248 00000100:00100000:2.0:1788459909.728911:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022213248 00000100:00100000:2.0:1788459909.728963:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788459909.728971:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd0a6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+19:8280:x1875336022213248:12345-0@lo:502: 00000100:00100000:2.0:1788459909.729054:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd0a6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+19:8280:x1875336022213248:12345-0@lo:502: Request processed in 84us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459909.729061:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788459909.729102:0:8280:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc3f66600 going to sleep for 11 seconds 00000100:00100000:2.0:1788459909.729117:0:8280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4394e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0cf73fe6-82e2-434e-b670-631647721b2c:8280:1875336022213248:0@lo:502: 00000020:01000000:2.0:1788459909.729140:0:8280:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788459909.729145:0:8280:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788459909.729147:0:8280:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788459909.729150:0:8280:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1788459909.729494:0:6530:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788459909.729503:0:6530:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788459909.729512:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2800/0x5dfa74784542ab03 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ab0a expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459909.729533:0:6530:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2800/0x5dfa74784542ab03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ab0a expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459909.905110:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788459910.225611:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4718380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022213376:0@lo:41: 00000100:00100000:2.0:1788459910.225682:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459910.225882:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf2febb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875336022213632:0@lo:400: 00000100:00100000:3.0:1788459910.225915:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459910.225938:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788459910.225967:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf2fe8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022213760:0@lo:400: 00000100:00100000:3.0:1788459910.226011:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459910.226044:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022213632 00000100:00100000:3.0:1788459910.226051:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022213632 00000100:00100000:3.0:1788459910.226096:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788459910.226105:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf2fe9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1875336022213632:12345-0@lo:400: 00000100:00100000:3.0:1788459910.226151:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf2fe9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1875336022213632:12345-0@lo:400: Request processed in 47us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459910.226158:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788459910.226180:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022213376 00000100:00100000:3.0:1788459910.226183:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022213376 00000100:00100000:3.0:1788459910.226215:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022213760 00000100:00100000:3.0:1788459910.226218:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022213760 00000100:00100000:3.0:1788459910.226231:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788459910.226237:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc4394e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022213376:12345-0@lo:41: 00000004:00000024:3.0:1788459910.226261:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446547456 avail 1300307968 00000100:00100000:3.0:1788459910.226291:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc4394e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022213376:12345-0@lo:41: Request processed in 54us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459910.226296:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788459910.226307:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788459910.226312:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf2fe8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022213760:12345-0@lo:400: 00000100:00100000:3.0:1788459910.226353:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf2fe8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022213760:12345-0@lo:400: Request processed in 41us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459910.226359:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788459910.226392:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf2fe8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022213760:0@lo:400: 00010000:00080000:3.0:1788459910.226404:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c4bf2febb80 x1875336022213632/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788459926 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788459910.226413:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf2febb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875336022213632:0@lo:400: 00000100:00100000:1.0:1788459910.226615:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf2fe8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0cf73fe6-82e2-434e-b670-631647721b2c:3660:1875336022213504:0@lo:400: 00000100:00100000:1.0:1788459910.226656:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459910.226696:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788459910.226703:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf2feb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3660:1875336022213888:0@lo:400: 00000100:00100000:1.0:1788459910.226728:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459910.227146:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4718380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022213376:0@lo:41: 00000100:00100000:1.0:1788459910.227211:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022213888 00000100:00100000:1.0:1788459910.227217:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022213888 00000100:00100000:1.0:1788459910.227258:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788459910.227267:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf75e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1875336022213888:12345-0@lo:400: 00000100:00100000:1.0:1788459910.227322:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf75e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1875336022213888:12345-0@lo:400: Request processed in 56us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459910.227329:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1788459910.227346:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c4bf2feb100 x1875336022213888/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788459926 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788459910.227358:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf2feb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3660:1875336022213888:0@lo:400: 00000100:00100000:3.0:1788459910.227420:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022213504 00000100:00100000:3.0:1788459910.227424:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022213504 00000100:00100000:3.0:1788459910.227458:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788459910.227465:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+19:3660:x1875336022213504:12345-0@lo:400: 00000100:00100000:3.0:1788459910.227514:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+19:3660:x1875336022213504:12345-0@lo:400: Request processed in 50us (858us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459910.227520:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788459910.227689:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf2fe8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0cf73fe6-82e2-434e-b670-631647721b2c:3660:1875336022213504:0@lo:400: 00010000:00010000:2.0:1788459910.929065:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788459911.956525:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788459912.585680:0:8441:0:(obd_mount.c:1011:lmd_print()) mount data: 00000020:01000004:3.0:1788459912.585686:0:8441:0:(obd_mount.c:1014:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788459912.585687:0:8441:0:(obd_mount.c:1017:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1788459912.587874:0:8441:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8c4bef21b800 00000020:01000004:3.0:1788459912.587892:0:8441:0:(tgt_mount.c:2642:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1788459912.587904:0:8441:0:(obd_mount.c:308:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788459912.587917:0:8441:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8c4bef211988) 00000020:00000080:3.0:1788459912.587932:0:8441:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788459912.632201:0:8441:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1788459912.632260:0:8441:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:3.0:1788459912.643728:0:8441:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788459912.644057:0:8441:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788459912.644069:0:8441:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788459912.644079:0:8441:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x5dfa74784542ab18 00000020:01000004:3.0:1788459912.644090:0:8441:0:(tgt_mount.c:2727:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788459912.644111:0:8441:0:(obd_mount.c:488:lustre_start_mgc()) mgc192.168.206.105@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788459912.644115:0:8441:0:(mgc_request.c:1379:mgc_set_info_async()) InitRecov mgc192.168.206.105@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788459912.644121:0:8441:0:(tgt_mount.c:1939:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788459912.644126:0:8441:0:(obd_mount.c:308:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788459912.644137:0:8441:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8c4bef216620) 00000020:00000080:3.0:1788459912.644148:0:8441:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:3.0:1788459912.652033:0:8441:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788459912.652215:0:8441:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788459912.652221:0:8441:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788459912.657844:0:8441:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788459912.657856:0:8441:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788459912.658655:0:8441:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788459912.658664:0:8441:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1788459912.661377:0:8441:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788459912.661542:0:8441:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1788459912.661629:0:8441:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1788459912.662800:0:8441:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1788459912.662809:0:8441:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1788459912.699700:0:8441:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788459912.700169:0:8441:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788459912.700176:0:8441:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1788459912.701750:0:8441:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788459912.701763:0:8441:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1788459912.705994:0:8441:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788459912.706020:0:8441:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1788459912.716087:0:8441:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788459912.716344:0:8441:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1788459912.716350:0:8441:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1788459912.717188:0:8441:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1788459912.717196:0:8441:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1788459912.787825:0:8441:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788459912.788043:0:8441:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788459912.788049:0:8441:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788459912.789815:0:8441:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788459912.789839:0:8441:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788459912.791296:0:8441:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1788459912.791344:0:8441:0:(tgt_mount.c:1519:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.105@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1788459912.791349:0:8441:0:(tgt_mount.c:1239:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788459912.791351:0:8441:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788459912.791352:0:8441:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788459912.791353:0:8441:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:2.0:1788459912.791355:0:8441:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788459912.791356:0:8441:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788459912.791358:0:8441:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788459912.791359:0:8441:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788459912.791360:0:8441:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788459912.791362:0:8441:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788459912.791363:0:8441:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788459912.791367:0:8441:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1788459912.791369:0:8441:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788459912.791370:0:8441:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788459912.791371:0:8441:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788459912.791372:0:8441:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:2.0:1788459912.791374:0:8441:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788459912.791375:0:8441:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788459912.791376:0:8441:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788459912.791377:0:8441:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788459912.791378:0:8441:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788459912.791379:0:8441:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788459912.791380:0:8441:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788459912.791406:0:8441:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788459912.791424:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4397800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:8441:1875336022214016:0@lo:253: 00000100:00100000:2.0:1788459912.791505:0:8441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459912.791610:0:8441:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bf767e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788459912.791895:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022214016 00000100:00100000:3.0:1788459912.791903:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022214016 00000100:00100000:3.0:1788459912.792011:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788459912.792021:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+19:8441:x1875336022214016:12345-0@lo:253: 20000000:01000000:3.0:1788459912.792061:0:6525:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788459912.792065:0:6525:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1788459912.792069:0:6525:0:(mgs_llog.c:875:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1788459912.792072:0:6525:0:(mgs_llog.c:3868:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1788459912.792318:0:6525:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788459912.792521:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1788459912.792535:0:6525:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1788459912.792553:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1788459912.792559:0:6525:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1788459912.792572:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1788459912.792600:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1788459912.792695:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1788459912.792709:0:6525:0:(mgs_llog.c:3821:mgs_write_log_osc_to_lov()) add nid 192.168.206.105@tcp 20000000:01000000:3.0:1788459912.792725:0:6525:0:(mgs_llog.c:1545:record_base_raw()) lcfg (null) 0xcf005 192.168.206.105@tcp (null) (null) (null) 00000040:00080000:3.0:1788459912.792752:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1788459912.792759:0:6525:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788459912.792772:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1788459912.792778:0:6525:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.206.105@tcp (null) (null) 00000040:00080000:3.0:1788459912.792789:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1788459912.792795:0:6525:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1788459912.792806:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1788459912.792820:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1788459912.792887:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:3.0:1788459912.792898:0:6525:0:(mgs_llog.c:3821:mgs_write_log_osc_to_lov()) add nid 192.168.206.105@tcp 20000000:01000000:3.0:1788459912.792899:0:6525:0:(mgs_llog.c:1545:record_base_raw()) lcfg (null) 0xcf005 192.168.206.105@tcp (null) (null) (null) 00000040:00080000:3.0:1788459912.792913:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:3.0:1788459912.792917:0:6525:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788459912.792928:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:3.0:1788459912.792932:0:6525:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.206.105@tcp (null) (null) 00000040:00080000:3.0:1788459912.792986:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:3.0:1788459912.792995:0:6525:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1788459912.793009:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:3.0:1788459912.793024:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:3.0:1788459912.793371:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:3.0:1788459912.793384:0:6525:0:(mgs_llog.c:3821:mgs_write_log_osc_to_lov()) add nid 192.168.206.105@tcp 20000000:01000000:3.0:1788459912.793385:0:6525:0:(mgs_llog.c:1545:record_base_raw()) lcfg (null) 0xcf005 192.168.206.105@tcp (null) (null) (null) 00000040:00080000:3.0:1788459912.793399:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:3.0:1788459912.793406:0:6525:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1788459912.793419:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:3.0:1788459912.793425:0:6525:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.206.105@tcp (null) (null) 00000040:00080000:3.0:1788459912.793437:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:3.0:1788459912.793452:0:6525:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1788459912.793470:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:3.0:1788459912.793500:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:3.0:1788459912.793515:0:6525:0:(mgs_llog.c:5258:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788459912.793518:0:6525:0:(mgs_llog.c:4754:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788459912.793521:0:6525:0:(mgs_llog.c:4187:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788459912.793575:0:6525:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788459912.793578:0:6525:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788459912.794699:0:8460:0:(mgs_llog.c:1082:mgs_modify_handler()) Changing rec 22 marker 18 1->4: lustre sys.timeout 20000000:01000000:1.0:1788459912.794818:0:8460:0:(mgs_llog.c:1082:mgs_modify_handler()) Changing rec 24 marker 18 2->4: lustre sys.timeout 00000040:00080000:1.0:1788459912.794837:0:8460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1788459912.795080:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1788459912.795102:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1788459912.795118:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:3.0:1788459912.795128:0:6525:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788459912.795131:0:6525:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788459912.795404:0:8461:0:(mgs_llog.c:1082:mgs_modify_handler()) Changing rec 27 marker 19 1->4: lustre sys.timeout 20000000:01000000:1.0:1788459912.795424:0:8461:0:(mgs_llog.c:1082:mgs_modify_handler()) Changing rec 29 marker 19 2->4: lustre sys.timeout 00000040:00080000:1.0:1788459912.795439:0:8461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1788459912.797867:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:3.0:1788459912.797899:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:3.0:1788459912.797916:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:3.0:1788459912.797927:0:6525:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788459912.797929:0:6525:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788459912.799431:0:8462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1788459912.801291:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1788459912.801327:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1788459912.801344:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:1.0:1788459912.801358:0:6525:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1788459912.801360:0:6525:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788459912.801849:0:8463:0:(mgs_llog.c:1082:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:3.0:1788459912.801889:0:8463:0:(mgs_llog.c:1082:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:3.0:1788459912.801907:0:8463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:1.0:1788459912.802667:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:1.0:1788459912.802693:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:1.0:1788459912.802710:0:6525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 10000000:01000000:1.0:1788459912.802816:0:6525:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788459912.802835:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c4bc29d0a00/0x5dfa74784542ab26 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459912.802878:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4bc29d1200/0x5dfa74784542a9c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542a9c1 expref: 19 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459912.802887:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4bc29d3e00/0x5dfa74784542a9f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542a9eb expref: 19 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459912.802894:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4bc29d0800/0x5dfa74784542aa69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542aa62 expref: 19 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459912.802901:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4bc29d2400/0x5dfa74784542aaa1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542aa9a expref: 19 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459912.802908:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4bc29d2600/0x5dfa74784542aabd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542aab6 expref: 19 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459912.802916:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4bef208000/0x5dfa74784542aae7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542aae0 expref: 19 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459912.802923:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c4bc29d0a00/0x5dfa74784542ab26 lrc: 9/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459912.802992:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4bef208000/0x5dfa74784542aae7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5dfa74784542aae0 expref: 19 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459912.803006:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c4bef208000/0x5dfa74784542aae7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5dfa74784542aae0 expref: 19 pid: 6528 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788459912.803019:0:6525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e0700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6525:1875336022214144:0@lo:104: 00000100:00100000:1.0:1788459912.803075:0:6525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459912.803348:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022214144 00000100:00100000:3.0:1788459912.803355:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022214144 00000100:00100000:3.0:1788459912.803406:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788459912.803414:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf75e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0cf73fe6-82e2-434e-b670-631647721b2c+3:6525:x1875336022214144:12345-0@lo:104: 00010000:00010000:3.0:1788459912.803426:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0000/0x5dfa74784542aae0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542aae7 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459912.803655:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788459912.803662:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf75e2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0cf73fe6-82e2-434e-b670-631647721b2c+3:6525:x1875336022214144:12345-0@lo:104: Request processed in 249us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459912.803679:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:0.0:1788459912.803734:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788459912.803740:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0000/0x5dfa74784542aae0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542aae7 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459912.803753:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc29d0000 already unused, calling callback (ffffffffc125ae00) 10000000:00010000:0.0:1788459912.803757:0:6522:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0000/0x5dfa74784542aae0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x5dfa74784542aae7 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459912.803765:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0000/0x5dfa74784542aae0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x5dfa74784542aae7 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788459912.803772:0:6522:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0000/0x5dfa74784542aae0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x5dfa74784542aae7 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788459912.803777:0:6522:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788459912.803814:0:6522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0000/0x5dfa74784542aae0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542aae7 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459912.803821:0:6522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788459912.803851:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc471a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0cf73fe6-82e2-434e-b670-631647721b2c:3660:1875336022214272:0@lo:103: 00000100:00100000:2.0:1788459912.803885:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459912.803993:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022214272 00000100:00100000:3.0:1788459912.803998:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022214272 00010000:00010000:3.0:1788459912.804016:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4bef208000/0x5dfa74784542aae7 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542aae0 expref: 20 pid: 6528 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788459912.804036:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788459912.804043:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc4395180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0cf73fe6-82e2-434e-b670-631647721b2c+20:3660:x1875336022214272:12345-0@lo:103: 00010000:00010000:0.0:1788459912.804048:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0000/0x5dfa74784542aae0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542aae7 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459912.804052:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788459912.804056:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0000/0x5dfa74784542aae0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542aae7 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459912.804057:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4bef208000/0x5dfa74784542aae7 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542aae0 expref: 20 pid: 6528 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459912.804066:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4bef208000/0x5dfa74784542aae7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5dfa74784542aae0 expref: 20 pid: 6528 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459912.804068:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788459912.804070:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788459912.804072:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788459912.804081:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788459912.804116:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc4395180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0cf73fe6-82e2-434e-b670-631647721b2c+20:3660:x1875336022214272:12345-0@lo:103: Request processed in 74us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459912.804133:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788459912.804138:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc471a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0cf73fe6-82e2-434e-b670-631647721b2c:3660:1875336022214272:0@lo:103: 00010000:00010000:1.0:1788459912.804325:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4bc29d2600/0x5dfa74784542aabd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5dfa74784542aab6 expref: 19 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459912.804335:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c4bc29d2600/0x5dfa74784542aabd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5dfa74784542aab6 expref: 19 pid: 6528 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788459912.804344:0:6525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e2300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6525:1875336022214400:0@lo:104: 00000100:00100000:1.0:1788459912.804369:0:6525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788459912.804399:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4bc29d2400/0x5dfa74784542aaa1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5dfa74784542aa9a expref: 19 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459912.804407:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c4bc29d2400/0x5dfa74784542aaa1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5dfa74784542aa9a expref: 19 pid: 6525 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788459912.804414:0:6525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e2d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6525:1875336022214528:0@lo:104: 00000100:00100000:1.0:1788459912.804433:0:6525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788459912.804545:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4bc29d0800/0x5dfa74784542aa69 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5dfa74784542aa62 expref: 19 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459912.804554:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c4bc29d0800/0x5dfa74784542aa69 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5dfa74784542aa62 expref: 19 pid: 6525 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788459912.804562:0:6525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e1880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6525:1875336022214656:0@lo:104: 00000100:00100000:1.0:1788459912.804593:0:6525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459912.807111:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022214400 00000100:00100000:2.0:1788459912.807124:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022214400 00000100:00100000:2.0:1788459912.807164:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022214528 00000100:00100000:2.0:1788459912.807167:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022214528 00000100:00100000:2.0:1788459912.807194:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022214656 00000100:00100000:2.0:1788459912.807197:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022214656 00000100:00100000:2.0:1788459912.807210:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788459912.807218:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf75e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0cf73fe6-82e2-434e-b670-631647721b2c+5:6525:x1875336022214400:12345-0@lo:104: 00010000:00010000:2.0:1788459912.807234:0:6516:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d3800/0x5dfa74784542aab6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542aabd expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459912.807660:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788459912.807667:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf75e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0cf73fe6-82e2-434e-b670-631647721b2c+5:6525:x1875336022214400:12345-0@lo:104: Request processed in 449us (3297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459912.807675:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788459912.807693:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788459912.807700:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf75e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0cf73fe6-82e2-434e-b670-631647721b2c+4:6525:x1875336022214528:12345-0@lo:104: 00010000:00010000:2.0:1788459912.807709:0:6516:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0200/0x5dfa74784542aa9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542aaa1 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459912.807756:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788459912.807761:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf75e1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0cf73fe6-82e2-434e-b670-631647721b2c+4:6525:x1875336022214528:12345-0@lo:104: Request processed in 63us (3327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459912.807767:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788459912.807779:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788459912.807786:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf75e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0cf73fe6-82e2-434e-b670-631647721b2c+3:6525:x1875336022214656:12345-0@lo:104: 00010000:00010000:2.0:1788459912.807793:0:6516:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.206.105@tcp lock: ffff8c4bef208400/0x5dfa74784542aa62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542aa69 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459912.807820:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788459912.807825:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf75e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0cf73fe6-82e2-434e-b670-631647721b2c+3:6525:x1875336022214656:12345-0@lo:104: Request processed in 41us (3232us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459912.807841:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1788459912.807998:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788459912.808004:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d3800/0x5dfa74784542aab6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542aabd expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459912.808022:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc29d3800 already unused, calling callback (ffffffffc125ae00) 10000000:00010000:0.0:1788459912.808026:0:6522:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d3800/0x5dfa74784542aab6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x5dfa74784542aabd expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459912.808034:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d3800/0x5dfa74784542aab6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x5dfa74784542aabd expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788459912.808041:0:6522:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d3800/0x5dfa74784542aab6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x5dfa74784542aabd expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788459912.808047:0:6522:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788459912.808078:0:6522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d3800/0x5dfa74784542aab6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542aabd expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459912.808085:0:6522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788459912.808105:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d3800/0x5dfa74784542aab6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542aabd expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459912.808112:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d3800/0x5dfa74784542aab6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542aabd expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459912.808124:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788459912.808127:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0200/0x5dfa74784542aa9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542aaa1 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459912.808133:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc29d0200 already unused, calling callback (ffffffffc125ae00) 10000000:00010000:0.0:1788459912.808136:0:6522:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0200/0x5dfa74784542aa9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5dfa74784542aaa1 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459912.808153:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0200/0x5dfa74784542aa9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5dfa74784542aaa1 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788459912.808160:0:6522:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0200/0x5dfa74784542aa9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5dfa74784542aaa1 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788459912.808165:0:6522:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788459912.808178:0:6522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0200/0x5dfa74784542aa9a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542aaa1 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459912.808184:0:6522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788459912.808189:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0200/0x5dfa74784542aa9a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542aaa1 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459912.808196:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0200/0x5dfa74784542aa9a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542aaa1 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459912.808205:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788459912.808208:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: ffff8c4bef208400/0x5dfa74784542aa62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542aa69 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459912.808213:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bef208400 already unused, calling callback (ffffffffc125ae00) 10000000:00010000:0.0:1788459912.808216:0:6522:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: ffff8c4bef208400/0x5dfa74784542aa62 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5dfa74784542aa69 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459912.808223:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: ffff8c4bef208400/0x5dfa74784542aa62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5dfa74784542aa69 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788459912.808229:0:6522:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: ffff8c4bef208400/0x5dfa74784542aa62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5dfa74784542aa69 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788459912.808251:0:6522:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788459912.808263:0:6522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.206.105@tcp lock: ffff8c4bef208400/0x5dfa74784542aa62 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542aa69 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459912.808269:0:6522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788459912.808282:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: ffff8c4bef208400/0x5dfa74784542aa62 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542aa69 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459912.808289:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: ffff8c4bef208400/0x5dfa74784542aa62 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542aa69 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459912.808296:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788459912.808298:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788459912.808300:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788459912.808311:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc471a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0cf73fe6-82e2-434e-b670-631647721b2c:3661:1875336022214784:0@lo:103: 00000100:00100000:0.0:1788459912.808345:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459912.808374:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788459912.808380:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc471a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0cf73fe6-82e2-434e-b670-631647721b2c:3661:1875336022214912:0@lo:103: 00000100:00100000:0.0:1788459912.808411:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459912.808439:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022214784 00000100:00100000:0.0:1788459912.808455:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022214784 00010000:00010000:0.0:1788459912.808477:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4bc29d2600/0x5dfa74784542aabd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542aab6 expref: 20 pid: 6528 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788459912.808496:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022214912 00000100:00100000:0.0:1788459912.808498:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022214912 00010000:00010000:0.0:1788459912.808507:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4bc29d2400/0x5dfa74784542aaa1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542aa9a expref: 21 pid: 6525 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788459912.808531:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788459912.808536:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc4719f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0cf73fe6-82e2-434e-b670-631647721b2c+21:3661:x1875336022214784:12345-0@lo:103: 00010000:00010000:0.0:1788459912.808545:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788459912.808550:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4bc29d2600/0x5dfa74784542aabd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542aab6 expref: 21 pid: 6528 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459912.808560:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4bc29d2600/0x5dfa74784542aabd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5dfa74784542aab6 expref: 21 pid: 6528 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459912.808574:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788459912.808609:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc4719f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0cf73fe6-82e2-434e-b670-631647721b2c+21:3661:x1875336022214784:12345-0@lo:103: Request processed in 72us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459912.808615:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788459912.808627:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788459912.808632:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc4718380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0cf73fe6-82e2-434e-b670-631647721b2c+20:3661:x1875336022214912:12345-0@lo:103: 00010000:00010000:0.0:1788459912.808638:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788459912.808642:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4bc29d2400/0x5dfa74784542aaa1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542aa9a expref: 20 pid: 6525 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459912.808650:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4bc29d2400/0x5dfa74784542aaa1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5dfa74784542aa9a expref: 20 pid: 6525 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459912.808659:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788459912.808674:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc4718380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0cf73fe6-82e2-434e-b670-631647721b2c+20:3661:x1875336022214912:12345-0@lo:103: Request processed in 43us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459912.808679:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788459912.808697:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4718700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0cf73fe6-82e2-434e-b670-631647721b2c:3659:1875336022215040:0@lo:103: 00000100:00100000:0.0:1788459912.810357:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788459912.810920:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788459912.811392:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc471a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0cf73fe6-82e2-434e-b670-631647721b2c:3661:1875336022214912:0@lo:103: 00010000:00010000:1.0:1788459912.811397:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4bc29d3e00/0x5dfa74784542a9f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5dfa74784542a9eb expref: 19 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459912.811410:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c4bc29d3e00/0x5dfa74784542a9f2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5dfa74784542a9eb expref: 19 pid: 6526 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788459912.811413:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc471a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0cf73fe6-82e2-434e-b670-631647721b2c:3661:1875336022214784:0@lo:103: 00000100:00100000:1.0:1788459912.811436:0:6525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e1180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6525:1875336022215168:0@lo:104: 00000100:00100000:0.0:1788459912.811443:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022215040 00000100:00100000:0.0:1788459912.811590:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022215040 00010000:00010000:0.0:1788459912.811616:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4bc29d0800/0x5dfa74784542aa69 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542aa62 expref: 20 pid: 6525 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788459912.811643:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788459912.811651:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc471b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0cf73fe6-82e2-434e-b670-631647721b2c+20:3659:x1875336022215040:12345-0@lo:103: 00010000:00010000:0.0:1788459912.811662:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788459912.811667:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4bc29d0800/0x5dfa74784542aa69 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542aa62 expref: 20 pid: 6525 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459912.811676:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4bc29d0800/0x5dfa74784542aa69 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5dfa74784542aa62 expref: 20 pid: 6525 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459912.811692:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788459912.811748:0:6525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459912.811751:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc471b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0cf73fe6-82e2-434e-b670-631647721b2c+20:3659:x1875336022215040:12345-0@lo:103: Request processed in 101us (1401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459912.811757:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788459912.811774:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022215168 00000100:00100000:1.0:1788459912.811777:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022215168 00000100:00100000:1.0:1788459912.811810:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788459912.811817:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf75e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0cf73fe6-82e2-434e-b670-631647721b2c+3:6525:x1875336022215168:12345-0@lo:104: 00010000:00010000:1.0:1788459912.811828:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.206.105@tcp lock: ffff8c4bc0031c00/0x5dfa74784542a9eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542a9f2 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788459912.811838:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4718700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0cf73fe6-82e2-434e-b670-631647721b2c:3659:1875336022215040:0@lo:103: 00010000:00010000:1.0:1788459912.811910:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788459912.811917:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf75e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0cf73fe6-82e2-434e-b670-631647721b2c+3:6525:x1875336022215168:12345-0@lo:104: Request processed in 100us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459912.811923:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1788459912.811973:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4bc29d1200/0x5dfa74784542a9c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5dfa74784542a9c1 expref: 19 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459912.811982:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c4bc29d1200/0x5dfa74784542a9c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5dfa74784542a9c1 expref: 19 pid: 6526 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788459912.811990:0:6525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e1c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6525:1875336022215296:0@lo:104: 00000100:00100000:1.0:1788459912.812013:0:6525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459912.812049:0:6525:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bf74ef600 going to sleep for 11 seconds 00010000:00010000:1.0:1788459912.812062:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4bef208000/0x5dfa74784542aae7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5dfa74784542aae0 expref: 19 pid: 6528 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788459912.812074:0:6525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e0700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6525:1875336022214144:0@lo:104: 00000100:00100000:0.0:1788459912.812084:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022215296 00010000:00010000:1.0:1788459912.812085:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4bc29d2600/0x5dfa74784542aabd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5dfa74784542aab6 expref: 18 pid: 6528 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788459912.812088:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022215296 00000100:00100000:1.0:1788459912.812092:0:6525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e2300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6525:1875336022214400:0@lo:104: 00000100:00100000:0.0:1788459912.812153:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788459912.812160:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf75e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0cf73fe6-82e2-434e-b670-631647721b2c+3:6525:x1875336022215296:12345-0@lo:104: 00010000:00010000:0.0:1788459912.812167:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.206.105@tcp lock: ffff8c4bc0030a00/0x5dfa74784542a9c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542a9c8 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459912.812197:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4bc29d2400/0x5dfa74784542aaa1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5dfa74784542aa9a expref: 17 pid: 6525 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788459912.812207:0:6525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e2d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6525:1875336022214528:0@lo:104: 00010000:00010000:1.0:1788459912.812219:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4bc29d0800/0x5dfa74784542aa69 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5dfa74784542aa62 expref: 16 pid: 6525 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788459912.812227:0:6525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e1880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6525:1875336022214656:0@lo:104: 00000100:00100000:1.0:1788459912.812235:0:6525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e1180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6525:1875336022215168:0@lo:104: 00000100:00100000:1.0:1788459912.812241:0:6525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e1c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6525:1875336022215296:0@lo:104: 00010000:00010000:1.0:1788459912.812261:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c4bc29d0a00/0x5dfa74784542ab26 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459912.812442:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788459912.812449:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: ffff8c4bc0031c00/0x5dfa74784542a9eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542a9f2 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459912.812706:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc0031c00 already unused, calling callback (ffffffffc125ae00) 10000000:00010000:3.0:1788459912.812709:0:6522:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: ffff8c4bc0031c00/0x5dfa74784542a9eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5dfa74784542a9f2 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459912.812729:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: ffff8c4bc0031c00/0x5dfa74784542a9eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5dfa74784542a9f2 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788459912.812735:0:6522:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: ffff8c4bc0031c00/0x5dfa74784542a9eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5dfa74784542a9f2 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788459912.812741:0:6522:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788459912.812816:0:6522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.206.105@tcp lock: ffff8c4bc0031c00/0x5dfa74784542a9eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542a9f2 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459912.812822:0:6522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788459912.812838:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: ffff8c4bc0031c00/0x5dfa74784542a9eb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542a9f2 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459912.812844:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: ffff8c4bc0031c00/0x5dfa74784542a9eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542a9f2 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459912.812855:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788459912.812859:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: ffff8c4bc0030a00/0x5dfa74784542a9c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542a9c8 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459912.812864:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc0030a00 already unused, calling callback (ffffffffc125ae00) 10000000:00010000:3.0:1788459912.812867:0:6522:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: ffff8c4bc0030a00/0x5dfa74784542a9c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5dfa74784542a9c8 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459912.812873:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: ffff8c4bc0030a00/0x5dfa74784542a9c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5dfa74784542a9c8 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788459912.812879:0:6522:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: ffff8c4bc0030a00/0x5dfa74784542a9c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5dfa74784542a9c8 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788459912.812890:0:6522:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1788459912.813001:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf2febb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0cf73fe6-82e2-434e-b670-631647721b2c:3660:1875336022215424:0@lo:103: 00000100:00100000:1.0:1788459912.813049:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459912.813083:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022215424 00000100:00100000:1.0:1788459912.813087:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022215424 00010000:00010000:1.0:1788459912.813120:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4bc29d3e00/0x5dfa74784542a9f2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542a9eb expref: 16 pid: 6526 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788459912.813151:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788459912.813158:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf75e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0cf73fe6-82e2-434e-b670-631647721b2c+16:3660:x1875336022215424:12345-0@lo:103: 00010000:00010000:1.0:1788459912.813167:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788459912.813171:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4bc29d3e00/0x5dfa74784542a9f2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542a9eb expref: 16 pid: 6526 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459912.813181:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4bc29d3e00/0x5dfa74784542a9f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5dfa74784542a9eb expref: 16 pid: 6526 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459912.813202:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4bc29d3e00/0x5dfa74784542a9f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5dfa74784542a9eb expref: 16 pid: 6526 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459912.813213:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788459912.813243:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf75e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0cf73fe6-82e2-434e-b670-631647721b2c+15:3660:x1875336022215424:12345-0@lo:103: Request processed in 86us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459912.813250:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788459912.813279:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf2febb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0cf73fe6-82e2-434e-b670-631647721b2c:3660:1875336022215424:0@lo:103: 00010000:00010000:3.0:1788459912.813924:0:6522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.206.105@tcp lock: ffff8c4bc0030a00/0x5dfa74784542a9c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542a9c8 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459912.813934:0:6522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788459912.813966:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: ffff8c4bc0030a00/0x5dfa74784542a9c1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542a9c8 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459912.813974:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: ffff8c4bc0030a00/0x5dfa74784542a9c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542a9c8 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459912.813989:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788459912.813991:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788459912.813993:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788459912.814332:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:0.0:1788459912.814341:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf75e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0cf73fe6-82e2-434e-b670-631647721b2c+3:6525:x1875336022215296:12345-0@lo:104: Request processed in 2180us (2325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459912.814350:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788459912.814373:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788459912.814383:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf2fe8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0cf73fe6-82e2-434e-b670-631647721b2c:3662:1875336022215552:0@lo:103: 00000100:00100000:0.0:1788459912.814427:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788459912.814555:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788459912.815233:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022215552 00000100:00100000:3.0:1788459912.815241:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022215552 00010000:00010000:3.0:1788459912.815271:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4bc29d1200/0x5dfa74784542a9c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542a9c1 expref: 15 pid: 6526 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788459912.815299:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788459912.815306:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bedf6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0cf73fe6-82e2-434e-b670-631647721b2c+15:3662:x1875336022215552:12345-0@lo:103: 00010000:00010000:3.0:1788459912.815316:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788459912.815321:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4bc29d1200/0x5dfa74784542a9c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542a9c1 expref: 15 pid: 6526 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459912.815332:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4bc29d1200/0x5dfa74784542a9c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5dfa74784542a9c1 expref: 15 pid: 6526 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459912.815347:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4bc29d1200/0x5dfa74784542a9c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5dfa74784542a9c1 expref: 15 pid: 6526 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459912.815371:0:6520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c4bc29d0a00/0x5dfa74784542ab26 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459912.815379:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bc29d0a00/0x5dfa74784542ab26 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459912.815394:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c4bc29d0a00/0x5dfa74784542ab26 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459912.815401:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c4bc29d0a00/0x5dfa74784542ab26 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459912.815407:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c4bc29d0a00/0x5dfa74784542ab26 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459912.815413:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c4bc29d0a00/0x5dfa74784542ab26 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459912.815419:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc29d0a00 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:3.0:1788459912.815423:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c4bc29d0a00/0x5dfa74784542ab26 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459912.815430:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c4bc29d0a00/0x5dfa74784542ab26 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459912.815452:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c4bc29d0a00/0x5dfa74784542ab26 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459912.815463:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788459912.815507:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bedf6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0cf73fe6-82e2-434e-b670-631647721b2c+14:3662:x1875336022215552:12345-0@lo:103: Request processed in 202us (1080us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459912.815523:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1788459912.815527:0:6525:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c4bc29d0a00/0x5dfa74784542ab26 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459912.815535:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c4bc29d0a00/0x5dfa74784542ab26 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459912.815542:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4bc29d0a00/0x5dfa74784542ab26 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788459912.815555:0:6525:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788459912.816388:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf2fe8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0cf73fe6-82e2-434e-b670-631647721b2c:3662:1875336022215552:0@lo:103: 00000100:00100000:1.0:1788459912.818719:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+13:8441:x1875336022214016:12345-0@lo:253: Request processed in 26686us (27201us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459912.818732:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788459912.818878:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4397800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:8441:1875336022214016:0@lo:253: 10000000:01000000:2.0:1788459912.818892:0:8441:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788459912.818895:0:8441:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788459912.818897:0:8441:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788459912.818898:0:8441:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788459912.818900:0:8441:0:(tgt_mount.c:1242:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1788459912.818901:0:8441:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788459912.818902:0:8441:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788459912.818904:0:8441:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788459912.818905:0:8441:0:(tgt_mount.c:1260:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788459912.818907:0:8441:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788459912.818908:0:8441:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788459912.818927:0:8441:0:(tgt_mount.c:115:server_register_mount()) register mount ffff8c4bef21b800 from lustre-OST0000 10000000:01000000:2.0:1788459912.818987:0:8441:0:(mgc_request.c:2423:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788459912.818990:0:8441:0:(mgc_request.c:424:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788459912.818996:0:8441:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8c4bef21b800 10000000:01000000:2.0:1788459912.819002:0:8441:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788459912.819041:0:8441:0:(mgc_request_server.c:106:mgc_fs_setup()) mgc192.168.206.105@tcp: setup lustre-OST0000-osd 00000040:01000000:2.0:1788459912.833737:0:8441:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.206.105@tcp ctxt 1 is initialized 00000040:01000000:2.0:1788459912.847340:0:8441:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.206.105@tcp ctxt 0 is initialized 10000000:01000000:2.0:1788459912.847359:0:8441:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-sptlrpc-ffff8c4bef21b800 from 1 10000000:01000000:2.0:1788459912.847363:0:8441:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788459912.847399:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0800/0x5dfa74784542ab2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459912.847409:0:8441:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0800/0x5dfa74784542ab2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459912.847432:0:8441:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0800/0x5dfa74784542ab2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788459912.847456:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4397800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:8441:1875336022215680:0@lo:101: 00000100:00100000:2.0:1788459912.847862:0:8441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459912.847925:0:8441:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bf767e000 going to sleep for 11 seconds 00000100:00100000:0.0:1788459912.848018:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022215680 00000100:00100000:0.0:1788459912.848026:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022215680 00000100:00100000:0.0:1788459912.848114:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788459912.848124:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd0a6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+13:8441:x1875336022215680:12345-0@lo:101: 00010000:00010000:0.0:1788459912.848137:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788459912.848150:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4bef208400/0x5dfa74784542ab34 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542ab2d expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459912.848171:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bef208400/0x5dfa74784542ab34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542ab2d expref: 14 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459912.848182:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4bef208400/0x5dfa74784542ab34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542ab2d expref: 14 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459912.848198:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bef208400, rc 0) 00000100:00100000:0.0:1788459912.848247:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd0a6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+14:8441:x1875336022215680:12345-0@lo:101: Request processed in 124us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459912.848254:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788459912.848330:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4397800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:8441:1875336022215680:0@lo:101: 00010000:00010000:3.0:1788459912.848347:0:8441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0800/0x5dfa74784542ab2d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ab34 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459912.848357:0:8441:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0800/0x5dfa74784542ab2d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542ab34 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788459912.848434:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf2fe9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:8441:1875336022215808:0@lo:501: 00000100:00100000:3.0:1788459912.848540:0:8441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459912.848569:0:8441:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bf7753480 going to sleep for 11 seconds 00000100:00100000:1.0:1788459912.848629:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022215808 00000100:00100000:1.0:1788459912.848634:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022215808 00000100:00100000:1.0:1788459912.848669:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788459912.848677:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+14:8441:x1875336022215808:12345-0@lo:501: 00000100:00100000:1.0:1788459912.848829:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+14:8441:x1875336022215808:12345-0@lo:501: Request processed in 153us (289us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788459912.848836:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788459912.848906:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf2fe9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:8441:1875336022215808:0@lo:501: 10000000:01000000:3.0:1788459912.848920:0:8441:0:(mgc_request_server.c:748:mgc_llog_local_copy()) mgc192.168.206.105@tcp: no remote llog for lustre-sptlrpc, check MGS config 00000100:00100000:3.0:1788459912.848990:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf2fe9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:8441:1875336022215936:0@lo:501: 00000100:00100000:3.0:1788459912.849016:0:8441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459912.849039:0:8441:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bf7753480 going to sleep for 11 seconds 00000100:00100000:1.0:1788459912.849558:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022215936 00000100:00100000:1.0:1788459912.849563:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022215936 00000100:00100000:1.0:1788459912.849608:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788459912.849617:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+14:8441:x1875336022215936:12345-0@lo:501: 00000100:00100000:1.0:1788459912.849682:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+14:8441:x1875336022215936:12345-0@lo:501: Request processed in 67us (665us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788459912.849689:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788459912.850106:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf2fe9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:8441:1875336022215936:0@lo:501: 10000000:01000000:3.0:1788459912.850132:0:8441:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788459912.850152:0:8441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0800/0x5dfa74784542ab2d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ab34 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459912.850162:0:8441:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0800/0x5dfa74784542ab2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ab34 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788459912.850172:0:8441:0:(mgc_request.c:206:do_config_log_add()) do adding config log params-ffff8c4bef21b800 10000000:01000000:3.0:1788459912.850178:0:8441:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788459912.850214:0:8441:0:(mgc_request_server.c:106:mgc_fs_setup()) mgc192.168.206.105@tcp: setup lustre-OST0000-osd 00000040:01000000:3.0:1788459912.850298:0:8441:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.206.105@tcp ctxt 1 is initialized 00000040:01000000:3.0:1788459912.850305:0:8441:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.206.105@tcp ctxt 0 is initialized 10000000:01000000:3.0:1788459912.850313:0:8441:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788459912.850316:0:8441:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788459912.850329:0:8441:0:(mgc_request_server.c:106:mgc_fs_setup()) mgc192.168.206.105@tcp: setup lustre-OST0000-osd 00000040:01000000:3.0:1788459912.850355:0:8441:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.206.105@tcp ctxt 1 is initialized 00000040:01000000:3.0:1788459912.850359:0:8441:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.206.105@tcp ctxt 0 is initialized 10000000:01000000:3.0:1788459912.850364:0:8441:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-mdtir-ffff8c4bef21b800 10000000:01000000:3.0:1788459912.850367:0:8441:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788459912.850384:0:8441:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788459912.850387:0:8441:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788459912.850428:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d3a00/0x5dfa74784542ab3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459912.850436:0:8441:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d3a00/0x5dfa74784542ab3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459912.850445:0:8441:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d3a00/0x5dfa74784542ab3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788459912.853075:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf2fe9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:8441:1875336022216064:0@lo:101: 00000100:00100000:0.0:1788459912.853145:0:8441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459912.853220:0:8441:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc2ab3c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788459912.853265:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022216064 00000100:00100000:3.0:1788459912.853273:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022216064 00000100:00100000:3.0:1788459912.853365:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788459912.853376:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+14:8441:x1875336022216064:12345-0@lo:101: 00010000:00010000:3.0:1788459912.853400:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788459912.853416:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4bc29d3000/0x5dfa74784542ab42 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542ab3b expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459912.853441:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bc29d3000/0x5dfa74784542ab42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542ab3b expref: 15 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459912.853481:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4bc29d3000/0x5dfa74784542ab42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542ab3b expref: 15 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459912.853490:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc29d3000, rc 0) 00000100:00100000:3.0:1788459912.853596:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+15:8441:x1875336022216064:12345-0@lo:101: Request processed in 206us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459912.853603:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788459912.853850:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf2fe9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:8441:1875336022216064:0@lo:101: 00010000:00010000:0.0:1788459912.853865:0:8441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d3a00/0x5dfa74784542ab3b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ab42 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459912.853875:0:8441:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d3a00/0x5dfa74784542ab3b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542ab42 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788459912.853998:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc471a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:8441:1875336022216192:0@lo:501: 00000100:00100000:0.0:1788459912.854026:0:8441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459912.854050:0:8441:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc2ab3c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788459912.854354:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022216192 00000100:00100000:1.0:1788459912.854368:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022216192 00000100:00100000:1.0:1788459912.854409:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788459912.854416:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+15:8441:x1875336022216192:12345-0@lo:501: 00000100:00100000:1.0:1788459912.854602:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+15:8441:x1875336022216192:12345-0@lo:501: Request processed in 186us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459912.854610:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788459912.855306:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc471a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:8441:1875336022216192:0@lo:501: 00000100:00100000:0.0:1788459912.855363:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc471a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:8441:1875336022216320:0@lo:503: 00000100:00100000:0.0:1788459912.855410:0:8441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459912.855436:0:8441:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc2ab3c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788459912.855577:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022216320 00000100:00100000:1.0:1788459912.855592:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022216320 00000100:00100000:1.0:1788459912.855631:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788459912.855638:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+15:8441:x1875336022216320:12345-0@lo:503: 00000100:00100000:1.0:1788459912.855853:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+15:8441:x1875336022216320:12345-0@lo:503: Request processed in 214us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459912.855860:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788459912.856285:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc471a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:8441:1875336022216320:0@lo:503: 00000040:00080000:0.0:1788459912.856607:0:8441:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788459912.856679:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc471a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:8441:1875336022216448:0@lo:502: 00000100:00100000:0.0:1788459912.857626:0:8441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459912.857724:0:8441:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc2ab3c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788459912.858290:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022216448 00000100:00100000:3.0:1788459912.858299:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022216448 00000100:00100000:3.0:1788459912.858340:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788459912.858349:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+15:8441:x1875336022216448:12345-0@lo:502: 00000100:00100000:3.0:1788459912.858477:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+15:8441:x1875336022216448:12345-0@lo:502: Request processed in 129us (854us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459912.858485:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788459912.858740:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc471a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:8441:1875336022216448:0@lo:502: 00000040:00080000:0.0:1788459912.858992:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788459912.859021:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1788459912.859037:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1788459912.859050:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1788459912.859062:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1788459912.859076:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1788459912.859104:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc471a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:8441:1875336022216576:0@lo:502: 00000100:00100000:0.0:1788459912.859148:0:8441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459912.859173:0:8441:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc2ab3c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788459912.859303:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022216576 00000100:00100000:1.0:1788459912.859308:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022216576 00000100:00100000:1.0:1788459912.859344:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788459912.859352:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+15:8441:x1875336022216576:12345-0@lo:502: 00000100:00100000:1.0:1788459912.859427:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+15:8441:x1875336022216576:12345-0@lo:502: Request processed in 76us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459912.859434:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788459912.859592:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc471a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:8441:1875336022216576:0@lo:502: 00000040:00080000:0.0:1788459912.859633:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1788459912.859641:0:8441:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1788459912.860407:0:8464:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788459912.860416:0:8464:0:(obd_mount.c:1049:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1788459912.860422:0:8464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788459912.860425:0:8464:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788459912.860430:0:8464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788459912.860521:0:8464:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8c4ac1ef6620) 00000020:00000080:1.0:1788459912.860542:0:8464:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788459912.860549:0:8464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788459912.860640:0:8464:0:(tgt_mount.c:167:server_get_mount()) get mount ffff8c4bef21b800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788459912.860648:0:8464:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788459912.860655:0:8464:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x5dfa74784542ab50 00010000:00010000:1.0:1788459912.869263:0:8464:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:1.0:1788459912.869639:0:8464:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:1.0:1788459912.879420:0:8464:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1788459912.880031:0:8464:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1788459912.886378:0:8464:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:0.0:1788459912.886572:0:8464:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:0.0:1788459912.898204:0:8464:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:0.0:1788459912.907259:0:8464:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788459912.907272:0:8464:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788459912.907279:0:8464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788459912.907281:0:8464:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788459912.907284:0:8464:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788459912.907289:0:8464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788459912.907290:0:8464:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788459912.907294:0:8464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788459912.907296:0:8464:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788459912.907332:0:8464:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788459912.907337:0:8464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788459912.907338:0:8464:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788459912.907348:0:8464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1788459912.907807:0:8441:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1788459912.907823:0:8441:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788459912.907849:0:8441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d3a00/0x5dfa74784542ab3b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ab42 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459912.907861:0:8441:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d3a00/0x5dfa74784542ab3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ab42 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788459912.907869:0:8441:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-mdtir-ffff8c4bef21b800 from 1 10000000:01000000:1.0:1788459912.907878:0:8441:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788459912.907911:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0800/0x5dfa74784542ab57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459912.907920:0:8441:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0800/0x5dfa74784542ab57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459912.907931:0:8441:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0800/0x5dfa74784542ab57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788459912.907974:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:8441:1875336022216704:0@lo:101: 00000100:00100000:1.0:1788459912.908032:0:8441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459912.908072:0:8441:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bd0b853c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788459912.908688:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022216704 00000100:00100000:2.0:1788459912.908696:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022216704 00000100:00100000:2.0:1788459912.908787:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788459912.908799:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+15:8441:x1875336022216704:12345-0@lo:101: 00010000:00010000:2.0:1788459912.908813:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788459912.908828:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4bc14f0200/0x5dfa74784542ab5e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542ab57 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459912.908852:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bc14f0200/0x5dfa74784542ab5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542ab57 expref: 16 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459912.908864:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4bc14f0200/0x5dfa74784542ab5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542ab57 expref: 16 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459912.908888:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc14f0200, rc 0) 00000100:00100000:2.0:1788459912.908976:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+16:8441:x1875336022216704:12345-0@lo:101: Request processed in 179us (942us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459912.908984:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788459912.909343:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:8441:1875336022216704:0@lo:101: 00010000:00010000:3.0:1788459912.909360:0:8441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0800/0x5dfa74784542ab57 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ab5e expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459912.909370:0:8441:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0800/0x5dfa74784542ab57 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542ab5e expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788459912.910143:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf2fe9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:8441:1875336022216832:0@lo:256: 00000100:00100000:3.0:1788459912.910195:0:8441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459912.910676:0:8441:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bf7753540 going to sleep for 11 seconds 00000100:00100000:1.0:1788459912.910844:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022216832 00000100:00100000:1.0:1788459912.910853:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022216832 00000100:00100000:1.0:1788459912.910973:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788459912.910983:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+16:8441:x1875336022216832:12345-0@lo:256: 20000000:01000000:1.0:1788459912.911002:0:6525:0:(mgs_nids.c:1209:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788459912.911028:0:6525:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788459912.911033:0:6525:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788459912.911036:0:6525:0:(mgs_nids.c:325:mgs_nidtbl_read()) Read IR logs lustre return with 88, version 4 00000100:00100000:1.0:1788459912.911384:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+16:8441:x1875336022216832:12345-0@lo:256: Request processed in 402us (1186us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459912.911393:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788459912.911496:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf2fe9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:8441:1875336022216832:0@lo:256: 10000000:01000000:3.0:1788459912.912219:0:8441:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788459912.913341:0:8441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0800/0x5dfa74784542ab57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ab5e expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459912.913354:0:8441:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0800/0x5dfa74784542ab57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ab5e expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788459912.913421:0:8441:0:(mgc_request.c:2266:mgc_process_log()) Process log params-ffff8c4bef21b800 from 1 10000000:01000000:3.0:1788459912.913426:0:8441:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788459912.913465:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d3e00/0x5dfa74784542ab65 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459912.913474:0:8441:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d3e00/0x5dfa74784542ab65 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459912.913484:0:8441:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d3e00/0x5dfa74784542ab65 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788459912.913503:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf2fe9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:8441:1875336022216960:0@lo:101: 00000100:00100000:3.0:1788459912.913686:0:8441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459912.913735:0:8441:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bf7753540 going to sleep for 11 seconds 00000100:00100000:0.0:1788459912.914388:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022216960 00000100:00100000:0.0:1788459912.914397:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022216960 00000100:00100000:0.0:1788459912.914443:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788459912.914453:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+16:8441:x1875336022216960:12345-0@lo:101: 00010000:00010000:0.0:1788459912.915408:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788459912.915435:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4bef208600/0x5dfa74784542ab6c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542ab65 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459912.915608:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bef208600/0x5dfa74784542ab6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542ab65 expref: 17 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459912.915623:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4bef208600/0x5dfa74784542ab6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542ab65 expref: 17 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459912.915633:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bef208600, rc 0) 00000100:00100000:0.0:1788459912.916155:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+17:8441:x1875336022216960:12345-0@lo:101: Request processed in 1701us (2467us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459912.916164:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788459912.919333:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf2fe9500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:8441:1875336022216960:0@lo:101: 00010000:00010000:3.0:1788459912.919365:0:8441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d3e00/0x5dfa74784542ab65 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ab6c expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459912.919381:0:8441:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d3e00/0x5dfa74784542ab65 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542ab6c expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788459912.919754:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4394380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:8441:1875336022217088:0@lo:501: 00000100:00100000:2.0:1788459912.919808:0:8441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459912.919989:0:8441:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bf767ec00 going to sleep for 11 seconds 00000100:00100000:3.0:1788459912.920286:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022217088 00000100:00100000:3.0:1788459912.920293:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022217088 00000100:00100000:3.0:1788459912.920340:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788459912.920357:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+17:8441:x1875336022217088:12345-0@lo:501: 00000100:00100000:3.0:1788459912.920471:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+17:8441:x1875336022217088:12345-0@lo:501: Request processed in 115us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459912.920479:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788459912.920568:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4394380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:8441:1875336022217088:0@lo:501: 00000100:00100000:1.0:1788459912.920614:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:8441:1875336022217216:0@lo:503: 00000100:00100000:1.0:1788459912.920658:0:8441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459912.920685:0:8441:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bd0b856c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788459912.920787:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022217216 00000100:00100000:2.0:1788459912.920792:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022217216 00000100:00100000:2.0:1788459912.920820:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788459912.920826:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+17:8441:x1875336022217216:12345-0@lo:503: 00000100:00100000:2.0:1788459912.920920:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+17:8441:x1875336022217216:12345-0@lo:503: Request processed in 93us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459912.920928:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788459912.921119:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:8441:1875336022217216:0@lo:503: 00000040:00080000:1.0:1788459912.921431:0:8441:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788459912.921514:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:8441:1875336022217344:0@lo:502: 00000100:00100000:1.0:1788459912.921674:0:8441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459912.921744:0:8441:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bd0b856c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788459912.921779:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022217344 00000100:00100000:0.0:1788459912.921785:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022217344 00000100:00100000:0.0:1788459912.921850:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788459912.921858:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+17:8441:x1875336022217344:12345-0@lo:502: 00000100:00100000:3.0:1788459912.922703:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+17:8441:x1875336022217344:12345-0@lo:502: Request processed in 842us (1025us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459912.922714:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788459912.922796:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:8441:1875336022217344:0@lo:502: 00000040:00080000:1.0:1788459912.923257:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1788459912.923287:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1788459912.923317:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:8441:1875336022217472:0@lo:502: 00000100:00100000:1.0:1788459912.923358:0:8441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459912.923438:0:8441:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bd0b856c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788459912.923474:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022217472 00000100:00100000:3.0:1788459912.923480:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022217472 00000100:00100000:3.0:1788459912.923638:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788459912.923647:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+17:8441:x1875336022217472:12345-0@lo:502: 00000100:00100000:3.0:1788459912.923859:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+17:8441:x1875336022217472:12345-0@lo:502: Request processed in 212us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459912.923866:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788459912.924111:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:8441:1875336022217472:0@lo:502: 00000040:00080000:1.0:1788459912.924256:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1788459912.924272:0:8441:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1788459912.924908:0:8468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788459912.924917:0:8468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788459912.924920:0:8468:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788459912.924926:0:8468:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c4bef21b800 00000020:00000080:1.0:1788459912.924928:0:8468:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788459912.924939:0:8468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788459912.925438:0:8468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788459912.925440:0:8468:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788459912.925444:0:8468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1788459912.925666:0:8441:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788459912.925677:0:8441:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788459912.925732:0:8441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d3e00/0x5dfa74784542ab65 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ab6c expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459912.925744:0:8441:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d3e00/0x5dfa74784542ab65 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ab6c expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788459912.925794:0:8441:0:(mgc_request.c:2423:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788459912.925797:0:8441:0:(mgc_request.c:424:config_log_add()) add config log lustre-client-ffff8c4bef21b800 10000000:01000000:2.0:1788459912.925800:0:8441:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-client-ffff8c4bef21b800 10000000:01000000:2.0:1788459912.925805:0:8441:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788459912.925822:0:8441:0:(mgc_request_server.c:106:mgc_fs_setup()) mgc192.168.206.105@tcp: setup lustre-OST0000-osd 00000040:01000000:2.0:1788459912.925871:0:8441:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.206.105@tcp ctxt 1 is initialized 00000040:01000000:2.0:1788459912.925877:0:8441:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.206.105@tcp ctxt 0 is initialized 10000000:01000000:2.0:1788459912.925888:0:8441:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-client-ffff8c4bef21b800 from 1 10000000:01000000:2.0:1788459912.925891:0:8441:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788459912.925936:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7a00/0x5dfa74784542ab73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459912.926109:0:8441:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7a00/0x5dfa74784542ab73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459912.926120:0:8441:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7a00/0x5dfa74784542ab73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788459912.926216:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4394a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:8441:1875336022217600:0@lo:101: 00000100:00100000:2.0:1788459912.926272:0:8441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459912.926361:0:8441:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bedf766c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788459912.926467:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022217600 00000100:00100000:3.0:1788459912.926473:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022217600 00000100:00100000:3.0:1788459912.926619:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788459912.926630:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4c02042850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+17:8441:x1875336022217600:12345-0@lo:101: 00010000:00010000:3.0:1788459912.926643:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788459912.926655:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4bc29d3800/0x5dfa74784542ab7a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542ab73 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459912.926676:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bc29d3800/0x5dfa74784542ab7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542ab73 expref: 18 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459912.926687:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4bc29d3800/0x5dfa74784542ab7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542ab73 expref: 18 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459912.926706:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc29d3800, rc 0) 00000100:00100000:3.0:1788459912.926836:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4c02042850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+18:8441:x1875336022217600:12345-0@lo:101: Request processed in 208us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459912.926843:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788459912.927031:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4394a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:8441:1875336022217600:0@lo:101: 00010000:00010000:1.0:1788459912.927047:0:8441:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7a00/0x5dfa74784542ab73 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ab7a expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459912.927055:0:8441:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7a00/0x5dfa74784542ab73 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542ab7a expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788459912.927118:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:8441:1875336022217728:0@lo:501: 00000100:00100000:1.0:1788459912.927307:0:8441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459912.930724:0:8441:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bd0b853c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788459912.930770:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022217728 00000100:00100000:2.0:1788459912.930779:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022217728 00000100:00100000:3.0:1788459912.930869:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788459912.930881:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc844a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+18:8441:x1875336022217728:12345-0@lo:501: 00000100:00100000:3.0:1788459912.931059:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc844a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+18:8441:x1875336022217728:12345-0@lo:501: Request processed in 180us (3751us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459912.931067:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788459912.931160:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:8441:1875336022217728:0@lo:501: 00000100:00100000:1.0:1788459912.931202:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:8441:1875336022217856:0@lo:503: 00000100:00100000:1.0:1788459912.931253:0:8441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459912.931523:0:8441:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bd0b853c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788459912.931639:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022217856 00000100:00100000:0.0:1788459912.931645:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022217856 00000100:00100000:0.0:1788459912.931669:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788459912.931676:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bca61bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+18:8441:x1875336022217856:12345-0@lo:503: 00000100:00100000:0.0:1788459912.931770:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bca61bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+18:8441:x1875336022217856:12345-0@lo:503: Request processed in 94us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459912.931786:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788459912.931861:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:8441:1875336022217856:0@lo:503: 00000040:00080000:1.0:1788459912.932297:0:8441:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788459912.932361:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:8441:1875336022217984:0@lo:502: 00000100:00100000:1.0:1788459912.932400:0:8441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459912.932475:0:8441:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bd0b853c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788459912.932806:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022217984 00000100:00100000:2.0:1788459912.932812:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022217984 00000100:00100000:3.0:1788459912.932878:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788459912.932887:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bca61a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+18:8441:x1875336022217984:12345-0@lo:502: 00000100:00100000:3.0:1788459912.933011:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bca61a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+18:8441:x1875336022217984:12345-0@lo:502: Request processed in 124us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459912.933217:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788459912.933313:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:8441:1875336022217984:0@lo:502: 00000040:00080000:1.0:1788459912.933499:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1788459912.933527:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1788459912.933559:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1788459912.933576:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1788459912.933604:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1788459912.933616:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1788459912.933628:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1788459912.933657:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1788459912.933674:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1788459912.933688:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1788459912.933703:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1788459912.933717:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1788459912.933730:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1788459912.933742:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1788459912.933755:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1788459912.933768:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1788459912.933781:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1788459912.933792:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1788459912.933803:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1788459912.933816:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1788459912.933830:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1788459912.933842:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1788459912.933856:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1788459912.933885:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1788459912.933902:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1788459912.933915:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1788459912.933928:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1788459912.933940:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:1.0:1788459912.934012:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:1.0:1788459912.934231:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:1.0:1788459912.934258:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:1.0:1788459912.934273:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:1.0:1788459912.934286:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:1.0:1788459912.934299:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:1.0:1788459912.934312:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:1.0:1788459912.934327:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:1.0:1788459912.934339:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:1.0:1788459912.934376:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:8441:1875336022218112:0@lo:502: 00000100:00100000:1.0:1788459912.934440:0:8441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459912.934922:0:8441:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bd0b853c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788459912.935040:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022218112 00000100:00100000:0.0:1788459912.935046:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022218112 00000100:00100000:1.0:1788459912.935241:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788459912.935249:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+18:8441:x1875336022218112:12345-0@lo:502: 00000100:00100000:1.0:1788459912.935385:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+18:8441:x1875336022218112:12345-0@lo:502: Request processed in 136us (944us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459912.935393:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788459912.935496:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:8441:1875336022218112:0@lo:502: 00000040:00080000:0.0:1788459912.935629:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:0.0:1788459912.935640:0:8441:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1788459912.936396:0:8469:0:(obd_mount.c:308:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788459912.936411:0:8469:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8c4ac1ef3310) 00000020:00000080:1.0:1788459912.936433:0:8469:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1788459912.936523:0:8469:0:(tgt_mount.c:167:server_get_mount()) get mount ffff8c4bef21b800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788459912.936527:0:8469:0:(tgt_mount.c:201:server_put_mount()) put mount ffff8c4bef21b800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788459912.936530:0:8469:0:(obd_mount.c:798:lustre_put_lsi()) put ffff8c4bef21b800 3 00010000:00080000:1.0:1788459912.936632:0:8469:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c4bfc4c2000@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.105@tcp at head 00010000:00010000:1.0:1788459912.941386:0:8469:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:1.0:1788459912.941738:0:8469:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788459912.941781:0:8469:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788459912.941794:0:8469:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x5dfa74784542ab88 00000100:00080000:1.0:1788459912.941804:0:8469:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788459912.941809:0:8469:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8c4bfc4c2000 using connection 192.168.206.105@tcp/0@lo 00000100:00100000:1.0:1788459912.941844:0:8469:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4bf75e2d80 x1875336022218240/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788459912.941911:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1875336022218240:0@lo:38: 00000100:00100000:2.0:1788459912.941995:0:3658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788459912.942298:0:8469:0:(pinger.c:380:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788459912.944162:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022218240 00000100:00100000:0.0:1788459912.944174:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022218240 00000100:00100000:0.0:1788459912.944214:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788459912.944221:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc4395880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3658:x1875336022218240:12345-0@lo:38: 00010000:00080000:0.0:1788459912.944246:0:6535:0:(ldlm_lib.c:1461:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 210 last 0 00000020:00000080:0.0:1788459912.944275:0:6535:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x5dfa74784542ab8f 00000004:00100000:0.0:1788459912.944288:0:6535:0:(mdt_handler.c:7310:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788459912.944319:0:6535:0:(import.c:65:import_set_state_nolock()) ffff8c4bef375000 : changing import state from RECOVER to FULL 00000020:01000004:1.0:1788459912.947336:0:8469:0:(obd_mount.c:308:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788459912.947353:0:8469:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8c4ac1ef0000) 00000020:00000080:1.0:1788459912.947373:0:8469:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:1.0:1788459912.947457:0:8469:0:(tgt_mount.c:167:server_get_mount()) get mount ffff8c4bef21b800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788459912.947461:0:8469:0:(tgt_mount.c:201:server_put_mount()) put mount ffff8c4bef21b800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788459912.947464:0:8469:0:(obd_mount.c:798:lustre_put_lsi()) put ffff8c4bef21b800 3 00010000:00080000:1.0:1788459912.947501:0:8469:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c4bfc4c5000@lustre-MDT0001-lwp-OST0000: add connection 192.168.206.105@tcp at head 00000100:00100000:0.0:1788459912.948836:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc4395880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1875336022218240:12345-0@lo:38: Request processed in 4609us (6835us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459912.948848:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788459912.948996:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4719500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022218752:0@lo:400: 00000100:00100000:0.0:1788459912.949062:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459912.949088:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788459912.949094:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc471a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875336022218368:0@lo:400: 00000100:00100000:0.0:1788459912.949117:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459912.949273:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc471a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022218496:0@lo:400: 00000100:00100000:0.0:1788459912.949298:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459912.949317:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788459912.949323:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc471ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1875336022218624:0@lo:400: 00000100:00100000:0.0:1788459912.949355:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459912.949389:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022218752 00000100:00100000:0.0:1788459912.949395:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022218752 00000100:00100000:0.0:1788459912.949420:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022218496 00000100:00100000:0.0:1788459912.949423:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022218496 00000100:00100000:0.0:1788459912.949438:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788459912.949445:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc4719f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1875336022218752:12345-0@lo:400: 00000100:00100000:0.0:1788459912.949495:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc4719f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1875336022218752:12345-0@lo:400: Request processed in 51us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459912.949502:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788459912.949516:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788459912.949522:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc471b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022218496:12345-0@lo:400: 00000100:00100000:0.0:1788459912.949642:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc471b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022218496:12345-0@lo:400: Request processed in 119us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459912.949649:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788459912.949669:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022218368 00000100:00100000:0.0:1788459912.949672:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022218368 00000100:00100000:0.0:1788459912.949692:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022218624 00000100:00100000:0.0:1788459912.949695:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022218624 00000100:00100000:0.0:1788459912.949708:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788459912.949714:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc4718380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1875336022218368:12345-0@lo:400: 00000100:00100000:0.0:1788459912.949745:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc4718380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1875336022218368:12345-0@lo:400: Request processed in 30us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459912.949751:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788459912.949762:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788459912.949767:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc4718700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1875336022218624:12345-0@lo:400: 00000100:00100000:0.0:1788459912.949792:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc4718700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1875336022218624:12345-0@lo:400: Request processed in 25us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459912.949807:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1788459912.949850:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c4bc471ad80 x1875336022218624/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788459928 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788459912.949863:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc471ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1875336022218624:0@lo:400: 00000100:00100000:0.0:1788459912.949873:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc471a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022218496:0@lo:400: 00010000:00080000:0.0:1788459912.949898:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c4bc471a300 x1875336022218368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788459928 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788459912.949905:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc471a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875336022218368:0@lo:400: 00000100:00100000:0.0:1788459912.949914:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4719500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022218752:0@lo:400: 00010000:00010000:1.0:1788459912.953981:0:8469:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:1.0:1788459912.956000:0:8469:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1788459912.956191:0:8469:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788459912.956204:0:8469:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x5dfa74784542ab9d 00000100:00080000:1.0:1788459912.956214:0:8469:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788459912.956219:0:8469:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8c4bfc4c5000 using connection 192.168.206.105@tcp/0@lo 00000100:00100000:1.0:1788459912.956253:0:8469:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4bf75e2300 x1875336022218880/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788459912.956268:0:8469:0:(pinger.c:380:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00010000:00080000:2.0:1788459912.957290:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c4bf75e2d80 x1875336022218240/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788459922 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788459912.957302:0:3658:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788459912.957311:0:3658:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1788459912.957319:0:3658:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788459912.957324:0:3658:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788459912.957326:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c4bfc4c2000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788459912.957333:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1875336022218240:0@lo:38: 00000100:00100000:2.0:1788459912.957359:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3658:1875336022218880:0@lo:38: 00000100:00100000:2.0:1788459912.957417:0:3658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459912.959279:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022218880 00000100:00100000:1.0:1788459912.959291:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022218880 00000100:00100000:1.0:1788459912.959331:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788459912.959338:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc4395500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3658:x1875336022218880:12345-0@lo:38: 00010000:00080000:1.0:1788459912.959365:0:7760:0:(ldlm_lib.c:1461:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 210 last 0 00000020:00000080:1.0:1788459912.959418:0:7760:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x5dfa74784542aba4 00000004:00100000:1.0:1788459912.959433:0:7760:0:(mdt_handler.c:7310:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788459912.959464:0:7760:0:(import.c:65:import_set_state_nolock()) ffff8c4bfc4c3800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788459912.959540:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc4395500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1875336022218880:12345-0@lo:38: Request processed in 201us (2122us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459912.959553:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788459912.959620:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c4bf75e2300 x1875336022218880/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788459922 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788459912.959631:0:3658:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788459912.959639:0:3658:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1788459912.959645:0:3658:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788459912.959649:0:3658:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788459912.959651:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c4bfc4c5000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788459912.959656:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3658:1875336022218880:0@lo:38: 00000040:00080000:1.0:1788459912.959752:0:8469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:0.0:1788459912.961517:0:8441:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1788459912.961536:0:8441:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788459912.961553:0:8441:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7a00/0x5dfa74784542ab73 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ab7a expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459912.961565:0:8441:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7a00/0x5dfa74784542ab73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ab7a expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788459912.961656:0:8441:0:(tgt_mount.c:1239:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788459912.961658:0:8441:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788459912.961659:0:8441:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788459912.961661:0:8441:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:0.0:1788459912.961662:0:8441:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:0.0:1788459912.961663:0:8441:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:0.0:1788459912.961664:0:8441:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788459912.961666:0:8441:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788459912.961667:0:8441:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788459912.961668:0:8441:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788459912.961670:0:8441:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788459912.961677:0:8441:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1788459912.961679:0:8441:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788459912.961680:0:8441:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788459912.961681:0:8441:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788459912.961682:0:8441:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:0.0:1788459912.961683:0:8441:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:0.0:1788459912.961684:0:8441:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:0.0:1788459912.961685:0:8441:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788459912.961686:0:8441:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788459912.961687:0:8441:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788459912.961688:0:8441:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788459912.961689:0:8441:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788459912.961712:0:8441:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788459912.961729:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4719500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:8441:1875336022219008:0@lo:253: 00000100:00100000:0.0:1788459912.961791:0:8441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459912.961827:0:8441:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc2ab39c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788459912.962002:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022219008 00000100:00100000:0.0:1788459912.962009:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022219008 00000100:00100000:0.0:1788459912.962060:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788459912.962067:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+18:8441:x1875336022219008:12345-0@lo:253: 20000000:01000000:0.0:1788459912.962090:0:6526:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788459912.962101:0:6526:0:(mgs_nids.c:475:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788459912.971437:0:6526:0:(mgs_nids.c:842:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788459912.971457:0:6526:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1788459912.971638:0:6549:0:(mgs_nids.c:739:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788459912.971643:0:6549:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788459912.971664:0:6549:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c4bc29d2400/0x5dfa74784542abab lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459912.971682:0:6549:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4bc14f1e00/0x5dfa74784542aa93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542aa8c expref: 18 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459912.971690:0:6549:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4bc29d3400/0x5dfa74784542aaaf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542aaa8 expref: 18 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459912.971697:0:6549:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4bc14f0200/0x5dfa74784542ab5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542ab57 expref: 18 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459912.971715:0:6549:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c4bc29d2400/0x5dfa74784542abab lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459912.971751:0:6549:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4bc14f0200/0x5dfa74784542ab5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5dfa74784542ab57 expref: 18 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459912.971765:0:6549:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c4bc14f0200/0x5dfa74784542ab5e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5dfa74784542ab57 expref: 18 pid: 6528 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788459912.971779:0:6549:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf2fe9500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6549:1875336022219136:0@lo:104: 00000100:00100000:3.0:1788459912.971839:0:6549:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788459912.971896:0:6549:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4bc29d3400/0x5dfa74784542aaaf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5dfa74784542aaa8 expref: 18 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459912.971904:0:6549:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c4bc29d3400/0x5dfa74784542aaaf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5dfa74784542aaa8 expref: 18 pid: 6528 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788459912.971911:0:6549:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf2fe9880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6549:1875336022219264:0@lo:104: 00010000:00010000:3.0:1788459912.971935:0:6549:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4bc14f1e00/0x5dfa74784542aa93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5dfa74784542aa8c expref: 18 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459912.971968:0:6549:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c4bc14f1e00/0x5dfa74784542aa93 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5dfa74784542aa8c expref: 18 pid: 6525 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788459912.971977:0:6549:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf2fe8380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6549:1875336022219392:0@lo:104: 00000100:00100000:3.0:1788459912.971995:0:6549:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac25b3180 going to sleep for 11 seconds 00000100:00100000:2.0:1788459912.972258:0:6516:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788459912.972277:0:6516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459912.972305:0:6516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459912.972316:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022219136 00000100:00100000:2.0:1788459912.972322:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022219136 00000100:00100000:2.0:1788459912.972360:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022219264 00000100:00100000:2.0:1788459912.972363:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022219264 00000100:00100000:2.0:1788459912.972372:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022219392 00000100:00100000:2.0:1788459912.972374:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022219392 00000100:00100000:2.0:1788459912.972385:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788459912.972391:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf7622c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0cf73fe6-82e2-434e-b670-631647721b2c+5:6549:x1875336022219136:12345-0@lo:104: 00010000:00010000:2.0:1788459912.972404:0:6516:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0800/0x5dfa74784542ab57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542ab5e expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459912.972455:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788459912.972461:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf7622c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0cf73fe6-82e2-434e-b670-631647721b2c+5:6549:x1875336022219136:12345-0@lo:104: Request processed in 71us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459912.972468:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788459912.972499:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788459912.972505:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc4396d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0cf73fe6-82e2-434e-b670-631647721b2c+4:6549:x1875336022219264:12345-0@lo:104: 00010000:00010000:2.0:1788459912.972513:0:6516:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0400/0x5dfa74784542aaa8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542aaaf expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459912.972556:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788459912.972561:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc4396d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0cf73fe6-82e2-434e-b670-631647721b2c+4:6549:x1875336022219264:12345-0@lo:104: Request processed in 57us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459912.972567:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788459912.972589:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788459912.972596:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc4397480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0cf73fe6-82e2-434e-b670-631647721b2c+3:6549:x1875336022219392:12345-0@lo:104: 00010000:00010000:2.0:1788459912.972604:0:6516:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0c00/0x5dfa74784542aa8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542aa93 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459912.972629:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788459912.972639:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc4397480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0cf73fe6-82e2-434e-b670-631647721b2c+3:6549:x1875336022219392:12345-0@lo:104: Request processed in 44us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459912.972645:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:2.0:1788459912.972661:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788459912.972666:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0800/0x5dfa74784542ab57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542ab5e expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459912.972672:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc29d0800 already unused, calling callback (ffffffffc125ae00) 10000000:00010000:2.0:1788459912.972676:0:6522:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0800/0x5dfa74784542ab57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5dfa74784542ab5e expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459912.972683:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0800/0x5dfa74784542ab57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5dfa74784542ab5e expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788459912.972689:0:6522:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0800/0x5dfa74784542ab57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5dfa74784542ab5e expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788459912.972694:0:6522:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788459912.972722:0:6522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0800/0x5dfa74784542ab57 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542ab5e expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459912.972729:0:6522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788459912.972746:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0800/0x5dfa74784542ab57 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542ab5e expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459912.972752:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0800/0x5dfa74784542ab57 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542ab5e expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459912.972764:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788459912.972767:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0400/0x5dfa74784542aaa8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542aaaf expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459912.972792:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc14f0400 already unused, calling callback (ffffffffc125ae00) 10000000:00010000:2.0:1788459912.972795:0:6522:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0400/0x5dfa74784542aaa8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5dfa74784542aaaf expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459912.972801:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0400/0x5dfa74784542aaa8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5dfa74784542aaaf expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788459912.972806:0:6522:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0400/0x5dfa74784542aaa8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5dfa74784542aaaf expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788459912.972811:0:6522:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788459912.972827:0:6522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0400/0x5dfa74784542aaa8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542aaaf expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459912.972833:0:6522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788459912.972846:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0400/0x5dfa74784542aaa8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542aaaf expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459912.972852:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0400/0x5dfa74784542aaa8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542aaaf expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459912.972861:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788459912.972864:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0c00/0x5dfa74784542aa8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542aa93 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459912.973011:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc29d0c00 already unused, calling callback (ffffffffc125ae00) 10000000:00010000:2.0:1788459912.973088:0:6522:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0c00/0x5dfa74784542aa8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5dfa74784542aa93 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459912.973107:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0c00/0x5dfa74784542aa8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5dfa74784542aa93 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788459912.973114:0:6522:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0c00/0x5dfa74784542aa8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5dfa74784542aa93 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788459912.973119:0:6522:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788459912.973199:0:6522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0c00/0x5dfa74784542aa8c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542aa93 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459912.973206:0:6522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788459912.973212:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0c00/0x5dfa74784542aa8c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542aa93 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459912.973218:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0c00/0x5dfa74784542aa8c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542aa93 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459912.973232:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788459912.973233:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788459912.973235:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788459912.973243:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788459912.973258:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788459912.973270:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4394a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0cf73fe6-82e2-434e-b670-631647721b2c:3661:1875336022219520:0@lo:103: 00000100:00100000:2.0:1788459912.973304:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459912.973334:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4397800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0cf73fe6-82e2-434e-b670-631647721b2c:3660:1875336022219776:0@lo:103: 00000100:00100000:2.0:1788459912.973355:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459912.973374:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788459912.973379:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4394380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0cf73fe6-82e2-434e-b670-631647721b2c:3660:1875336022219648:0@lo:103: 00000100:00100000:2.0:1788459912.973408:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459912.973438:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022219520 00000100:00100000:2.0:1788459912.973443:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022219520 00010000:00010000:2.0:1788459912.973463:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4bc14f0200/0x5dfa74784542ab5e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542ab57 expref: 19 pid: 6528 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788459912.973479:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022219776 00000100:00100000:2.0:1788459912.973482:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022219776 00010000:00010000:2.0:1788459912.973492:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4bc14f1e00/0x5dfa74784542aa93 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542aa8c expref: 20 pid: 6525 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788459912.973502:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022219648 00000100:00100000:2.0:1788459912.973504:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022219648 00010000:00010000:2.0:1788459912.973514:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4bc29d3400/0x5dfa74784542aaaf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542aaa8 expref: 21 pid: 6528 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788459912.973525:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788459912.973531:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc4395c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0cf73fe6-82e2-434e-b670-631647721b2c+21:3661:x1875336022219520:12345-0@lo:103: 00010000:00010000:2.0:1788459912.973619:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788459912.973625:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4bc14f0200/0x5dfa74784542ab5e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542ab57 expref: 21 pid: 6528 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459912.973633:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4bc14f0200/0x5dfa74784542ab5e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5dfa74784542ab57 expref: 21 pid: 6528 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459912.973647:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788459912.973676:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc4395c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0cf73fe6-82e2-434e-b670-631647721b2c+21:3661:x1875336022219520:12345-0@lo:103: Request processed in 145us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459912.973683:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788459912.973697:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788459912.973703:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc4395180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0cf73fe6-82e2-434e-b670-631647721b2c+20:3660:x1875336022219776:12345-0@lo:103: 00010000:00010000:2.0:1788459912.973718:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788459912.973723:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4bc14f1e00/0x5dfa74784542aa93 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542aa8c expref: 20 pid: 6525 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459912.973731:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4bc14f1e00/0x5dfa74784542aa93 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5dfa74784542aa8c expref: 20 pid: 6525 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459912.973740:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788459912.973767:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc4395180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0cf73fe6-82e2-434e-b670-631647721b2c+20:3660:x1875336022219776:12345-0@lo:103: Request processed in 64us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459912.973773:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788459912.973786:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788459912.973792:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc4396300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0cf73fe6-82e2-434e-b670-631647721b2c+19:3660:x1875336022219648:12345-0@lo:103: 00010000:00010000:2.0:1788459912.973799:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788459912.973803:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4bc29d3400/0x5dfa74784542aaaf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542aaa8 expref: 19 pid: 6528 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459912.973812:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4bc29d3400/0x5dfa74784542aaaf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5dfa74784542aaa8 expref: 19 pid: 6528 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459912.973823:0:6519:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c4bc29d2400/0x5dfa74784542abab lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459912.973831:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bc29d2400/0x5dfa74784542abab lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788459912.973844:0:6519:0:(mgs_nids.c:715:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.010918397s 00010000:00010000:2.0:1788459912.973848:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c4bc29d2400/0x5dfa74784542abab lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459912.974230:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c4bc29d2400/0x5dfa74784542abab lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459912.974240:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c4bc29d2400/0x5dfa74784542abab lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459912.974246:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c4bc29d2400/0x5dfa74784542abab lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459912.974252:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc29d2400 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:2.0:1788459912.974255:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c4bc29d2400/0x5dfa74784542abab lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459912.974262:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c4bc29d2400/0x5dfa74784542abab lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459912.974270:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c4bc29d2400/0x5dfa74784542abab lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459912.974281:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788459912.974311:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc4396300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0cf73fe6-82e2-434e-b670-631647721b2c+19:3660:x1875336022219648:12345-0@lo:103: Request processed in 518us (901us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459912.974317:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788459912.974358:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4394a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0cf73fe6-82e2-434e-b670-631647721b2c:3661:1875336022219520:0@lo:103: 00000100:00100000:2.0:1788459912.974382:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4394380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0cf73fe6-82e2-434e-b670-631647721b2c:3660:1875336022219648:0@lo:103: 00000100:00100000:2.0:1788459912.974389:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4397800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0cf73fe6-82e2-434e-b670-631647721b2c:3660:1875336022219776:0@lo:103: 00010000:00010000:2.0:1788459912.974413:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4bc14f0200/0x5dfa74784542ab5e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5dfa74784542ab57 expref: 18 pid: 6528 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788459912.974436:0:6549:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf2fe9500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6549:1875336022219136:0@lo:104: 00010000:00010000:2.0:1788459912.974449:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4bc29d3400/0x5dfa74784542aaaf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5dfa74784542aaa8 expref: 17 pid: 6528 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788459912.974457:0:6549:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf2fe9880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6549:1875336022219264:0@lo:104: 00010000:00010000:2.0:1788459912.974473:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4bc14f1e00/0x5dfa74784542aa93 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5dfa74784542aa8c expref: 16 pid: 6525 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788459912.974481:0:6549:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf2fe8380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6549:1875336022219392:0@lo:104: 00010000:00010000:2.0:1788459912.974495:0:6549:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c4bc29d2400/0x5dfa74784542abab lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459912.974503:0:6549:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c4bc29d2400/0x5dfa74784542abab lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459912.974510:0:6549:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c4bc29d2400/0x5dfa74784542abab lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459912.974516:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4bc29d2400/0x5dfa74784542abab lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788459912.974699:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+15:8441:x1875336022219008:12345-0@lo:253: Request processed in 12631us (12907us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459912.974716:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788459912.974803:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4719500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:8441:1875336022219008:0@lo:253: 10000000:01000000:0.0:1788459912.974814:0:8441:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788459912.974817:0:8441:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788459912.974818:0:8441:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788459912.974819:0:8441:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788459912.974820:0:8441:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:0.0:1788459912.974822:0:8441:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:0.0:1788459912.974823:0:8441:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:0.0:1788459912.974824:0:8441:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788459912.974826:0:8441:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788459912.974827:0:8441:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788459912.974829:0:8441:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788459912.974830:0:8441:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788459912.974846:0:8441:0:(tgt_mount.c:2880:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:2.0:1788459912.978779:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:0.0:1788459912.993333:0:8441:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:0.0:1788459912.994290:0:8441:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1788459912.995456:0:8441:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:0.0:1788459912.995796:0:8441:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1788459912.996445:0:8441:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1788459912.996902:0:8441:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:1.0:1788459912.998645:0:8441:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1788459913.012755:0:8441:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1788459913.012766:0:8441:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1788459913.012834:0:8441:0:(tgt_mount.c:2600:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788459913.012857:0:8441:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:1.0:1788459913.014372:0:8441:0:(tgt_mount.c:2486:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788459913.014570:0:8441:0:(tgt_mount.c:2501:is_cmd_supported()) ioctl cmd=41009432 00000020:00000004:1.0:1788459913.905686:0:8525:0:(tgt_mount.c:2486:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788459913.906314:0:8525:0:(tgt_mount.c:2501:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788459914.001196:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788459914.321142:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf2febb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022219904:0@lo:41: 00000100:00100000:0.0:1788459914.321215:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459914.321255:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022219904 00000100:00100000:3.0:1788459914.321262:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022219904 00000100:00100000:3.0:1788459914.321312:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788459914.321322:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc4719500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022219904:12345-0@lo:41: 00000004:00000024:3.0:1788459914.321354:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:3.0:1788459914.321400:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc4719500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022219904:12345-0@lo:41: Request processed in 80us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459914.321407:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788459914.321448:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf2febb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022219904:0@lo:41: 00010000:00010000:0.0:1788459915.028767:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788459915.346509:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788459915.346885:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc471a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022220032:0@lo:41: 00000100:00100000:3.0:1788459915.346967:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459915.347065:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022220032 00000100:00100000:1.0:1788459915.347071:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022220032 00000100:00100000:1.0:1788459915.347113:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788459915.347122:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf2febb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1875336022220032:12345-0@lo:41: 00000004:00000024:1.0:1788459915.347151:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446547456 avail 1300307968 00000100:00100000:1.0:1788459915.347197:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf2febb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1875336022220032:12345-0@lo:41: Request processed in 77us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459915.347203:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788459915.347328:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc471a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022220032:0@lo:41: 00010000:00010000:2.0:1788459916.049188:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788459917.073049:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788459918.099069:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788459918.420580:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf2feb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3660:1875336022220288:0@lo:400: 00000100:00100000:3.0:1788459918.420644:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459918.420694:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf2fe8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3660:1875336022220800:0@lo:400: 00000100:00100000:3.0:1788459918.420735:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459918.420765:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788459918.420772:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf2fe8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0cf73fe6-82e2-434e-b670-631647721b2c:3660:1875336022220160:0@lo:400: 00000100:00100000:3.0:1788459918.420800:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459918.420822:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf2feaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022220672:0@lo:400: 00000100:00100000:3.0:1788459918.420843:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459918.420869:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf2fe8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022220416:0@lo:400: 00000100:00100000:3.0:1788459918.420898:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459918.420915:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf2fe9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1875336022220928:0@lo:400: 00000100:00100000:3.0:1788459918.420937:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459918.420977:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788459918.420996:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf2fe8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875336022220544:0@lo:400: 00000100:00100000:3.0:1788459918.421016:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459918.421043:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022220160 00000100:00100000:3.0:1788459918.421049:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022220160 00000100:00100000:3.0:1788459918.421087:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788459918.421095:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+15:3660:x1875336022220160:12345-0@lo:400: 00000100:00100000:3.0:1788459918.421142:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+15:3660:x1875336022220160:12345-0@lo:400: Request processed in 47us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459918.421149:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788459918.421373:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022220672 00000100:00100000:3.0:1788459918.421378:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022220672 00000100:00100000:3.0:1788459918.421397:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022220416 00000100:00100000:3.0:1788459918.421400:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022220416 00000100:00100000:3.0:1788459918.421412:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788459918.421418:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfaea9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022220672:12345-0@lo:400: 00000100:00100000:3.0:1788459918.421451:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfaea9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022220672:12345-0@lo:400: Request processed in 34us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459918.421457:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788459918.421466:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788459918.421472:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfaea8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022220416:12345-0@lo:400: 00000100:00100000:3.0:1788459918.421502:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfaea8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022220416:12345-0@lo:400: Request processed in 31us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459918.421508:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788459918.421534:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022220288 00000100:00100000:3.0:1788459918.421538:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022220288 00000100:00100000:3.0:1788459918.421566:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022220800 00000100:00100000:3.0:1788459918.421569:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022220800 00000100:00100000:3.0:1788459918.421597:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022220928 00000100:00100000:3.0:1788459918.421600:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022220928 00000100:00100000:3.0:1788459918.421612:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022220544 00000100:00100000:3.0:1788459918.421615:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022220544 00000100:00100000:3.0:1788459918.421628:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788459918.421633:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf2fe9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1875336022220288:12345-0@lo:400: 00000100:00100000:3.0:1788459918.421663:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf2fe9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1875336022220288:12345-0@lo:400: Request processed in 30us (1020us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459918.421669:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788459918.421680:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788459918.421686:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfaeab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1875336022220800:12345-0@lo:400: 00000100:00100000:3.0:1788459918.421710:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfaeab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1875336022220800:12345-0@lo:400: Request processed in 25us (976us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459918.421716:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788459918.421727:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788459918.421733:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfaeaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1875336022220928:12345-0@lo:400: 00000100:00100000:3.0:1788459918.421757:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfaeaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1875336022220928:12345-0@lo:400: Request processed in 24us (819us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459918.421762:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788459918.421773:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788459918.421778:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfaea8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1875336022220544:12345-0@lo:400: 00000100:00100000:3.0:1788459918.421802:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfaea8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1875336022220544:12345-0@lo:400: Request processed in 24us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459918.421808:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1788459918.421855:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4bf2fe8700 x1875336022220544/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788459934 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788459918.421869:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf2fe8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875336022220544:0@lo:400: 00000100:00100000:3.0:1788459918.421879:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf2fe8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022220416:0@lo:400: 00010000:00080000:3.0:1788459918.421888:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4bf2fe9880 x1875336022220928/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788459934 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788459918.421896:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf2fe9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1875336022220928:0@lo:400: 00000100:00100000:3.0:1788459918.421929:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf2fe8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0cf73fe6-82e2-434e-b670-631647721b2c:3660:1875336022220160:0@lo:400: 00000100:00100000:3.0:1788459918.421939:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf2feaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022220672:0@lo:400: 00010000:00080000:3.0:1788459918.421969:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4bf2feb100 x1875336022220288/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788459934 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788459918.422106:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788459918.422111:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788459918.424103:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf2feb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3660:1875336022220288:0@lo:400: 00010000:00080000:3.0:1788459918.424143:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4bf2fe8380 x1875336022220800/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788459934 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788459918.424155:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf2fe8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3660:1875336022220800:0@lo:400: 00000001:02000400:2.0:1788459918.865559:0:8815:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:2.0:1788459918.930014:0:6530:0:(mgc_request.c:715:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788459918.930021:0:6530:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-mdtir-ffff8c4bef21b800 from 5 10000000:01000000:2.0:1788459918.930026:0:6530:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788459918.930080:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7c00/0x5dfa74784542abb2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459918.930090:0:6530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7c00/0x5dfa74784542abb2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459918.930100:0:6530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7c00/0x5dfa74784542abb2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788459918.930120:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4397800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022221056:0@lo:101: 00000100:00100000:2.0:1788459918.930179:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459918.930221:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bf77a09c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788459918.930299:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022221056 00000100:00100000:3.0:1788459918.930315:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022221056 00000100:00100000:3.0:1788459918.930360:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788459918.930369:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+15:6530:x1875336022221056:12345-0@lo:101: 00010000:00010000:3.0:1788459918.930380:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788459918.930392:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4bc29d2a00/0x5dfa74784542abb9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542abb2 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459918.930413:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bc29d2a00/0x5dfa74784542abb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542abb2 expref: 16 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459918.930431:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4bc29d2a00/0x5dfa74784542abb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542abb2 expref: 16 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459918.930439:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc29d2a00, rc 0) 00000100:00100000:3.0:1788459918.930486:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+16:6530:x1875336022221056:12345-0@lo:101: Request processed in 118us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459918.930493:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788459918.930630:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4397800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022221056:0@lo:101: 00010000:00010000:2.0:1788459918.930643:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7c00/0x5dfa74784542abb2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542abb9 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459918.930651:0:6530:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7c00/0x5dfa74784542abb2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542abb9 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788459918.930696:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4397800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022221184:0@lo:256: 00000100:00100000:2.0:1788459918.930726:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459918.930763:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bf77a09c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788459918.930814:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022221184 00000100:00100000:1.0:1788459918.930818:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022221184 00000100:00100000:1.0:1788459918.930860:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788459918.930868:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+16:6530:x1875336022221184:12345-0@lo:256: 20000000:01000000:1.0:1788459918.930881:0:6528:0:(mgs_nids.c:1209:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788459918.930895:0:6528:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788459918.930898:0:6528:0:(mgs_nids.c:325:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1788459918.931012:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+16:6530:x1875336022221184:12345-0@lo:256: Request processed in 145us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459918.931018:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788459918.931319:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4397800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022221184:0@lo:256: 10000000:01000000:2.0:1788459918.931351:0:6530:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788459918.931358:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7c00/0x5dfa74784542abb2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542abb9 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459918.931366:0:6530:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7c00/0x5dfa74784542abb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542abb9 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788459918.931386:0:6530:0:(mgc_request.c:715:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788459918.931387:0:6530:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-client-ffff8c4bc438f000 from 30 10000000:01000000:2.0:1788459918.931390:0:6530:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788459918.931407:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7000/0x5dfa74784542abc0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459918.931414:0:6530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7000/0x5dfa74784542abc0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459918.931422:0:6530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7000/0x5dfa74784542abc0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788459918.931434:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4397800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022221312:0@lo:101: 00000100:00100000:2.0:1788459918.931460:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459918.931472:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bf77a09c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788459918.931808:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022221312 00000100:00100000:0.0:1788459918.931814:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022221312 00000100:00100000:0.0:1788459918.931867:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788459918.931875:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+16:6530:x1875336022221312:12345-0@lo:101: 00010000:00010000:0.0:1788459918.931884:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788459918.931897:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4bef209800/0x5dfa74784542abc7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542abc0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459918.931914:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bef209800/0x5dfa74784542abc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542abc0 expref: 17 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459918.931923:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4bef209800/0x5dfa74784542abc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542abc0 expref: 17 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459918.931940:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bef209800, rc 0) 00000100:00100000:0.0:1788459918.931989:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+17:6530:x1875336022221312:12345-0@lo:101: Request processed in 115us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459918.931994:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788459918.932187:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4397800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022221312:0@lo:101: 00010000:00010000:2.0:1788459918.932200:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7000/0x5dfa74784542abc0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542abc7 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459918.932207:0:6530:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7000/0x5dfa74784542abc0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542abc7 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788459918.932345:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1788459918.932618:0:6530:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788459918.932770:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1788459918.932793:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1788459918.932805:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1788459918.932815:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1788459918.932826:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1788459918.932843:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1788459918.932870:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1788459918.932884:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1788459918.932896:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1788459918.932910:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1788459918.932924:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1788459918.932936:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1788459918.932974:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1788459918.932988:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1788459918.932999:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1788459918.933012:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1788459918.933026:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1788459918.933039:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1788459918.933050:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1788459918.933060:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1788459918.933070:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1788459918.933080:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1788459918.933091:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1788459918.933102:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1788459918.933112:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:2.0:1788459918.933123:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:2.0:1788459918.933134:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:2.0:1788459918.933144:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:2.0:1788459918.933159:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:2.0:1788459918.933162:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1788459918.933213:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4397800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022221440:0@lo:501: 00000100:00100000:2.0:1788459918.933248:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459918.933282:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bf77a09c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788459918.933978:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022221440 00000100:00100000:1.0:1788459918.933987:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022221440 00000100:00100000:1.0:1788459918.934024:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788459918.934031:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+17:6530:x1875336022221440:12345-0@lo:501: 00000100:00100000:1.0:1788459918.934135:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+17:6530:x1875336022221440:12345-0@lo:501: Request processed in 104us (886us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459918.934142:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788459918.934866:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4397800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022221440:0@lo:501: 00000100:00100000:2.0:1788459918.934909:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4397800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022221568:0@lo:503: 00000100:00100000:2.0:1788459918.934985:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459918.935018:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bf77a09c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788459918.935143:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022221568 00000100:00100000:1.0:1788459918.935149:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022221568 00000100:00100000:1.0:1788459918.935176:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788459918.935182:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+17:6530:x1875336022221568:12345-0@lo:503: 00000100:00100000:1.0:1788459918.935261:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+17:6530:x1875336022221568:12345-0@lo:503: Request processed in 78us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459918.935267:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788459918.935386:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4397800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022221568:0@lo:503: 00000040:00080000:2.0:1788459918.935913:0:6530:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788459918.936084:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4397800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022221696:0@lo:502: 00000100:00100000:2.0:1788459918.936122:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459918.936183:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bf77a09c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788459918.940828:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022221696 00000100:00100000:3.0:1788459918.940839:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022221696 00000100:00100000:3.0:1788459918.941606:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788459918.941617:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+17:6530:x1875336022221696:12345-0@lo:502: 00000100:00100000:3.0:1788459918.941770:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+17:6530:x1875336022221696:12345-0@lo:502: Request processed in 154us (5647us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459918.941778:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788459918.941992:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4397800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022221696:0@lo:502: 00000040:00080000:2.0:1788459918.942184:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1788459918.942214:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1788459918.942228:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1788459918.942257:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1788459918.942272:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1788459918.942285:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1788459918.942297:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1788459918.942309:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1788459918.942322:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1788459918.942334:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1788459918.942346:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1788459918.942360:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1788459918.942372:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1788459918.942384:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1788459918.942397:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1788459918.942412:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1788459918.942424:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1788459918.942436:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1788459918.942448:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1788459918.942475:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1788459918.942491:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1788459918.942502:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1788459918.942513:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1788459918.942537:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1788459918.942564:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:2.0:1788459918.942579:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:2.0:1788459918.942594:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:2.0:1788459918.942607:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:2.0:1788459918.942620:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:2.0:1788459918.942633:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:2.0:1788459918.942646:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:2.0:1788459918.942659:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:2.0:1788459918.942671:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:2.0:1788459918.942683:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:2.0:1788459918.942696:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:2.0:1788459918.942726:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:2.0:1788459918.942739:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000100:00100000:2.0:1788459918.942783:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4397800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022221824:0@lo:502: 00000100:00100000:2.0:1788459918.942830:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459918.942985:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bf77a09c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788459918.947870:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022221824 00000100:00100000:1.0:1788459918.947885:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022221824 00000100:00100000:1.0:1788459918.948045:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788459918.948057:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+17:6530:x1875336022221824:12345-0@lo:502: 00000100:00100000:1.0:1788459918.948444:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+17:6530:x1875336022221824:12345-0@lo:502: Request processed in 389us (5611us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459918.948460:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788459918.948602:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4397800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022221824:0@lo:502: 00000040:00080000:3.0:1788459918.948683:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:3.0:1788459918.948695:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000040:00080000:0.0:1788459918.950594:0:8820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 39 count 39 00000020:01000000:3.0:1788459918.950723:0:6530:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1788459918.950733:0:6530:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788459918.950751:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7000/0x5dfa74784542abc0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542abc7 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459918.950762:0:6530:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7000/0x5dfa74784542abc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542abc7 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788459918.950771:0:6530:0:(mgc_request.c:715:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788459918.950773:0:6530:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-mdtir-ffff8c4bc438f000 from 5 10000000:01000000:3.0:1788459918.950781:0:6530:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788459918.950812:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2600/0x5dfa74784542abce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459918.950820:0:6530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2600/0x5dfa74784542abce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459918.950829:0:6530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2600/0x5dfa74784542abce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788459918.950972:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfaeaa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022221952:0@lo:101: 00000100:00100000:3.0:1788459918.951028:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459918.951062:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac25b6540 going to sleep for 11 seconds 00000100:00100000:1.0:1788459918.951156:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022221952 00000100:00100000:1.0:1788459918.951164:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022221952 00000100:00100000:1.0:1788459918.951210:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788459918.951219:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+17:6530:x1875336022221952:12345-0@lo:101: 00010000:00010000:1.0:1788459918.951231:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788459918.951243:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4bc29d1e00/0x5dfa74784542abd5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542abce expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459918.951265:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bc29d1e00/0x5dfa74784542abd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542abce expref: 18 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459918.951276:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4bc29d1e00/0x5dfa74784542abd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542abce expref: 18 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459918.951284:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc29d1e00, rc 0) 00000100:00100000:1.0:1788459918.951328:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+18:6530:x1875336022221952:12345-0@lo:101: Request processed in 110us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459918.951335:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788459918.951438:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfaeaa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022221952:0@lo:101: 00010000:00010000:0.0:1788459918.951451:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2600/0x5dfa74784542abce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542abd5 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459918.951460:0:6530:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2600/0x5dfa74784542abce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542abd5 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788459918.951506:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc471a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022222080:0@lo:256: 00000100:00100000:0.0:1788459918.951535:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459918.951567:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bf767e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788459918.951610:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022222080 00000100:00100000:1.0:1788459918.951614:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022222080 00000100:00100000:1.0:1788459918.951672:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788459918.951680:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+18:6530:x1875336022222080:12345-0@lo:256: 20000000:01000000:1.0:1788459918.951692:0:6525:0:(mgs_nids.c:1209:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788459918.951707:0:6525:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788459918.951710:0:6525:0:(mgs_nids.c:325:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1788459918.951798:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+18:6530:x1875336022222080:12345-0@lo:256: Request processed in 118us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459918.951812:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788459918.951871:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc471a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022222080:0@lo:256: 10000000:01000000:3.0:1788459918.951915:0:6530:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788459918.951921:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2600/0x5dfa74784542abce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542abd5 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459918.951929:0:6530:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2600/0x5dfa74784542abce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542abd5 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788459918.951939:0:6530:0:(mgc_request.c:715:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1788459918.951940:0:6530:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:3.0:1788459918.951960:0:6530:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788459918.951977:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2400/0x5dfa74784542abdc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459918.951985:0:6530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2400/0x5dfa74784542abdc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459918.952003:0:6530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2400/0x5dfa74784542abdc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788459918.952015:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfaeaa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022222208:0@lo:101: 00000100:00100000:3.0:1788459918.952040:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459918.955764:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022222208 00000100:00100000:0.0:1788459918.955778:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022222208 00000100:00100000:0.0:1788459918.955906:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788459918.955918:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+18:6530:x1875336022222208:12345-0@lo:101: 00010000:00010000:0.0:1788459918.955933:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788459918.956623:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4bef209400/0x5dfa74784542abe3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542abdc expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459918.956653:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bef209400/0x5dfa74784542abe3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542abdc expref: 19 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459918.956664:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4bef209400/0x5dfa74784542abe3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542abdc expref: 19 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459918.956681:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bef209400, rc 0) 00000100:00100000:0.0:1788459918.956733:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+19:6530:x1875336022222208:12345-0@lo:101: Request processed in 818us (4691us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459918.956740:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788459918.956963:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac25b63c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788459918.956987:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfaeaa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022222208:0@lo:101: 00010000:00010000:3.0:1788459918.957003:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2400/0x5dfa74784542abdc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542abe3 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459918.957012:0:6530:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2400/0x5dfa74784542abdc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542abe3 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788459918.957152:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:3.0:1788459918.957352:0:6530:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788459918.957518:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1788459918.957544:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 136 off8552 00000040:00080000:3.0:1788459918.957574:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 176 off8728 00000040:00080000:3.0:1788459918.957588:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8952 00000040:00080000:3.0:1788459918.957600:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9176 00000040:00080000:3.0:1788459918.957612:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9296 00000040:00080000:3.0:1788459918.957625:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 112 off9408 00000040:00080000:3.0:1788459918.957638:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 160 off9568 00000040:00080000:3.0:1788459918.957652:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9792 00000040:00080000:3.0:1788459918.957667:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off10016 00000040:00080000:3.0:1788459918.957683:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 88 off10104 00000040:00080000:3.0:1788459918.957695:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 144 off10248 00000040:00080000:3.0:1788459918.957705:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 152 off10400 00000040:00080000:3.0:1788459918.957717:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 168 off10568 00000040:00080000:3.0:1788459918.957739:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 224 off10792 00000040:00080000:3.0:1788459918.957827:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 224 off11016 00000040:00080000:3.0:1788459918.957841:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 80 off11096 00000040:00080000:3.0:1788459918.957922:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11320 00000040:00080000:3.0:1788459918.957937:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 224 off11544 00000040:00080000:3.0:1788459918.957970:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 160 off11704 00000040:00080000:3.0:1788459918.957986:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11928 00000040:00080000:3.0:1788459918.958001:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 224 off12152 00000040:00080000:3.0:1788459918.958015:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 80 off12232 00000040:00080000:3.0:1788459918.958034:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 224 off12456 00000040:00080000:3.0:1788459918.958038:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:3.0:1788459918.958098:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfaeaa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022222336:0@lo:501: 00000100:00100000:3.0:1788459918.958138:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459918.958174:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac25b63c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788459918.958223:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022222336 00000100:00100000:0.0:1788459918.958229:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022222336 00000100:00100000:0.0:1788459918.958304:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788459918.958313:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+19:6530:x1875336022222336:12345-0@lo:501: 00000100:00100000:0.0:1788459918.958417:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+19:6530:x1875336022222336:12345-0@lo:501: Request processed in 104us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459918.958425:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788459918.958482:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfaeaa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022222336:0@lo:501: 00000100:00100000:3.0:1788459918.958507:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfaeaa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022222464:0@lo:503: 00000100:00100000:3.0:1788459918.958543:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459918.958613:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac25b63c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788459918.958640:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022222464 00000100:00100000:1.0:1788459918.958644:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022222464 00000100:00100000:1.0:1788459918.958666:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788459918.958672:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+19:6530:x1875336022222464:12345-0@lo:503: 00000100:00100000:1.0:1788459918.958756:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+19:6530:x1875336022222464:12345-0@lo:503: Request processed in 83us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459918.958763:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788459918.959070:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfaeaa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022222464:0@lo:503: 00000040:00080000:3.0:1788459918.959379:0:6530:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788459918.959446:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfaeaa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022222592:0@lo:502: 00000100:00100000:3.0:1788459918.959485:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459918.959518:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac25b63c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788459918.959576:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022222592 00000100:00100000:1.0:1788459918.959581:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022222592 00000100:00100000:1.0:1788459918.959616:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788459918.959624:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+19:6530:x1875336022222592:12345-0@lo:502: 00000100:00100000:1.0:1788459918.959696:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+19:6530:x1875336022222592:12345-0@lo:502: Request processed in 73us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459918.959703:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788459918.959835:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfaeaa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022222592:0@lo:502: 00000040:00080000:3.0:1788459918.960070:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1788459918.960095:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 136 off8552 00000040:00080000:3.0:1788459918.960109:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 176 off8728 00000040:00080000:3.0:1788459918.960123:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8952 00000040:00080000:3.0:1788459918.960146:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9176 00000040:00080000:3.0:1788459918.960160:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9296 00000040:00080000:3.0:1788459918.960172:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 112 off9408 00000040:00080000:3.0:1788459918.960185:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 160 off9568 00000040:00080000:3.0:1788459918.960198:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9792 00000040:00080000:3.0:1788459918.960211:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off10016 00000040:00080000:3.0:1788459918.960224:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 88 off10104 00000040:00080000:3.0:1788459918.960238:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 144 off10248 00000040:00080000:3.0:1788459918.960253:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 152 off10400 00000040:00080000:3.0:1788459918.960265:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 168 off10568 00000040:00080000:3.0:1788459918.960278:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 224 off10792 00000040:00080000:3.0:1788459918.960305:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 224 off11016 00000040:00080000:3.0:1788459918.960320:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 80 off11096 00000040:00080000:3.0:1788459918.960334:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11320 00000040:00080000:3.0:1788459918.960348:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 224 off11544 00000040:00080000:3.0:1788459918.960362:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 160 off11704 00000040:00080000:3.0:1788459918.960375:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11928 00000040:00080000:3.0:1788459918.960387:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 224 off12152 00000040:00080000:3.0:1788459918.960400:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 80 off12232 00000040:00080000:3.0:1788459918.960412:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 224 off12456 00000040:00080000:3.0:1788459918.960424:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 224 off12680 00000040:00080000:3.0:1788459918.960435:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 88 off12768 00000040:00080000:3.0:1788459918.960448:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 144 off12912 00000040:00080000:3.0:1788459918.960461:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 152 off13064 00000040:00080000:3.0:1788459918.960475:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 136 off13200 00000040:00080000:3.0:1788459918.960487:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13424 00000040:00080000:3.0:1788459918.960498:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 224 off13648 00000040:00080000:3.0:1788459918.960523:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 80 off13728 00000100:00100000:3.0:1788459918.960561:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfaeaa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022222720:0@lo:502: 00000100:00100000:3.0:1788459918.960603:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459918.960627:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac25b63c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788459918.960691:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022222720 00000100:00100000:1.0:1788459918.960696:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022222720 00000100:00100000:1.0:1788459918.960733:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788459918.960741:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf363f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+19:6530:x1875336022222720:12345-0@lo:502: 00000100:00100000:1.0:1788459918.960884:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf363f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+19:6530:x1875336022222720:12345-0@lo:502: Request processed in 144us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459918.960892:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788459918.961053:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfaeaa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022222720:0@lo:502: 00000040:00080000:3.0:1788459918.961093:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 224 off13952 00000040:00080000:3.0:1788459918.961099:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 33 count 34 00000020:01000000:3.0:1788459918.961617:0:8822:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788459918.961624:0:8822:0:(obd_mount.c:1049:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1788459918.961630:0:8822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788459918.961632:0:8822:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788459918.961637:0:8822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788459918.961641:0:8822:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.105@tcp to nid 0x20000c0a8ce69 (192.168.206.105@tcp) 00000020:01000000:3.0:1788459918.961661:0:8822:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1788459918.961664:0:8822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788459918.961677:0:8822:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8c4bef213310) 00000020:00000080:3.0:1788459918.961697:0:8822:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:3.0:1788459918.961702:0:8822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788459918.961845:0:8822:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1788459918.961909:0:8822:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788459918.961917:0:8822:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5dfa74784542abf1 00010000:00080000:3.0:1788459918.962002:0:8822:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c4bef685000@lustre-OST0000-osc-MDT0001: add connection 192.168.206.105@tcp at head 00010000:00010000:3.0:1788459918.963178:0:8822:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:3.0:1788459918.969178:0:8822:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1788459918.969200:0:8822:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1788459918.969389:0:8822:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788459918.969590:0:8822:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788459918.969697:0:8822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1788459918.969797:0:8822:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1788459918.970188:0:8823:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788459918.970193:0:8823:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788459918.970821:0:8822:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788459918.970831:0:8822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788459918.970934:0:8822:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788459918.971030:0:8822:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5dfa74784542abf8 00000100:00080000:3.0:1788459918.971040:0:8822:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788459918.971052:0:8822:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8c4bef685000 using connection 192.168.206.105@tcp/0@lo 00000100:00100000:3.0:1788459918.971083:0:8822:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4bfaeaa300 x1875336022222848/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788459918.971139:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfaeaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1875336022222848:0@lo:8: 00000100:00100000:2.0:1788459918.971204:0:3658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788459918.971263:0:8822:0:(pinger.c:380:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788459918.971329:0:8822:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788459918.971334:0:8822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788459918.971336:0:8822:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788459918.971339:0:8822:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788459918.971343:0:8822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788459918.971344:0:8822:0:(obd_config.c:1563:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788459918.971347:0:8822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788459918.971349:0:8822:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788459918.971367:0:8822:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788459918.971369:0:8822:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788459918.971371:0:8822:0:(obd_config.c:1563:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788459918.971373:0:8822:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 34 count 34 00000100:00100000:0.0:1788459918.971540:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022222848 00000100:00100000:0.0:1788459918.971556:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022222848 00000100:00100000:0.0:1788459918.971586:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788459918.971593:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc4394380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3658:x1875336022222848:12345-0@lo:8: 00010000:00080000:0.0:1788459918.971616:0:8448:0:(ldlm_lib.c:1461:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 216 last 0 00000020:00000080:0.0:1788459918.971639:0:8448:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5dfa74784542abff 00002000:00100000:0.0:1788459918.971668:0:8448:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8c4bc4739800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a07 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1788459918.971672:0:8448:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:0.0:1788459918.971676:0:8448:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1788459918.971721:0:8448:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788459918.972059:0:8448:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:0.0:1788459918.972082:0:8448:0:(import.c:65:import_set_state_nolock()) ffff8c4bef373000 : changing import state from RECOVER to FULL 00000020:01000000:1.0:1788459918.972301:0:6530:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:1.0:1788459918.972316:0:6530:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1788459918.972326:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2400/0x5dfa74784542abdc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542abe3 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459918.972347:0:6530:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2400/0x5dfa74784542abdc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542abe3 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788459918.972358:0:6530:0:(mgc_request.c:715:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788459918.972360:0:6530:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-sptlrpc-ffff8c4bc438f000 from 1 10000000:01000000:1.0:1788459918.972362:0:6530:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788459918.972386:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0000/0x5dfa74784542ac06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459918.972395:0:6530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0000/0x5dfa74784542ac06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459918.972403:0:6530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0000/0x5dfa74784542ac06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788459918.972419:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022223744:0@lo:101: 00000100:00100000:1.0:1788459918.972455:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459918.972485:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022223744 00000100:00100000:1.0:1788459918.972489:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022223744 00000100:00100000:1.0:1788459918.972522:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788459918.972529:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf363d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+19:6530:x1875336022223744:12345-0@lo:101: 00010000:00010000:1.0:1788459918.972539:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788459918.972562:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4bc29d0200/0x5dfa74784542ac0d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542ac06 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459918.972582:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bc29d0200/0x5dfa74784542ac0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542ac06 expref: 20 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459918.972592:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4bc29d0200/0x5dfa74784542ac0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542ac06 expref: 20 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459918.972606:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc29d0200, rc 0) 00000100:00100000:1.0:1788459918.972631:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf363d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+20:6530:x1875336022223744:12345-0@lo:101: Request processed in 103us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459918.972638:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788459918.972675:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bd1c90780 going to sleep for 11 seconds 00000100:00100000:1.0:1788459918.972693:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022223744:0@lo:101: 00010000:00010000:1.0:1788459918.972706:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0000/0x5dfa74784542ac06 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ac0d expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459918.972714:0:6530:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0000/0x5dfa74784542ac06 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542ac0d expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788459918.972785:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022223872:0@lo:501: 00000100:00100000:1.0:1788459918.972810:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459918.972831:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022223872 00000100:00100000:1.0:1788459918.972834:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022223872 00000100:00100000:1.0:1788459918.973006:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788459918.973014:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf363cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+20:6530:x1875336022223872:12345-0@lo:501: 00000100:00100000:1.0:1788459918.973063:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf363cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+20:6530:x1875336022223872:12345-0@lo:501: Request processed in 51us (252us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788459918.973070:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788459918.973091:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc65d76c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788459918.973101:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022223872:0@lo:501: 10000000:01000000:1.0:1788459918.973111:0:6530:0:(mgc_request_server.c:748:mgc_llog_local_copy()) mgc192.168.206.105@tcp: no remote llog for lustre-sptlrpc, check MGS config 00000100:00100000:1.0:1788459918.973135:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022224000:0@lo:501: 00000100:00100000:1.0:1788459918.973163:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459918.973176:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc65d76c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788459918.973187:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022224000 00000100:00100000:1.0:1788459918.973190:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022224000 00000100:00100000:1.0:1788459918.973211:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788459918.973217:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf363dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+20:6530:x1875336022224000:12345-0@lo:501: 00000100:00100000:1.0:1788459918.973261:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf363dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+20:6530:x1875336022224000:12345-0@lo:501: Request processed in 44us (98us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788459918.973267:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788459918.973295:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022224000:0@lo:501: 10000000:01000000:1.0:1788459918.973310:0:6530:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788459918.973316:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0000/0x5dfa74784542ac06 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ac0d expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459918.973323:0:6530:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0000/0x5dfa74784542ac06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ac0d expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788459918.973330:0:6530:0:(mgc_request.c:715:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788459918.973331:0:6530:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-client-ffff8c4be2d81000 from 30 10000000:01000000:1.0:1788459918.973333:0:6530:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788459918.973346:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d1200/0x5dfa74784542ac14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459918.973353:0:6530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d1200/0x5dfa74784542ac14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459918.973359:0:6530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d1200/0x5dfa74784542ac14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788459918.973381:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022224128:0@lo:101: 00000100:00100000:1.0:1788459918.973404:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459918.973421:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022224128 00000100:00100000:1.0:1788459918.973424:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022224128 00000100:00100000:1.0:1788459918.973445:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788459918.973451:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf363f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+20:6530:x1875336022224128:12345-0@lo:101: 00010000:00010000:1.0:1788459918.973457:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788459918.973465:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4bc29d0a00/0x5dfa74784542ac1b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542ac14 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459918.973480:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bc29d0a00/0x5dfa74784542ac1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542ac14 expref: 21 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459918.973488:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4bc29d0a00/0x5dfa74784542ac1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542ac14 expref: 21 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459918.973495:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc29d0a00, rc 0) 00000100:00100000:1.0:1788459918.973517:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf363f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+21:6530:x1875336022224128:12345-0@lo:101: Request processed in 66us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459918.973522:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788459918.973543:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc65d76c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788459918.973567:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022224128:0@lo:101: 00010000:00010000:1.0:1788459918.973576:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d1200/0x5dfa74784542ac14 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ac1b expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459918.973584:0:6530:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d1200/0x5dfa74784542ac14 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542ac1b expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788459918.973616:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022224256:0@lo:501: 00000100:00100000:1.0:1788459918.973639:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459918.973656:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022224256 00000100:00100000:1.0:1788459918.973659:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022224256 00000100:00100000:1.0:1788459918.973677:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788459918.973683:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf363d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+21:6530:x1875336022224256:12345-0@lo:501: 00000100:00100000:3.0:1788459918.973858:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3662:1875336022222976:0@lo:400: 00000100:00100000:3.0:1788459918.974015:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459918.974038:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3662:1875336022223488:0@lo:400: 00000100:00100000:3.0:1788459918.974059:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459918.974079:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788459918.974085:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022223360:0@lo:400: 00000100:00100000:3.0:1788459918.974107:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459918.974133:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3660:1875336022223232:0@lo:400: 00000100:00100000:3.0:1788459918.974151:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459918.974169:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788459918.974174:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022223104:0@lo:400: 00000100:00100000:3.0:1788459918.974191:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459918.974213:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3660:1875336022223616:0@lo:400: 00000100:00100000:3.0:1788459918.974232:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459918.974252:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022222976 00000100:00100000:3.0:1788459918.974255:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022222976 00000100:00100000:3.0:1788459918.974276:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022223488 00000100:00100000:3.0:1788459918.974279:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022223488 00000100:00100000:3.0:1788459918.974290:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022223232 00000100:00100000:3.0:1788459918.974292:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022223232 00000100:00100000:3.0:1788459918.974300:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022223616 00000100:00100000:3.0:1788459918.974302:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022223616 00000100:00100000:3.0:1788459918.974313:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788459918.974319:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfaeab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1875336022222976:12345-0@lo:400: 00000100:00100000:3.0:1788459918.974354:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfaeab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1875336022222976:12345-0@lo:400: Request processed in 35us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459918.974360:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788459918.974373:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788459918.974379:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfaeaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1875336022223488:12345-0@lo:400: 00000100:00100000:3.0:1788459918.974400:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfaeaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1875336022223488:12345-0@lo:400: Request processed in 22us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459918.974405:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788459918.974415:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788459918.974419:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfaea9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1875336022223232:12345-0@lo:400: 00000100:00100000:3.0:1788459918.974442:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfaea9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1875336022223232:12345-0@lo:400: Request processed in 23us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459918.974447:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788459918.974454:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788459918.974459:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfaea9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1875336022223616:12345-0@lo:400: 00000100:00100000:3.0:1788459918.974480:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfaea9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1875336022223616:12345-0@lo:400: Request processed in 20us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459918.974491:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788459918.974511:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022223360 00000100:00100000:3.0:1788459918.974514:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022223360 00000100:00100000:3.0:1788459918.974528:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022223104 00000100:00100000:3.0:1788459918.974531:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022223104 00000100:00100000:3.0:1788459918.974542:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788459918.974559:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfaea9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1875336022223360:12345-0@lo:400: 00000100:00100000:3.0:1788459918.974591:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfaea9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1875336022223360:12345-0@lo:400: Request processed in 43us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459918.974597:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788459918.974608:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788459918.974614:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfaea8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022223104:12345-0@lo:400: 00000100:00100000:3.0:1788459918.974638:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfaea8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022223104:12345-0@lo:400: Request processed in 26us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459918.974643:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788459918.974672:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022223104:0@lo:400: 00010000:00080000:3.0:1788459918.974684:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4bf75e0a80 x1875336022223616/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788459934 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788459918.974694:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3660:1875336022223616:0@lo:400: 00010000:00080000:3.0:1788459918.974704:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4bf75e2680 x1875336022223232/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788459934 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788459918.974712:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3660:1875336022223232:0@lo:400: 00000100:00100000:3.0:1788459918.974738:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022223360:0@lo:400: 00000100:00100000:1.0:1788459918.974883:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf363d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+21:6530:x1875336022224256:12345-0@lo:501: Request processed in 1200us (1242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459918.974890:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788459918.974917:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc65d76c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788459918.974927:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022224256:0@lo:501: 00000100:00100000:1.0:1788459918.974974:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022224384:0@lo:503: 00000100:00100000:1.0:1788459918.975012:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459918.975026:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc65d76c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788459918.975038:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022224384 00000100:00100000:1.0:1788459918.975040:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022224384 00000100:00100000:1.0:1788459918.975061:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788459918.975066:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf363f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+21:6530:x1875336022224384:12345-0@lo:503: 00000100:00100000:1.0:1788459918.975140:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf363f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+21:6530:x1875336022224384:12345-0@lo:503: Request processed in 72us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459918.975146:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788459918.975181:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022224384:0@lo:503: 00000100:00100000:1.0:1788459918.975379:0:8825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0cf73fe6-82e2-434e-b670-631647721b2c:8825:1875336022224512:0@lo:502: 00000100:00100000:1.0:1788459918.975410:0:8825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459918.975437:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022224512 00000100:00100000:1.0:1788459918.975441:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022224512 00000100:00100000:1.0:1788459918.975461:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788459918.975467:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf363fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+21:8825:x1875336022224512:12345-0@lo:502: 00000100:00100000:1.0:1788459918.975529:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf363fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+21:8825:x1875336022224512:12345-0@lo:502: Request processed in 62us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459918.975536:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788459918.975576:0:8825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc65d7840 going to sleep for 11 seconds 00000100:00100000:1.0:1788459918.975587:0:8825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0cf73fe6-82e2-434e-b670-631647721b2c:8825:1875336022224512:0@lo:502: 00000100:00100000:1.0:1788459918.975625:0:8825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0cf73fe6-82e2-434e-b670-631647721b2c:8825:1875336022224640:0@lo:502: 00000100:00100000:1.0:1788459918.975657:0:8825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459918.975675:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022224640 00000100:00100000:1.0:1788459918.975679:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022224640 00000100:00100000:1.0:1788459918.975699:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788459918.975705:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf363e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+21:8825:x1875336022224640:12345-0@lo:502: 00000100:00100000:1.0:1788459918.975778:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf363e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+21:8825:x1875336022224640:12345-0@lo:502: Request processed in 73us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459918.975785:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788459918.975813:0:8825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc65d7840 going to sleep for 11 seconds 00000100:00100000:1.0:1788459918.975825:0:8825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0cf73fe6-82e2-434e-b670-631647721b2c:8825:1875336022224640:0@lo:502: 00000040:00080000:1.0:1788459918.975842:0:8825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1788459918.975889:0:6530:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1788459918.975897:0:6530:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788459918.975905:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d1200/0x5dfa74784542ac14 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ac1b expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459918.975915:0:6530:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d1200/0x5dfa74784542ac14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ac1b expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788459918.975931:0:6530:0:(mgc_request.c:715:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788459918.975933:0:6530:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-mdtir-ffff8c4be2d81000 from 5 10000000:01000000:1.0:1788459918.975936:0:6530:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788459918.975981:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0800/0x5dfa74784542ac22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459918.975988:0:6530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0800/0x5dfa74784542ac22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459918.975996:0:6530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0800/0x5dfa74784542ac22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788459918.976007:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022224768:0@lo:101: 00000100:00100000:1.0:1788459918.976033:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459918.976046:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc65d7840 going to sleep for 11 seconds 00000100:00100000:1.0:1788459918.976057:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022224768 00000100:00100000:1.0:1788459918.976061:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022224768 00000100:00100000:1.0:1788459918.976080:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788459918.976086:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf363e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+21:6530:x1875336022224768:12345-0@lo:101: 00010000:00010000:1.0:1788459918.976094:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788459918.976103:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4bc29d0c00/0x5dfa74784542ac29 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542ac22 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459918.976121:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bc29d0c00/0x5dfa74784542ac29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542ac22 expref: 22 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459918.976131:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4bc29d0c00/0x5dfa74784542ac29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542ac22 expref: 22 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459918.976150:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc29d0c00, rc 0) 00000100:00100000:1.0:1788459918.976179:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf363e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+22:6530:x1875336022224768:12345-0@lo:101: Request processed in 92us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459918.976185:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788459918.976213:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022224768:0@lo:101: 00010000:00010000:1.0:1788459918.976224:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0800/0x5dfa74784542ac22 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ac29 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459918.976231:0:6530:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0800/0x5dfa74784542ac22 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542ac29 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788459918.976270:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022224896:0@lo:256: 00000100:00100000:1.0:1788459918.976299:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459918.976312:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc65d7840 going to sleep for 11 seconds 00000100:00100000:1.0:1788459918.976322:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022224896 00000100:00100000:1.0:1788459918.976325:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022224896 00000100:00100000:1.0:1788459918.976344:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788459918.976350:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf363c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+22:6530:x1875336022224896:12345-0@lo:256: 20000000:01000000:1.0:1788459918.976362:0:6528:0:(mgs_nids.c:1209:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788459918.976378:0:6528:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788459918.976381:0:6528:0:(mgs_nids.c:325:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1788459918.976445:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf363c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+22:6530:x1875336022224896:12345-0@lo:256: Request processed in 94us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459918.976451:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788459918.976476:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022224896:0@lo:256: 10000000:01000000:1.0:1788459918.976513:0:6530:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788459918.976522:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0800/0x5dfa74784542ac22 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ac29 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459918.976529:0:6530:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0800/0x5dfa74784542ac22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ac29 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788459918.976537:0:6530:0:(mgc_request.c:715:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788459918.976539:0:6530:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1788459918.976541:0:6530:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788459918.976567:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0e00/0x5dfa74784542ac30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459918.976575:0:6530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0e00/0x5dfa74784542ac30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459918.976583:0:6530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0e00/0x5dfa74784542ac30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788459918.976594:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022225024:0@lo:101: 00000100:00100000:1.0:1788459918.976617:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459918.976630:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc65d7840 going to sleep for 11 seconds 00000100:00100000:1.0:1788459918.976641:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022225024 00000100:00100000:1.0:1788459918.976644:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022225024 00000100:00100000:1.0:1788459918.976666:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788459918.976673:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf363d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+22:6530:x1875336022225024:12345-0@lo:101: 00010000:00010000:1.0:1788459918.976679:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788459918.976686:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4bc29d1a00/0x5dfa74784542ac37 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542ac30 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459918.976698:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bc29d1a00/0x5dfa74784542ac37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542ac30 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459918.976714:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4bc29d1a00/0x5dfa74784542ac37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542ac30 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459918.976720:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc29d1a00, rc 0) 00000100:00100000:1.0:1788459918.976747:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf363d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+23:6530:x1875336022225024:12345-0@lo:101: Request processed in 74us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459918.976752:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788459918.976873:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022225024:0@lo:101: 00010000:00010000:1.0:1788459918.976884:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0e00/0x5dfa74784542ac30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ac37 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459918.976891:0:6530:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0e00/0x5dfa74784542ac30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542ac37 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788459918.976915:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022225152:0@lo:501: 00000100:00100000:1.0:1788459918.976938:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459918.976967:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc65d7840 going to sleep for 11 seconds 00000100:00100000:1.0:1788459918.976979:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022225152 00000100:00100000:1.0:1788459918.976982:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022225152 00000100:00100000:1.0:1788459918.977003:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788459918.977008:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf363e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+23:6530:x1875336022225152:12345-0@lo:501: 00000100:00100000:1.0:1788459918.977093:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf363e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+23:6530:x1875336022225152:12345-0@lo:501: Request processed in 84us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459918.977098:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788459918.977122:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022225152:0@lo:501: 00000100:00100000:1.0:1788459918.977140:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022225280:0@lo:503: 00000100:00100000:1.0:1788459918.977174:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459918.977185:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc65d7840 going to sleep for 11 seconds 00000100:00100000:1.0:1788459918.977194:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022225280 00000100:00100000:1.0:1788459918.977197:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022225280 00000100:00100000:1.0:1788459918.977213:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788459918.977218:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf363c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+23:6530:x1875336022225280:12345-0@lo:503: 00000100:00100000:1.0:1788459918.977284:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf363c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+23:6530:x1875336022225280:12345-0@lo:503: Request processed in 64us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459918.977290:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788459918.977324:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022225280:0@lo:503: 00010000:00080000:3.0:1788459918.977702:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4bf75e2300 x1875336022222976/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788459934 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788459918.977722:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3662:1875336022222976:0@lo:400: 00010000:00080000:3.0:1788459918.977749:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4bf75e1500 x1875336022223488/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788459934 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788459918.977758:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3662:1875336022223488:0@lo:400: 00000100:00100000:0.0:1788459918.978027:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc4394380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3658:x1875336022222848:12345-0@lo:8: Request processed in 6432us (6820us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459918.978045:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788459918.978348:0:8826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfaeab100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0cf73fe6-82e2-434e-b670-631647721b2c:8826:1875336022225408:0@lo:502: 00000100:00100000:3.0:1788459918.978389:0:8826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459918.978421:0:8826:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac25b69c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788459918.978750:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022225408 00000100:00100000:1.0:1788459918.978756:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022225408 00000100:00100000:1.0:1788459918.978795:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788459918.978802:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf363c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+23:8826:x1875336022225408:12345-0@lo:502: 00000100:00100000:1.0:1788459918.979066:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf363c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+23:8826:x1875336022225408:12345-0@lo:502: Request processed in 264us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459918.979073:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788459918.979140:0:8826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfaeab100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0cf73fe6-82e2-434e-b670-631647721b2c:8826:1875336022225408:0@lo:502: 00000020:01000000:3.0:1788459918.979168:0:8826:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788459918.979175:0:8826:0:(obd_mount.c:1049:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788459918.979181:0:8826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788459918.979183:0:8826:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788459918.979187:0:8826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788459918.979191:0:8826:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.105@tcp to nid 0x20000c0a8ce69 (192.168.206.105@tcp) 00000020:01000000:3.0:1788459918.979210:0:8826:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788459918.979213:0:8826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788459918.979226:0:8826:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8c4bef210000) 00000020:00000080:3.0:1788459918.979246:0:8826:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:3.0:1788459918.979252:0:8826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788459918.979326:0:8826:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788459918.979331:0:8826:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788459918.979338:0:8826:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5dfa74784542ac45 00010000:00080000:3.0:1788459918.979364:0:8826:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c4bff80d000@lustre-OST0000-osc-MDT0000: add connection 192.168.206.105@tcp at head 00010000:00010000:3.0:1788459918.979629:0:8826:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00010000:00080000:2.0:1788459918.980649:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4bfaeaa300 x1875336022222848/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788459928 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788459918.980661:0:3658:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788459918.980669:0:3658:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1788459918.980675:0:3658:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788459918.980680:0:3658:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788459918.980683:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c4bef685000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788459918.980731:0:3658:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788459918.980737:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfaeaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1875336022222848:0@lo:8: 00000004:00080000:3.0:1788459918.982670:0:8823:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788459918.982733:0:8823:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 216085788529ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788459918.982762:0:8823:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1788459918.984108:0:8824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e3100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8824:1875336022225536:0@lo:700: 00000100:00100000:1.0:1788459918.984173:0:8824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459918.984204:0:8824:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc65d7540 going to sleep for 11 seconds 00000100:00100000:2.0:1788459918.988100:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022225536 00000100:00100000:2.0:1788459918.988119:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022225536 00000100:00100000:2.0:1788459918.988190:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788459918.988200:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf75e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8824:x1875336022225536:12345-0@lo:700: 00000100:00100000:2.0:1788459918.988249:0:8456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4394a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8456:1875336022225664:0@lo:700: 00000100:00100000:2.0:1788459918.988303:0:8456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459918.988329:0:8456:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bf77a06c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788459918.988436:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022225664 00000100:00100000:2.0:1788459918.988440:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022225664 00000100:00100000:2.0:1788459918.988462:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788459918.988467:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc4395f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8456:x1875336022225664:12345-0@lo:700: 00000100:00080000:0.0:1788459918.988825:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1788459918.990153:0:7465:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000040:01000000:3.0:1788459918.993348:0:8826:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1788459918.993372:0:8826:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788459918.993636:0:8826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788459918.993835:0:8826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788459918.994186:0:8826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1788459918.994287:0:8826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1788459918.995115:0:8828:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788459918.995120:0:8828:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788459919.000256:0:8826:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788459919.000269:0:8826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788459919.000306:0:8826:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788459919.000325:0:8826:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5dfa74784542ac4c 00000100:00080000:3.0:1788459919.000334:0:8826:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788459919.000340:0:8826:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8c4bff80d000 using connection 192.168.206.105@tcp/0@lo 00000100:00100000:3.0:1788459919.000369:0:8826:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4bfaeab100 x1875336022225792/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788459919.000391:0:8826:0:(pinger.c:380:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788459919.000436:0:8826:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788459919.000439:0:8826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788459919.000441:0:8826:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788459919.000444:0:8826:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788459919.000448:0:8826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788459919.000449:0:8826:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788459919.000452:0:8826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788459919.000454:0:8826:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788459919.000489:0:8826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfaea8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0cf73fe6-82e2-434e-b670-631647721b2c:8826:1875336022225920:0@lo:502: 00000100:00100000:3.0:1788459919.000577:0:8826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459919.000610:0:8826:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc6b9b600 going to sleep for 11 seconds 00000100:00100000:1.0:1788459919.000901:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022225920 00000100:00100000:1.0:1788459919.000908:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022225920 00000100:00100000:1.0:1788459919.000974:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788459919.000984:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd0a6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+23:8826:x1875336022225920:12345-0@lo:502: 00000100:00100000:1.0:1788459919.001094:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd0a6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+23:8826:x1875336022225920:12345-0@lo:502: Request processed in 111us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459919.001111:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788459919.001162:0:8826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfaea8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0cf73fe6-82e2-434e-b670-631647721b2c:8826:1875336022225920:0@lo:502: 00000020:01000000:1.0:1788459919.001186:0:8826:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788459919.001191:0:8826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788459919.001193:0:8826:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788459919.001196:0:8826:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000100:00100000:3.0:1788459919.002028:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfaeab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1875336022225792:0@lo:8: 00000100:00100000:3.0:1788459919.002077:0:3658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459919.002133:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022225792 00000100:00100000:3.0:1788459919.002139:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022225792 00000100:00100000:3.0:1788459919.002164:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788459919.002170:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfaeabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3658:x1875336022225792:12345-0@lo:8: 00010000:00080000:3.0:1788459919.002196:0:8450:0:(ldlm_lib.c:1461:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 216 last 0 00000020:00000080:3.0:1788459919.002223:0:8450:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5dfa74784542ac53 00002000:00100000:3.0:1788459919.002234:0:8450:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8c4bff80e800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a07 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788459919.002239:0:8450:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1788459919.002241:0:8450:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788459919.002301:0:8450:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788459919.002324:0:8450:0:(import.c:65:import_set_state_nolock()) ffff8c4bff80a000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788459919.002365:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfaeabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3658:x1875336022225792:12345-0@lo:8: Request processed in 193us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459919.002372:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788459919.002402:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4bfaeab100 x1875336022225792/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788459929 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788459919.002411:0:3658:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788459919.002418:0:3658:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788459919.002425:0:3658:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788459919.002429:0:3658:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788459919.002431:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c4bff80d000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788459919.002444:0:3658:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788459919.002449:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfaeab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1875336022225792:0@lo:8: 00000004:00080000:0.0:1788459919.003283:0:8828:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788459919.003332:0:8828:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 216106387555ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788459919.003339:0:8828:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000020:01000000:0.0:1788459919.003994:0:6530:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1788459919.004007:0:6530:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788459919.004016:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0e00/0x5dfa74784542ac30 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ac37 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459919.004027:0:6530:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0e00/0x5dfa74784542ac30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ac37 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788459919.004036:0:6530:0:(mgc_request.c:715:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788459919.004038:0:6530:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-sptlrpc-ffff8c4be2d81000 from 1 10000000:01000000:0.0:1788459919.004041:0:6530:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788459919.004071:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bef209600/0x5dfa74784542ac5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459919.004078:0:6530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4bef209600/0x5dfa74784542ac5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459919.004088:0:6530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4bef209600/0x5dfa74784542ac5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788459919.004107:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc471ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022226048:0@lo:101: 00000100:00100000:0.0:1788459919.004157:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459919.004202:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bca45e840 going to sleep for 11 seconds 00000100:00100000:1.0:1788459919.004316:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022226048 00000100:00100000:1.0:1788459919.004322:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022226048 00000100:00100000:1.0:1788459919.004415:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788459919.004424:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd0a6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+23:6530:x1875336022226048:12345-0@lo:101: 00010000:00010000:1.0:1788459919.004436:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788459919.004448:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4bc0030a00/0x5dfa74784542ac61 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542ac5a expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459919.004469:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bc0030a00/0x5dfa74784542ac61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542ac5a expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459919.004480:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4bc0030a00/0x5dfa74784542ac61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542ac5a expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459919.004487:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc0030a00, rc 0) 00000100:00100000:1.0:1788459919.004525:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd0a6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+24:6530:x1875336022226048:12345-0@lo:101: Request processed in 103us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459919.004532:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788459919.004593:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc471ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022226048:0@lo:101: 00010000:00010000:1.0:1788459919.004606:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4bef209600/0x5dfa74784542ac5a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ac61 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459919.004625:0:6530:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4bef209600/0x5dfa74784542ac5a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542ac61 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788459919.004659:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022226176:0@lo:501: 00000100:00100000:1.0:1788459919.004682:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459919.004698:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc5536e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788459919.004710:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022226176 00000100:00100000:1.0:1788459919.004714:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022226176 00000100:00100000:1.0:1788459919.004734:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788459919.004740:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd0a6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+24:6530:x1875336022226176:12345-0@lo:501: 00000100:00100000:1.0:1788459919.004823:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd0a6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+24:6530:x1875336022226176:12345-0@lo:501: Request processed in 83us (139us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788459919.004829:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788459919.004921:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022226176:0@lo:501: 10000000:01000000:1.0:1788459919.004933:0:6530:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788459919.004937:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bef209600/0x5dfa74784542ac5a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ac61 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459919.004968:0:6530:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4bef209600/0x5dfa74784542ac5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ac61 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 40000000:02000000:1.0:1788459919.007540:0:6540:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000004:00080000:0.0:1788459919.010767:0:6513:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:3.0:1788459919.011652:0:8829:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1788459919.011682:0:8829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfaea8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8829:1875336022226432:0@lo:7: 00000100:00100000:0.0:1788459919.011690:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfaeab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022226304:0@lo:13: 00000100:00100000:3.0:1788459919.013996:0:8829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459919.014046:0:8829:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc6b9bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788459919.016746:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459919.016922:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc4395f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8456:x1875336022225664:12345-0@lo:700: Request processed in 28450us (28615us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459919.016940:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788459919.017172:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022226432 00000100:00100000:0.0:1788459919.017180:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022226432 00000100:00100000:0.0:1788459919.017229:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788459919.017239:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfaea9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8829:x1875336022226432:12345-0@lo:7: 00000100:00100000:3.0:1788459919.023979:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022226304 00000100:00100000:3.0:1788459919.023990:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022226304 00000100:00100000:3.0:1788459919.024037:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788459919.024046:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc471ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3660:x1875336022226304:12345-0@lo:13: 00002000:00000024:3.0:1788459919.024071:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923865600 avail 3692343296 00000100:00100000:3.0:1788459919.024146:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc471ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3660:x1875336022226304:12345-0@lo:13: Request processed in 100us (7513us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459919.024154:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788459919.024929:0:8456:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4bc4394a80 x1875336022225664/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788459934 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788459919.024960:0:8456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4394a80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8456:1875336022225664:0@lo:700: 40000000:02000000:2.0:1788459919.024974:0:8456:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00002000:00080000:0.0:1788459919.028185:0:8449:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1788459919.028197:0:8449:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1788459919.028372:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfaea9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8829:x1875336022226432:12345-0@lo:7: Request processed in 11130us (14377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459919.028383:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1788459919.028421:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788459919.028462:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4bfaeab100 x1875336022226304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788459935 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788459919.028487:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfaeab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022226304:0@lo:13: 00010000:00080000:3.0:1788459919.033600:0:8829:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4bfaea8000 x1875336022226432/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788459935 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788459919.033618:0:8829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfaea8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8829:1875336022226432:0@lo:7: 00000004:00080000:3.0:1788459919.033632:0:8829:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1788459919.033895:0:8829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfaea8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8829:1875336022226560:0@lo:5: 00000100:00100000:3.0:1788459919.033967:0:8829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459919.034010:0:8829:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc6b9bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788459919.034673:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022226560 00000100:00100000:0.0:1788459919.034682:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022226560 00000100:00100000:0.0:1788459919.034739:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788459919.034749:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfaeab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8829:x1875336022226560:12345-0@lo:5: 00002000:00080000:0.0:1788459919.034776:0:8448:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1788459919.034780:0:8448:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000001:00100000:2.0:1788459919.038041:0:8443:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1788459919.038050:0:8443:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1788459919.038211:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf75e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8824:x1875336022225536:12345-0@lo:700: Request processed in 50009us (54033us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459919.038228:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788459919.038309:0:8824:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4bf75e3100 x1875336022225536/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788459934 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788459919.038322:0:8824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e3100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8824:1875336022225536:0@lo:700: 00000004:00080000:0.0:1788459919.048797:0:8824:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1788459919.048828:0:8824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc471a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8824:1875336022226816:0@lo:7: 00000100:00100000:2.0:1788459919.048831:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788459919.048851:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc471a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022226688:0@lo:13: 00000100:00100000:2.0:1788459919.048902:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459919.048915:0:8824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459919.048971:0:8824:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc306e780 going to sleep for 11 seconds 00000100:00100000:0.0:1788459919.048990:0:8450:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788459919.048997:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022226688 00000100:00100000:2.0:1788459919.049005:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022226688 00000100:00100000:0.0:1788459919.049006:0:8450:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1788459919.049060:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788459919.049070:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc4394a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022226688:12345-0@lo:13: 00002000:00000024:2.0:1788459919.049097:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923865600 avail 3692343296 00000100:00100000:2.0:1788459919.049141:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc4394a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022226688:12345-0@lo:13: Request processed in 72us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459919.049148:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788459919.049323:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4bc471a680 x1875336022226688/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788459935 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788459919.049340:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc471a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022226688:0@lo:13: 00000100:00100000:2.0:1788459919.051002:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022226816 00000100:00100000:2.0:1788459919.051012:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022226816 00000100:00100000:3.0:1788459919.052409:0:8832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788459919.052426:0:8832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf7713b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8824:x1875336022226816:12345-0@lo:7: 00002000:00080000:3.0:1788459919.059721:0:8832:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:3.0:1788459919.059730:0:8832:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:3.0:1788459919.059824:0:8832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf7713b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8824:x1875336022226816:12345-0@lo:7: Request processed in 7400us (10905us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459919.059835:0:8832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788459919.060171:0:8824:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4bc471a300 x1875336022226816/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788459935 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788459919.060186:0:8824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc471a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8824:1875336022226816:0@lo:7: 00000004:00080000:0.0:1788459919.060199:0:8824:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:0.0:1788459919.060233:0:8824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf7710000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8824:1875336022226944:0@lo:5: 00000100:00100000:0.0:1788459919.060267:0:8824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459919.060290:0:8824:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac25b3d80 going to sleep for 11 seconds 00000001:00080000:0.0:1788459919.060331:0:8443:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000100:00100000:0.0:1788459919.060391:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfaeab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8829:x1875336022226560:12345-0@lo:5: Request processed in 25643us (26424us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788459919.060397:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788459919.060413:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022226944 00000100:00100000:0.0:1788459919.060418:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022226944 00000100:00100000:0.0:1788459919.060446:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788459919.060453:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf7711c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8824:x1875336022226944:12345-0@lo:5: 00002000:00080000:0.0:1788459919.060475:0:8448:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:0.0:1788459919.060500:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf7711c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8824:x1875336022226944:12345-0@lo:5: Request processed in 48us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459919.060506:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788459919.060529:0:8824:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4bf7710000 x1875336022226944/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788459935 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788459919.060539:0:8824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf7710000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8824:1875336022226944:0@lo:5: 00000004:00080000:0.0:1788459919.060558:0:8824:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:0.0:1788459919.060578:0:8824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf7710000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8824:1875336022227072:0@lo:5: 00000100:00100000:0.0:1788459919.060600:0:8824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459919.060623:0:8824:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac25b3d80 going to sleep for 11 seconds 00010000:00080000:0.0:1788459919.060646:0:8829:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4bfaea8000 x1875336022226560/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788459935 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788459919.060655:0:8829:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788459919.060658:0:8829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfaea8000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8829:1875336022226560:0@lo:5: 00000004:00080000:0.0:1788459919.060666:0:8829:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1788459919.060688:0:8829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf7711f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8829:1875336022227200:0@lo:700: 00000100:00100000:0.0:1788459919.060711:0:8829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459919.060727:0:8829:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac25b3180 going to sleep for 11 seconds 00000100:00100000:0.0:1788459919.060738:0:8832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022227072 00000100:00100000:0.0:1788459919.060753:0:8832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022227072 00000100:00100000:0.0:1788459919.060779:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788459919.060785:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf7713800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8824:x1875336022227072:12345-0@lo:5: 00002000:00080000:0.0:1788459919.060807:0:8448:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:0.0:1788459919.062288:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf7713800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:8824:x1875336022227072:12345-0@lo:5: Request processed in 1498us (1682us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788459919.062299:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788459919.062385:0:8824:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4bf7710000 x1875336022227072/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788459935 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788459919.062399:0:8824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf7710000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8824:1875336022227072:0@lo:5: 00000004:00080000:0.0:1788459919.062410:0:8824:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:0.0:1788459919.062442:0:8824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf7712a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8824:1875336022227328:0@lo:900: 00000100:00100000:0.0:1788459919.062472:0:8824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459919.062495:0:8824:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac25b3d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788459919.062662:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022227200 00000100:00100000:2.0:1788459919.062670:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022227200 00000100:00100000:2.0:1788459919.062709:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788459919.062716:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf7710e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8829:x1875336022227200:12345-0@lo:700: 00000100:00100000:1.0:1788459919.063936:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022227328 00000100:00100000:1.0:1788459919.063972:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022227328 00000100:00100000:1.0:1788459919.064012:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788459919.064019:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf7710700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8824:x1875336022227328:12345-0@lo:900: 00000100:00100000:1.0:1788459919.064085:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf7710700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8824:x1875336022227328:12345-0@lo:900: Request processed in 66us (1612us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459919.064090:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788459919.064123:0:8824:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4bf7712a00 x1875336022227328/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788459935 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788459919.064134:0:8824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf7712a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8824:1875336022227328:0@lo:900: 00000001:00080000:2.0:1788459919.067483:0:8443:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000100:00100000:0.0:1788459919.073000:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf7710e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8829:x1875336022227200:12345-0@lo:700: Request processed in 10276us (12279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459919.073025:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788459919.073119:0:8829:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4bf7711f80 x1875336022227200/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788459935 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788459919.073133:0:8829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf7711f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8829:1875336022227200:0@lo:700: 00000004:02000040:2.0:1788459919.080838:0:8829:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:2.0:1788459919.095157:0:8829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4397100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8829:1875336022227456:0@lo:5: 00000100:00100000:2.0:1788459919.095216:0:8829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459919.095259:0:8829:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bf77a0540 going to sleep for 11 seconds 00000100:00100000:1.0:1788459919.095848:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022227456 00000100:00100000:1.0:1788459919.095856:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022227456 00000100:00100000:1.0:1788459919.095904:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788459919.095911:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc4397b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8829:x1875336022227456:12345-0@lo:5: 00002000:00080000:1.0:1788459919.104891:0:8448:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1788459919.104913:0:8448:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:1.0:1788459919.113978:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc4397b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8829:x1875336022227456:12345-0@lo:5: Request processed in 18062us (18755us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788459919.113990:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788459919.114445:0:8829:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4bc4397100 x1875336022227456/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788459935 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788459919.114463:0:8829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4397100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8829:1875336022227456:0@lo:5: 00000004:00080000:2.0:1788459919.114477:0:8829:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00010000:00010000:1.0:1788459919.122241:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788459919.441158:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfaea8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022227584:0@lo:41: 00000100:00100000:2.0:1788459919.441221:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459919.442818:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022227584 00000100:00100000:2.0:1788459919.442831:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022227584 00000100:00100000:2.0:1788459919.442878:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788459919.442888:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc4397800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022227584:12345-0@lo:41: 00000004:00000024:2.0:1788459919.442921:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:2.0:1788459919.443005:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc4397800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022227584:12345-0@lo:41: Request processed in 119us (1783us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459919.443012:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788459919.443067:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfaea8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022227584:0@lo:41: 00000020:00000004:3.0:1788459919.706360:0:8876:0:(tgt_mount.c:2486:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788459919.706576:0:8876:0:(tgt_mount.c:2501:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788459920.149997:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788459920.465644:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf7712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022227712:0@lo:41: 00000100:00100000:3.0:1788459920.465713:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459920.474018:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022227712 00000100:00100000:2.0:1788459920.474035:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022227712 00000100:00100000:2.0:1788459920.474097:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788459920.474112:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfaeaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022227712:12345-0@lo:41: 00000004:00000024:2.0:1788459920.474152:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446502400 avail 1300262912 00000100:00100000:2.0:1788459920.478335:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfaeaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022227712:12345-0@lo:41: Request processed in 4220us (12614us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459920.478350:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788459920.483839:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf7712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022227712:0@lo:41: 00000001:00080000:0.0:1788459920.529677:0:8443:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:1.0:1788459921.169521:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788459922.199070:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788459922.298757:0:8977:0:(tgt_mount.c:2486:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788459922.299013:0:8977:0:(tgt_mount.c:2501:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:2.0:1788459923.048842:0:9025:0:(tgt_mount.c:2486:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788459923.048851:0:9025:0:(tgt_mount.c:2501:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:1.0:1788459923.232756:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788459924.050038:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788459924.050061:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1875336022228352:0@lo:400: 00000100:00100000:1.0:1788459924.050101:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022228480:0@lo:400: 00000100:00100000:0.0:1788459924.050120:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459924.050127:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459924.050161:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022228992:0@lo:400: 00000100:00100000:1.0:1788459924.050913:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459924.050971:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788459924.050974:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022228992 00000100:00100000:1.0:1788459924.050979:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022228864:0@lo:400: 00000100:00100000:2.0:1788459924.050981:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022228992 00000100:00100000:1.0:1788459924.051024:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459924.051030:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788459924.051038:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf75e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022228992:12345-0@lo:400: 00000100:00100000:1.0:1788459924.051050:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875336022228096:0@lo:400: 00000100:00100000:1.0:1788459924.051072:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459924.051083:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf75e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022228992:12345-0@lo:400: Request processed in 47us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459924.051087:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3661:1875336022228608:0@lo:400: 00000100:00100000:2.0:1788459924.051095:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788459924.051107:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459924.051109:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022228864 00000100:00100000:2.0:1788459924.051112:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022228864 00000100:00100000:2.0:1788459924.051132:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788459924.051138:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac1e63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022228864:12345-0@lo:400: 00000100:00100000:1.0:1788459924.051361:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788459924.051367:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022228224:0@lo:400: 00000100:00100000:0.0:1788459924.053355:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf7712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022227840:0@lo:13: 00000100:00100000:2.0:1788459924.056067:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac1e63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022228864:12345-0@lo:400: Request processed in 4919us (5032us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459924.056083:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788459924.057034:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022228352 00000100:00100000:2.0:1788459924.057046:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022228352 00000100:00100000:2.0:1788459924.057093:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022228096 00000100:00100000:2.0:1788459924.057096:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022228096 00000100:00100000:2.0:1788459924.057108:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022228608 00000100:00100000:2.0:1788459924.057110:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022228608 00000100:00100000:2.0:1788459924.057132:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788459924.057140:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf7713480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1875336022228352:12345-0@lo:400: 00000100:00100000:2.0:1788459924.057204:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf7713480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1875336022228352:12345-0@lo:400: Request processed in 64us (7083us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459924.057211:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788459924.057225:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788459924.057231:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac1e60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1875336022228096:12345-0@lo:400: 00000100:00100000:2.0:1788459924.057261:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac1e60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1875336022228096:12345-0@lo:400: Request processed in 30us (6188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459924.057267:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788459924.057278:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788459924.057284:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac1e61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1875336022228608:12345-0@lo:400: 00000100:00100000:2.0:1788459924.057310:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac1e61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1875336022228608:12345-0@lo:400: Request processed in 27us (6202us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459924.057320:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459924.057329:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788459924.057352:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1875336022228736:0@lo:400: 00010000:00080000:2.0:1788459924.057368:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4bf75e3480 x1875336022228864/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788459940 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788459924.057377:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459924.057378:0:3660:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1788459924.057392:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022228864:0@lo:400: 00010000:00080000:1.0:1788459924.057396:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4bf75e1880 x1875336022228096/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788459940 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1788459924.057404:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4bf75e2680 x1875336022228992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788459940 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788459924.057405:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875336022228096:0@lo:400: 00000100:00100000:2.0:1788459924.057411:0:3660:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00010000:00080000:1.0:1788459924.057414:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4bf75e1500 x1875336022228608/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788459940 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788459924.057417:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022228992:0@lo:400: 00000100:00100000:1.0:1788459924.057423:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3661:1875336022228608:0@lo:400: 00000100:00100000:2.0:1788459924.057596:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022228480 00000100:00100000:2.0:1788459924.057601:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022228480 00000100:00100000:2.0:1788459924.057621:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022228224 00000100:00100000:2.0:1788459924.057624:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022228224 00000100:00100000:2.0:1788459924.057648:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788459924.057654:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf75e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022228480:12345-0@lo:400: 00000100:00100000:2.0:1788459924.057692:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf75e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022228480:12345-0@lo:400: Request processed in 37us (7563us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459924.057698:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788459924.057709:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788459924.057779:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac1e63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022228224:12345-0@lo:400: 00000100:00100000:2.0:1788459924.057816:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac1e63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022228224:12345-0@lo:400: Request processed in 101us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459924.057822:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788459924.057912:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022228736 00000100:00100000:2.0:1788459924.057916:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022228736 00000100:00100000:2.0:1788459924.057972:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788459924.057979:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac1e61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1875336022228736:12345-0@lo:400: 00000100:00100000:2.0:1788459924.058011:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac1e61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1875336022228736:12345-0@lo:400: Request processed in 33us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459924.058017:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788459924.058044:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022228480:0@lo:400: 00000100:00100000:2.0:1788459924.058067:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022228224:0@lo:400: 00010000:00080000:2.0:1788459924.058077:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4bf75e2300 x1875336022228736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788459940 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788459924.058086:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1875336022228736:0@lo:400: 00000100:00100000:0.0:1788459924.058313:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459924.058353:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0cf73fe6-82e2-434e-b670-631647721b2c:3659:1875336022227968:0@lo:400: 00000100:00100000:0.0:1788459924.058381:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788459924.058468:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4bf75e1c00 x1875336022228352/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788459940 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788459924.058477:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1875336022228352:0@lo:400: 00000100:00080000:0.0:1788459924.058500:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788459924.058503:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788459924.058506:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788459924.058829:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022227840 00000100:00100000:2.0:1788459924.058835:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022227840 00000100:00100000:2.0:1788459924.058872:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788459924.058880:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf7712d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022227840:12345-0@lo:13: 00002000:00000024:2.0:1788459924.058903:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788459924.059001:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf7712d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022227840:12345-0@lo:13: Request processed in 122us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459924.059009:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788459924.059036:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4bf7712300 x1875336022227840/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788459940 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788459924.059051:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf7712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022227840:0@lo:13: 00000100:00100000:3.0:1788459924.059212:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022227968 00000100:00100000:3.0:1788459924.059217:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022227968 00000100:00100000:3.0:1788459924.059287:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788459924.059296:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd0a6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+24:3659:x1875336022227968:12345-0@lo:400: 00000100:00100000:3.0:1788459924.059344:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd0a6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+24:3659:x1875336022227968:12345-0@lo:400: Request processed in 49us (962us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459924.059350:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788459924.059406:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0cf73fe6-82e2-434e-b670-631647721b2c:3659:1875336022227968:0@lo:400: 00010000:00010000:2.0:1788459924.252484:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788459924.561467:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022229120:0@lo:13: 00000100:00100000:1.0:1788459924.561545:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459924.561615:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022229120 00000100:00100000:1.0:1788459924.561622:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022229120 00000100:00100000:1.0:1788459924.561666:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788459924.561675:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac1e62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022229120:12345-0@lo:13: 00002000:00000024:1.0:1788459924.561695:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788459924.561736:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac1e62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022229120:12345-0@lo:13: Request processed in 63us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459924.561752:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788459924.561788:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4ac1e60e00 x1875336022229120/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788459940 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788459924.561806:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022229120:0@lo:13: 00000100:00100000:3.0:1788459924.564214:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788459924.564234:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfaeaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022229248:0@lo:41: 00000100:00100000:3.0:1788459924.564293:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459924.564335:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022229248 00000100:00100000:3.0:1788459924.564342:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022229248 00000100:00100000:3.0:1788459924.564380:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788459924.564388:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfaea8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022229248:12345-0@lo:41: 00000004:00000024:3.0:1788459924.564417:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1788459924.564540:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfaea8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022229248:12345-0@lo:41: Request processed in 152us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459924.564549:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788459924.564838:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfaeaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022229248:0@lo:41: 00010000:00010000:1.0:1788459925.270404:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788459925.585153:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788459925.589079:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf7711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022229376:0@lo:41: 00000100:00100000:3.0:1788459925.589149:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459925.590150:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022229376 00000100:00100000:2.0:1788459925.590161:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022229376 00000100:00100000:2.0:1788459925.590210:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788459925.590218:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfaeaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022229376:12345-0@lo:41: 00000004:00000024:2.0:1788459925.590249:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446502400 avail 1300262912 00000100:00100000:2.0:1788459925.590312:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfaeaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022229376:12345-0@lo:41: Request processed in 94us (1162us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459925.590319:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788459925.590389:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf7711500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022229376:0@lo:41: 00010000:00010000:0.0:1788459926.299578:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788459927.313127:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788459928.337427:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788459929.174992:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf2feaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1875336022229888:0@lo:400: 00000100:00100000:3.0:1788459929.175598:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459929.175653:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf2fe8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022230400:0@lo:400: 00000100:00100000:3.0:1788459929.175686:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459929.175719:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788459929.175726:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfaea8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0cf73fe6-82e2-434e-b670-631647721b2c:3659:1875336022229504:0@lo:400: 00000100:00100000:3.0:1788459929.175766:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459929.175787:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf2fe8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022230016:0@lo:400: 00000100:00100000:3.0:1788459929.175811:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459929.175828:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac2975880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022230528:0@lo:400: 00000100:00100000:3.0:1788459929.175847:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459929.175875:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf2fe8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875336022229632:0@lo:400: 00000100:00100000:3.0:1788459929.175897:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459929.175915:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf2fe9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3661:1875336022230144:0@lo:400: 00000100:00100000:3.0:1788459929.175933:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459929.175974:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788459929.175980:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf2feb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022229760:0@lo:400: 00000100:00100000:3.0:1788459929.176001:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459929.176020:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf2fe8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1875336022230272:0@lo:400: 00000100:00100000:3.0:1788459929.176171:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459929.176208:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022229888 00000100:00100000:3.0:1788459929.176215:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022229888 00000100:00100000:3.0:1788459929.176249:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022229632 00000100:00100000:3.0:1788459929.176252:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022229632 00000100:00100000:3.0:1788459929.176263:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022230144 00000100:00100000:3.0:1788459929.176265:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022230144 00000100:00100000:3.0:1788459929.176285:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022230272 00000100:00100000:3.0:1788459929.176296:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022230272 00000100:00100000:3.0:1788459929.176315:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788459929.176322:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac2974a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1875336022229888:12345-0@lo:400: 00000100:00100000:3.0:1788459929.176375:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac2974a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1875336022229888:12345-0@lo:400: Request processed in 53us (778us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459929.176382:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788459929.176398:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788459929.176404:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac2977b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1875336022229632:12345-0@lo:400: 00000100:00100000:3.0:1788459929.176437:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac2977b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1875336022229632:12345-0@lo:400: Request processed in 33us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459929.176444:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788459929.176455:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788459929.176461:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac2974000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1875336022230144:12345-0@lo:400: 00000100:00100000:3.0:1788459929.176486:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac2974000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1875336022230144:12345-0@lo:400: Request processed in 27us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459929.176635:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022229504 00000100:00100000:1.0:1788459929.176639:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022229504 00000100:00100000:1.0:1788459929.176670:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788459929.176676:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd0a6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+24:3659:x1875336022229504:12345-0@lo:400: 00000100:00100000:1.0:1788459929.176709:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd0a6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+24:3659:x1875336022229504:12345-0@lo:400: Request processed in 33us (943us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459929.176715:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788459929.177137:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788459929.177156:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788459929.177163:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac2977800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1875336022230272:12345-0@lo:400: 00000100:00100000:3.0:1788459929.177204:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac2977800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1875336022230272:12345-0@lo:400: Request processed in 42us (1033us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459929.177210:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788459929.177230:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022230400 00000100:00100000:3.0:1788459929.177234:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022230400 00000100:00100000:3.0:1788459929.177261:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022230528 00000100:00100000:3.0:1788459929.177265:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022230528 00000100:00100000:3.0:1788459929.177284:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788459929.177290:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac2975180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022230400:12345-0@lo:400: 00000100:00100000:3.0:1788459929.177331:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac2975180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022230400:12345-0@lo:400: Request processed in 41us (1644us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459929.177337:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788459929.177349:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788459929.177355:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac2974380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022230528:12345-0@lo:400: 00000100:00100000:3.0:1788459929.177381:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac2974380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022230528:12345-0@lo:400: Request processed in 26us (1532us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459929.177386:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788459929.177405:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022230016 00000100:00100000:3.0:1788459929.177409:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022230016 00000100:00100000:3.0:1788459929.177426:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022229760 00000100:00100000:3.0:1788459929.177429:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022229760 00000100:00100000:3.0:1788459929.177441:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788459929.177446:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac2977100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022230016:12345-0@lo:400: 00000100:00100000:3.0:1788459929.177483:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac2977100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022230016:12345-0@lo:400: Request processed in 36us (1670us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459929.177489:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:1.0:1788459929.178068:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788459929.178074:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788459929.178076:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788459929.178095:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788459929.178105:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac2975c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022229760:12345-0@lo:400: 00000100:00100000:1.0:1788459929.178147:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac2975c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022229760:12345-0@lo:400: Request processed in 45us (2145us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459929.178153:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788459929.178638:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf2feb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022229760:0@lo:400: 00010000:00080000:3.0:1788459929.178655:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4bf2fe8e00 x1875336022230272/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788459945 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788459929.178665:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf2fe8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1875336022230272:0@lo:400: 00010000:00080000:3.0:1788459929.178678:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4bf2fe8380 x1875336022229632/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788459945 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788459929.178687:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf2fe8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875336022229632:0@lo:400: 00010000:00080000:3.0:1788459929.178697:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4bf2fe9880 x1875336022230144/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788459945 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788459929.178713:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf2fe9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3661:1875336022230144:0@lo:400: 00000100:00100000:1.0:1788459929.179238:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf7711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022230656:0@lo:13: 00000100:00100000:1.0:1788459929.179285:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459929.179383:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022230656 00000100:00100000:0.0:1788459929.179390:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022230656 00000100:00100000:0.0:1788459929.179425:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788459929.179433:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac1e60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1875336022230656:12345-0@lo:13: 00002000:00000024:0.0:1788459929.179457:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788459929.180759:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfaea8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0cf73fe6-82e2-434e-b670-631647721b2c:3659:1875336022229504:0@lo:400: 00000100:00100000:3.0:1788459929.180787:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf2fe8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022230016:0@lo:400: 00010000:00080000:3.0:1788459929.180803:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4ac2975880 x1875336022230528/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788459945 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788459929.180813:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac2975880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022230528:0@lo:400: 00010000:00080000:3.0:1788459929.180825:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4bf2feaa00 x1875336022229888/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788459945 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788459929.180833:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf2feaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1875336022229888:0@lo:400: 00010000:00080000:3.0:1788459929.180844:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4bf2fe8700 x1875336022230400/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788459945 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788459929.180852:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf2fe8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022230400:0@lo:400: 00000100:00100000:0.0:1788459929.182533:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac1e60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1875336022230656:12345-0@lo:13: Request processed in 3090us (3236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459929.182558:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788459929.182657:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4bf7711880 x1875336022230656/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788459945 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788459929.182691:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf7711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022230656:0@lo:13: 00010000:00010000:1.0:1788459929.361058:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788459929.682240:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788459929.682262:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022230784:0@lo:13: 00000100:00100000:1.0:1788459929.682686:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459929.682863:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022230784 00000100:00100000:2.0:1788459929.682873:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022230784 00000100:00100000:2.0:1788459929.682926:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788459929.682934:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac1e62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022230784:12345-0@lo:13: 00002000:00000024:2.0:1788459929.682969:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788459929.683012:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac1e62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022230784:12345-0@lo:13: Request processed in 78us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459929.683019:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788459929.683219:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4ac1e60700 x1875336022230784/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788459945 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788459929.683237:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022230784:0@lo:13: 00000100:00100000:3.0:1788459929.685750:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf7710a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022230912:0@lo:41: 00000100:00100000:3.0:1788459929.685873:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459929.687635:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022230912 00000100:00100000:1.0:1788459929.687646:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022230912 00000100:00100000:1.0:1788459929.687702:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788459929.687710:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac2975880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022230912:12345-0@lo:41: 00000004:00000024:1.0:1788459929.687741:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:2.0:1788459929.695614:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf7710a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022230912:0@lo:41: 00000100:00100000:1.0:1788459929.697091:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac2975880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022230912:12345-0@lo:41: Request processed in 9375us (11210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459929.697102:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:0.0:1788459930.385259:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788459930.712002:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf7711180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022231040:0@lo:41: 00000100:00100000:2.0:1788459930.712064:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459930.712126:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022231040 00000100:00100000:2.0:1788459930.712132:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022231040 00000100:00100000:2.0:1788459930.712171:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788459930.712179:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc4397100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022231040:12345-0@lo:41: 00000004:00000024:2.0:1788459930.712208:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446502400 avail 1300262912 00000100:00100000:2.0:1788459930.712247:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc4397100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022231040:12345-0@lo:41: Request processed in 68us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459930.712255:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788459930.712294:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf7711180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022231040:0@lo:41: 00010000:00010000:1.0:1788459931.409085:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788459931.543033:0:9525:0:(obd_mount.c:1011:lmd_print()) mount data: 00000020:01000004:2.0:1788459931.543042:0:9525:0:(obd_mount.c:1014:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1788459931.543043:0:9525:0:(obd_mount.c:1017:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1788459931.543214:0:9525:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8c4bfc4e5800 00000020:01000004:2.0:1788459931.543228:0:9525:0:(tgt_mount.c:2642:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1788459931.543240:0:9525:0:(obd_mount.c:308:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788459931.544059:0:9525:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8c4bd0b8e620) 00000020:00000080:2.0:1788459931.544077:0:9525:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788459931.587021:0:9525:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1788459931.587071:0:9525:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:2.0:1788459931.628105:0:9525:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788459931.628477:0:9525:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788459931.628500:0:9525:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788459931.628512:0:9525:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x5dfa74784542ac6f 00000020:01000004:2.0:1788459931.628518:0:9525:0:(tgt_mount.c:2727:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1788459931.628542:0:9525:0:(obd_mount.c:488:lustre_start_mgc()) mgc192.168.206.105@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788459931.628615:0:9525:0:(mgc_request.c:1379:mgc_set_info_async()) InitRecov mgc192.168.206.105@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788459931.628622:0:9525:0:(tgt_mount.c:1939:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788459931.628657:0:9525:0:(tgt_mount.c:1519:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.105@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1788459931.628661:0:9525:0:(tgt_mount.c:1239:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788459931.628662:0:9525:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788459931.628663:0:9525:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788459931.628665:0:9525:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:2.0:1788459931.628666:0:9525:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788459931.628667:0:9525:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788459931.628669:0:9525:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788459931.628670:0:9525:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788459931.628671:0:9525:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788459931.628673:0:9525:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788459931.628674:0:9525:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788459931.628677:0:9525:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1788459931.628679:0:9525:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788459931.628680:0:9525:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788459931.628681:0:9525:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788459931.628682:0:9525:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:2.0:1788459931.628684:0:9525:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788459931.628685:0:9525:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788459931.628686:0:9525:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788459931.628687:0:9525:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788459931.628688:0:9525:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788459931.628695:0:9525:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788459931.628696:0:9525:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788459931.628720:0:9525:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788459931.628737:0:9525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:9525:1875336022231168:0@lo:253: 00000100:00100000:2.0:1788459931.628797:0:9525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459931.628881:0:9525:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac25b3840 going to sleep for 11 seconds 00000100:00100000:3.0:1788459931.632146:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022231168 00000100:00100000:3.0:1788459931.632159:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022231168 00000100:00100000:3.0:1788459931.632528:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788459931.632538:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd0a6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+24:9525:x1875336022231168:12345-0@lo:253: 20000000:01000000:3.0:1788459931.632587:0:6528:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788459931.632591:0:6528:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1788459931.632596:0:6528:0:(mgs_llog.c:875:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1788459931.632599:0:6528:0:(mgs_llog.c:3868:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1788459931.632858:0:6528:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788459931.633020:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:3.0:1788459931.633035:0:6528:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1788459931.633123:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:3.0:1788459931.633132:0:6528:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1788459931.633149:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:3.0:1788459931.633418:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:3.0:1788459931.633565:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:3.0:1788459931.633582:0:6528:0:(mgs_llog.c:3821:mgs_write_log_osc_to_lov()) add nid 192.168.206.105@tcp 20000000:01000000:3.0:1788459931.633584:0:6528:0:(mgs_llog.c:1545:record_base_raw()) lcfg (null) 0xcf005 192.168.206.105@tcp (null) (null) (null) 00000040:00080000:3.0:1788459931.633602:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:3.0:1788459931.633608:0:6528:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788459931.633626:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:3.0:1788459931.633635:0:6528:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.206.105@tcp (null) (null) 00000040:00080000:3.0:1788459931.633654:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:3.0:1788459931.633663:0:6528:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1788459931.633681:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:3.0:1788459931.633702:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:3.0:1788459931.633794:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:3.0:1788459931.633807:0:6528:0:(mgs_llog.c:3821:mgs_write_log_osc_to_lov()) add nid 192.168.206.105@tcp 20000000:01000000:3.0:1788459931.633809:0:6528:0:(mgs_llog.c:1545:record_base_raw()) lcfg (null) 0xcf005 192.168.206.105@tcp (null) (null) (null) 00000040:00080000:3.0:1788459931.633825:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:3.0:1788459931.633835:0:6528:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788459931.633852:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:3.0:1788459931.633858:0:6528:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.206.105@tcp (null) (null) 00000040:00080000:3.0:1788459931.633870:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:3.0:1788459931.633876:0:6528:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1788459931.633894:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:3.0:1788459931.633914:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:3.0:1788459931.634563:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:3.0:1788459931.634578:0:6528:0:(mgs_llog.c:3821:mgs_write_log_osc_to_lov()) add nid 192.168.206.105@tcp 20000000:01000000:3.0:1788459931.634580:0:6528:0:(mgs_llog.c:1545:record_base_raw()) lcfg (null) 0xcf005 192.168.206.105@tcp (null) (null) (null) 00000040:00080000:3.0:1788459931.634605:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:3.0:1788459931.634614:0:6528:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1788459931.634632:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:3.0:1788459931.634640:0:6528:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.206.105@tcp (null) (null) 00000040:00080000:3.0:1788459931.634656:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:3.0:1788459931.634663:0:6528:0:(mgs_llog.c:1545:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1788459931.634676:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:3.0:1788459931.634692:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:3.0:1788459931.634708:0:6528:0:(mgs_llog.c:5258:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788459931.634711:0:6528:0:(mgs_llog.c:4754:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788459931.634714:0:6528:0:(mgs_llog.c:4187:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788459931.634752:0:6528:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788459931.634755:0:6528:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788459931.636300:0:9531:0:(mgs_llog.c:1082:mgs_modify_handler()) Changing rec 31 marker 25 1->4: lustre sys.timeout 20000000:01000000:2.0:1788459931.636335:0:9531:0:(mgs_llog.c:1082:mgs_modify_handler()) Changing rec 33 marker 25 2->4: lustre sys.timeout 00000040:00080000:2.0:1788459931.636353:0:9531:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:3.0:1788459931.636608:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:3.0:1788459931.636631:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:3.0:1788459931.636644:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:3.0:1788459931.636655:0:6528:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788459931.636657:0:6528:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788459931.637379:0:9532:0:(mgs_llog.c:1082:mgs_modify_handler()) Changing rec 36 marker 26 1->4: lustre sys.timeout 20000000:01000000:3.0:1788459931.637402:0:9532:0:(mgs_llog.c:1082:mgs_modify_handler()) Changing rec 38 marker 26 2->4: lustre sys.timeout 00000040:00080000:3.0:1788459931.637419:0:9532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:1.0:1788459931.638914:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:1.0:1788459931.639624:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:1.0:1788459931.639659:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:1.0:1788459931.640013:0:6528:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788459931.640016:0:6528:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788459931.643177:0:9533:0:(mgs_llog.c:1082:mgs_modify_handler()) Changing rec 5 marker 27 1->4: lustre sys.timeout 20000000:01000000:1.0:1788459931.643230:0:9533:0:(mgs_llog.c:1082:mgs_modify_handler()) Changing rec 7 marker 27 2->4: lustre sys.timeout 00000040:00080000:1.0:1788459931.643441:0:9533:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1788459931.643882:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1788459931.643921:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:3.0:1788459931.643939:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:3.0:1788459931.643980:0:6528:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1788459931.643982:0:6528:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788459931.644377:0:9534:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:1.0:1788459931.644522:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:1.0:1788459931.644553:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:1.0:1788459931.644581:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:1.0:1788459931.644592:0:6528:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1788459931.644594:0:6528:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788459931.644870:0:9535:0:(mgs_llog.c:1082:mgs_modify_handler()) Changing rec 31 marker 28 1->4: lustre sys.timeout 20000000:01000000:1.0:1788459931.644980:0:9535:0:(mgs_llog.c:1082:mgs_modify_handler()) Changing rec 33 marker 28 2->4: lustre sys.timeout 00000040:00080000:1.0:1788459931.644999:0:9535:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:3.0:1788459931.645132:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:3.0:1788459931.645152:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:3.0:1788459931.645165:0:6528:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 10000000:01000000:3.0:1788459931.645178:0:6528:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788459931.645196:0:6528:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c4ac2841000/0x5dfa74784542ac76 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.645221:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4bef208400/0x5dfa74784542ab34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542ab2d expref: 24 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.645229:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4bc29d3000/0x5dfa74784542ab42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542ab3b expref: 24 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.645247:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4bc29d3800/0x5dfa74784542ab7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542ab73 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.645255:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4bef209800/0x5dfa74784542abc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542abc0 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.645262:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4bef209400/0x5dfa74784542abe3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542abdc expref: 24 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.645268:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4bc29d0200/0x5dfa74784542ac0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542ac06 expref: 24 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.645275:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4bc29d0a00/0x5dfa74784542ac1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542ac14 expref: 24 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.645282:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4bc29d1a00/0x5dfa74784542ac37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542ac30 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.645288:0:6528:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4bc0030a00/0x5dfa74784542ac61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542ac5a expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.645296:0:6528:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c4ac2841000/0x5dfa74784542ac76 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.645339:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4bc0030a00/0x5dfa74784542ac61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5dfa74784542ac5a expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.645354:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c4bc0030a00/0x5dfa74784542ac61 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5dfa74784542ac5a expref: 24 pid: 6526 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788459931.645367:0:6528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac2975f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6528:1875336022231296:0@lo:104: 00000100:00100000:3.0:1788459931.645423:0:6528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788459931.645488:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4bc29d1a00/0x5dfa74784542ac37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5dfa74784542ac30 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.645498:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c4bc29d1a00/0x5dfa74784542ac37 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5dfa74784542ac30 expref: 24 pid: 6525 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788459931.645507:0:6528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac2976a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6528:1875336022231424:0@lo:104: 00000100:00100000:3.0:1788459931.645531:0:6528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788459931.645568:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4bc29d0a00/0x5dfa74784542ac1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5dfa74784542ac14 expref: 24 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.645577:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c4bc29d0a00/0x5dfa74784542ac1b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5dfa74784542ac14 expref: 24 pid: 6528 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788459931.645586:0:6528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac2976680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6528:1875336022231552:0@lo:104: 00000100:00100000:3.0:1788459931.645607:0:6528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788459931.645622:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4bc29d0200/0x5dfa74784542ac0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5dfa74784542ac06 expref: 24 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.645631:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c4bc29d0200/0x5dfa74784542ac0d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5dfa74784542ac06 expref: 24 pid: 6528 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788459931.645646:0:6528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac2977480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6528:1875336022231680:0@lo:104: 00000100:00100000:3.0:1788459931.645667:0:6528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788459931.645683:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4bef209400/0x5dfa74784542abe3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5dfa74784542abdc expref: 24 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.645692:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c4bef209400/0x5dfa74784542abe3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5dfa74784542abdc expref: 24 pid: 6528 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788459931.645699:0:6528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac2975500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6528:1875336022231808:0@lo:104: 00000100:00100000:3.0:1788459931.645720:0:6528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788459931.645737:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4bef209800/0x5dfa74784542abc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5dfa74784542abc0 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.645745:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c4bef209800/0x5dfa74784542abc7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5dfa74784542abc0 expref: 24 pid: 6525 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788459931.645753:0:6528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfaea8000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6528:1875336022231936:0@lo:104: 00010000:00010000:3.0:1788459931.645774:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4bc29d3800/0x5dfa74784542ab7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5dfa74784542ab73 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.645783:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c4bc29d3800/0x5dfa74784542ab7a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5dfa74784542ab73 expref: 24 pid: 6525 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788459931.645790:0:6528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf2fe8700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6528:1875336022232064:0@lo:104: 00010000:00010000:3.0:1788459931.645812:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4bc29d3000/0x5dfa74784542ab42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5dfa74784542ab3b expref: 24 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.645819:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c4bc29d3000/0x5dfa74784542ab42 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5dfa74784542ab3b expref: 24 pid: 6528 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788459931.645834:0:6528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf2feaa00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6528:1875336022232192:0@lo:104: 00010000:00010000:3.0:1788459931.645861:0:6528:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4bef208400/0x5dfa74784542ab34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5dfa74784542ab2d expref: 24 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.645869:0:6528:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c4bef208400/0x5dfa74784542ab34 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5dfa74784542ab2d expref: 24 pid: 6528 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788459931.645877:0:6528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf2fe8000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6528:1875336022232320:0@lo:104: 00000100:00100000:3.0:1788459931.646099:0:6528:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4c01849780 going to sleep for 11 seconds 00000100:00100000:3.0:1788459931.646127:0:6516:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788459931.646145:0:6516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459931.646155:0:6516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459931.646162:0:6516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459931.646169:0:6516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459931.646176:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022231296 00000100:00100000:3.0:1788459931.646182:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022231296 00000100:00100000:3.0:1788459931.646213:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022231424 00000100:00100000:3.0:1788459931.646216:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022231424 00000100:00100000:3.0:1788459931.646224:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022231552 00000100:00100000:3.0:1788459931.646226:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022231552 00000100:00100000:3.0:1788459931.646249:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022231680 00000100:00100000:3.0:1788459931.646252:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022231680 00000100:00100000:3.0:1788459931.646260:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022231808 00000100:00100000:3.0:1788459931.646262:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022231808 00000100:00100000:3.0:1788459931.646269:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022231936 00000100:00100000:3.0:1788459931.646271:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022231936 00000100:00100000:3.0:1788459931.646278:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022232064 00000100:00100000:3.0:1788459931.646280:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022232064 00000100:00100000:3.0:1788459931.646287:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022232192 00000100:00100000:3.0:1788459931.646288:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022232192 00000100:00100000:3.0:1788459931.646306:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022232320 00000100:00100000:3.0:1788459931.646308:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022232320 00000100:00100000:3.0:1788459931.646320:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788459931.646327:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac2974e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0cf73fe6-82e2-434e-b670-631647721b2c+11:6528:x1875336022231296:12345-0@lo:104: 00010000:00010000:3.0:1788459931.646338:0:6516:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.206.105@tcp lock: ffff8c4bef209600/0x5dfa74784542ac5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542ac61 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.646392:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788459931.646398:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac2974e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0cf73fe6-82e2-434e-b670-631647721b2c+11:6528:x1875336022231296:12345-0@lo:104: Request processed in 71us (975us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459931.646404:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788459931.646420:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788459931.646425:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac2974700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0cf73fe6-82e2-434e-b670-631647721b2c+10:6528:x1875336022231424:12345-0@lo:104: 00010000:00010000:3.0:1788459931.646432:0:6516:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0e00/0x5dfa74784542ac30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542ac37 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.646463:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788459931.646469:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac2974700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0cf73fe6-82e2-434e-b670-631647721b2c+10:6528:x1875336022231424:12345-0@lo:104: Request processed in 44us (938us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459931.646476:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788459931.646500:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788459931.646505:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac2976300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0cf73fe6-82e2-434e-b670-631647721b2c+9:6528:x1875336022231552:12345-0@lo:104: 00010000:00010000:3.0:1788459931.646511:0:6516:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d1200/0x5dfa74784542ac14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542ac1b expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.646535:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788459931.646641:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac2976300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0cf73fe6-82e2-434e-b670-631647721b2c+9:6528:x1875336022231552:12345-0@lo:104: Request processed in 35us (932us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459931.646658:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788459931.646671:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788459931.646677:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac2976d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0cf73fe6-82e2-434e-b670-631647721b2c+8:6528:x1875336022231680:12345-0@lo:104: 00010000:00010000:3.0:1788459931.646684:0:6516:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0000/0x5dfa74784542ac06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542ac0d expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.646713:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1788459931.646717:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac2976d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0cf73fe6-82e2-434e-b670-631647721b2c+8:6528:x1875336022231680:12345-0@lo:104: Request processed in 41us (1050us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459931.646723:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788459931.646734:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788459931.646740:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfc428450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0cf73fe6-82e2-434e-b670-631647721b2c+7:6528:x1875336022231808:12345-0@lo:104: 00010000:00010000:3.0:1788459931.646747:0:6516:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2400/0x5dfa74784542abdc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542abe3 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.646771:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1788459931.646775:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfc428450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0cf73fe6-82e2-434e-b670-631647721b2c+7:6528:x1875336022231808:12345-0@lo:104: Request processed in 37us (1055us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459931.646781:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788459931.646805:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788459931.646811:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf2fe9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0cf73fe6-82e2-434e-b670-631647721b2c+6:6528:x1875336022231936:12345-0@lo:104: 00010000:00010000:3.0:1788459931.646818:0:6516:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7000/0x5dfa74784542abc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542abc7 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.646842:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:3.0:1788459931.646847:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf2fe9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0cf73fe6-82e2-434e-b670-631647721b2c+6:6528:x1875336022231936:12345-0@lo:104: Request processed in 37us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459931.646858:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788459931.646870:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788459931.646875:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf2fe8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0cf73fe6-82e2-434e-b670-631647721b2c+5:6528:x1875336022232064:12345-0@lo:104: 00010000:00010000:3.0:1788459931.647035:0:6516:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7a00/0x5dfa74784542ab73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542ab7a expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.647065:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:3.0:1788459931.647070:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf2fe8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0cf73fe6-82e2-434e-b670-631647721b2c+5:6528:x1875336022232064:12345-0@lo:104: Request processed in 195us (913us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459931.647075:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788459931.647088:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788459931.647093:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf2fe8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0cf73fe6-82e2-434e-b670-631647721b2c+4:6528:x1875336022232192:12345-0@lo:104: 00010000:00010000:3.0:1788459931.647100:0:6516:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d3a00/0x5dfa74784542ab3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542ab42 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.647121:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to priority blp list, 8 blwis in pool 00000100:00100000:3.0:1788459931.647125:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf2fe8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0cf73fe6-82e2-434e-b670-631647721b2c+4:6528:x1875336022232192:12345-0@lo:104: Request processed in 33us (963us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459931.647129:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788459931.647139:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788459931.647144:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf2feb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0cf73fe6-82e2-434e-b670-631647721b2c+3:6528:x1875336022232320:12345-0@lo:104: 00010000:00010000:3.0:1788459931.647150:0:6516:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0800/0x5dfa74784542ab2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542ab34 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.647169:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to priority blp list, 9 blwis in pool 00000100:00100000:3.0:1788459931.647174:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf2feb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0cf73fe6-82e2-434e-b670-631647721b2c+3:6528:x1875336022232320:12345-0@lo:104: Request processed in 31us (1004us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459931.647185:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:3.0:1788459931.647202:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:3.0:1788459931.647208:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: ffff8c4bef209600/0x5dfa74784542ac5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542ac61 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.647215:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bef209600 already unused, calling callback (ffffffffc125ae00) 10000000:00010000:3.0:1788459931.647218:0:6521:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: ffff8c4bef209600/0x5dfa74784542ac5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x5dfa74784542ac61 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.647226:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: ffff8c4bef209600/0x5dfa74784542ac5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x5dfa74784542ac61 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788459931.647297:0:6521:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: ffff8c4bef209600/0x5dfa74784542ac5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x5dfa74784542ac61 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788459931.647304:0:6521:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788459931.647375:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.206.105@tcp lock: ffff8c4bef209600/0x5dfa74784542ac5a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542ac61 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.647381:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788459931.647401:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: ffff8c4bef209600/0x5dfa74784542ac5a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542ac61 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.647408:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: ffff8c4bef209600/0x5dfa74784542ac5a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542ac61 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.647420:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:3.0:1788459931.647423:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0e00/0x5dfa74784542ac30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542ac37 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.647437:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc29d0e00 already unused, calling callback (ffffffffc125ae00) 10000000:00010000:3.0:1788459931.647440:0:6521:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0e00/0x5dfa74784542ac30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x5dfa74784542ac37 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.647447:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0e00/0x5dfa74784542ac30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x5dfa74784542ac37 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788459931.647453:0:6521:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0e00/0x5dfa74784542ac30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x5dfa74784542ac37 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788459931.647457:0:6521:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1788459931.647782:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4396d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0cf73fe6-82e2-434e-b670-631647721b2c:3661:1875336022232448:0@lo:103: 00000100:00100000:1.0:1788459931.647818:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459931.647864:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022232448 00000100:00100000:1.0:1788459931.647869:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022232448 00010000:00010000:1.0:1788459931.647902:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4bc0030a00/0x5dfa74784542ac61 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542ac5a expref: 25 pid: 6526 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788459931.647927:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788459931.647933:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac1e60700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0cf73fe6-82e2-434e-b670-631647721b2c+25:3661:x1875336022232448:12345-0@lo:103: 00010000:00010000:1.0:1788459931.648086:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788459931.648092:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4bc0030a00/0x5dfa74784542ac61 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542ac5a expref: 25 pid: 6526 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459931.648107:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4bc0030a00/0x5dfa74784542ac61 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5dfa74784542ac5a expref: 25 pid: 6526 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459931.648124:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788459931.648154:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac1e60700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0cf73fe6-82e2-434e-b670-631647721b2c+25:3661:x1875336022232448:12345-0@lo:103: Request processed in 221us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459931.648160:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788459931.648198:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4396d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0cf73fe6-82e2-434e-b670-631647721b2c:3661:1875336022232448:0@lo:103: 00010000:00010000:1.0:1788459931.649104:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:3.0:1788459931.649151:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0e00/0x5dfa74784542ac30 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542ac37 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.649160:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788459931.649172:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0e00/0x5dfa74784542ac30 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542ac37 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.649179:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0e00/0x5dfa74784542ac30 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542ac37 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788459931.649184:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1788459931.649195:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1788459931.649198:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0000/0x5dfa74784542ac06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542ac0d expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.649204:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc29d0000 already unused, calling callback (ffffffffc125ae00) 00000100:00100000:1.0:1788459931.649204:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4397480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0cf73fe6-82e2-434e-b670-631647721b2c:3661:1875336022232576:0@lo:103: 10000000:00010000:3.0:1788459931.649208:0:6521:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0000/0x5dfa74784542ac06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x5dfa74784542ac0d expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.649223:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0000/0x5dfa74784542ac06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x5dfa74784542ac0d expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788459931.649229:0:6521:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0000/0x5dfa74784542ac06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x5dfa74784542ac0d expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788459931.649234:0:6521:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788459931.649249:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0000/0x5dfa74784542ac06 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542ac0d expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.649254:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788459931.649269:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0000/0x5dfa74784542ac06 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542ac0d expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.649276:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0000/0x5dfa74784542ac06 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542ac0d expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.649285:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788459931.649289:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2400/0x5dfa74784542abdc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542abe3 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.649294:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc29d2400 already unused, calling callback (ffffffffc125ae00) 10000000:00010000:3.0:1788459931.649296:0:6521:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2400/0x5dfa74784542abdc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x5dfa74784542abe3 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.649303:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2400/0x5dfa74784542abdc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x5dfa74784542abe3 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788459931.649309:0:6521:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2400/0x5dfa74784542abdc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x5dfa74784542abe3 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788459931.649320:0:6521:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788459931.649334:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2400/0x5dfa74784542abdc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542abe3 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.649340:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788459931.649345:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2400/0x5dfa74784542abdc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542abe3 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.649351:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2400/0x5dfa74784542abdc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542abe3 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.649360:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00000100:00100000:1.0:1788459931.649360:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788459931.649363:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7000/0x5dfa74784542abc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542abc7 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.649369:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bfadc7000 already unused, calling callback (ffffffffc125ae00) 10000000:00010000:3.0:1788459931.649372:0:6521:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7000/0x5dfa74784542abc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x5dfa74784542abc7 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.649384:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7000/0x5dfa74784542abc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x5dfa74784542abc7 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788459931.649390:0:6521:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7000/0x5dfa74784542abc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x5dfa74784542abc7 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459931.649446:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4bc0030a00/0x5dfa74784542ac61 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5dfa74784542ac5a expref: 24 pid: 6526 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788459931.649458:0:6528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac2975f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6528:1875336022231296:0@lo:104: 00000100:00100000:1.0:1788459931.649470:0:6528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac2976a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6528:1875336022231424:0@lo:104: 00000100:00100000:1.0:1788459931.649488:0:6528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac2976680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6528:1875336022231552:0@lo:104: 00000100:00100000:1.0:1788459931.649498:0:6528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac2977480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6528:1875336022231680:0@lo:104: 00000100:00100000:1.0:1788459931.649506:0:6528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac2975500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6528:1875336022231808:0@lo:104: 10000000:01000000:3.0:1788459931.649511:0:6521:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1788459931.649514:0:6528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfaea8000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6528:1875336022231936:0@lo:104: 00000100:00100000:1.0:1788459931.649522:0:6528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf2fe8700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6528:1875336022232064:0@lo:104: 00000100:00100000:1.0:1788459931.649531:0:6528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf2feaa00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6528:1875336022232192:0@lo:104: 00000100:00100000:1.0:1788459931.649539:0:6528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf2fe8000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6528:1875336022232320:0@lo:104: 00010000:00010000:3.0:1788459931.649561:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7000/0x5dfa74784542abc0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542abc7 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.649567:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788459931.649580:0:6528:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c4ac2841000/0x5dfa74784542ac76 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.649582:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7000/0x5dfa74784542abc0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542abc7 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.649598:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7000/0x5dfa74784542abc0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542abc7 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.649607:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788459931.649610:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7a00/0x5dfa74784542ab73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542ab7a expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.649616:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bfadc7a00 already unused, calling callback (ffffffffc125ae00) 10000000:00010000:3.0:1788459931.649619:0:6521:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7a00/0x5dfa74784542ab73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5dfa74784542ab7a expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.649625:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7a00/0x5dfa74784542ab73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5dfa74784542ab7a expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788459931.649632:0:6521:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7a00/0x5dfa74784542ab73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5dfa74784542ab7a expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788459931.649637:0:6521:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788459931.649643:0:9536:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788459931.649648:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d1200/0x5dfa74784542ac14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542ac1b expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459931.649655:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc29d1200 already unused, calling callback (ffffffffc125ae00) 10000000:00010000:1.0:1788459931.649657:0:6522:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d1200/0x5dfa74784542ac14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5dfa74784542ac1b expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459931.649664:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d1200/0x5dfa74784542ac14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5dfa74784542ac1b expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788459931.649676:0:6522:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d1200/0x5dfa74784542ac14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5dfa74784542ac1b expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788459931.649680:0:6522:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1788459931.649767:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022232576 00000100:00100000:0.0:1788459931.649772:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022232576 00010000:00010000:0.0:1788459931.649794:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4bc29d1a00/0x5dfa74784542ac37 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542ac30 expref: 24 pid: 6525 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788459931.649820:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788459931.649827:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac1e62300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0cf73fe6-82e2-434e-b670-631647721b2c+24:3661:x1875336022232576:12345-0@lo:103: 00010000:00010000:0.0:1788459931.649837:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788459931.649842:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4bc29d1a00/0x5dfa74784542ac37 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542ac30 expref: 24 pid: 6525 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459931.649851:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4bc29d1a00/0x5dfa74784542ac37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5dfa74784542ac30 expref: 24 pid: 6525 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459931.649864:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4bc29d1a00/0x5dfa74784542ac37 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5dfa74784542ac30 expref: 24 pid: 6525 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459931.649877:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788459931.649917:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac1e62300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0cf73fe6-82e2-434e-b670-631647721b2c+23:3661:x1875336022232576:12345-0@lo:103: Request processed in 91us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459931.649924:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:1.0:1788459931.650665:0:6522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d1200/0x5dfa74784542ac14 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542ac1b expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459931.650674:0:6522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788459931.650682:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d1200/0x5dfa74784542ac14 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542ac1b expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459931.650689:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d1200/0x5dfa74784542ac14 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542ac1b expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459931.650699:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788459931.650703:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0800/0x5dfa74784542ab2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542ab34 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459931.650709:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc14f0800 already unused, calling callback (ffffffffc125ae00) 10000000:00010000:1.0:1788459931.650712:0:6522:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0800/0x5dfa74784542ab2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5dfa74784542ab34 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459931.650719:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0800/0x5dfa74784542ab2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5dfa74784542ab34 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788459931.650726:0:6522:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0800/0x5dfa74784542ab2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5dfa74784542ab34 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788459931.650731:0:6522:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788459931.650751:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7a00/0x5dfa74784542ab73 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542ab7a expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459931.650751:0:6522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0800/0x5dfa74784542ab2d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542ab34 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.650758:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788459931.650758:0:6522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788459931.650763:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7a00/0x5dfa74784542ab73 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542ab7a expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459931.650763:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0800/0x5dfa74784542ab2d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542ab34 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.650771:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7a00/0x5dfa74784542ab73 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542ab7a expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459931.650771:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0800/0x5dfa74784542ab2d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542ab34 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.650781:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788459931.650781:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788459931.650782:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788459931.650784:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788459931.650786:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788459931.650788:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788459931.650891:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0cf73fe6-82e2-434e-b670-631647721b2c:3662:1875336022233088:0@lo:103: 00000100:00100000:3.0:1788459931.650932:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459931.650996:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022233088 00000100:00100000:1.0:1788459931.651001:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022233088 00010000:00010000:1.0:1788459931.651024:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4bc29d0a00/0x5dfa74784542ac1b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542ac14 expref: 23 pid: 6528 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788459931.651046:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788459931.651053:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac2976d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0cf73fe6-82e2-434e-b670-631647721b2c+23:3662:x1875336022233088:12345-0@lo:103: 00010000:00010000:1.0:1788459931.651062:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788459931.651065:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4bc29d0a00/0x5dfa74784542ac1b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542ac14 expref: 23 pid: 6528 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459931.651074:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4bc29d0a00/0x5dfa74784542ac1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5dfa74784542ac14 expref: 23 pid: 6528 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459931.651087:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4bc29d0a00/0x5dfa74784542ac1b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5dfa74784542ac14 expref: 23 pid: 6528 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459931.651097:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788459931.651339:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788459931.651371:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788459931.651373:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788459931.651408:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac2976d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0cf73fe6-82e2-434e-b670-631647721b2c+22:3662:x1875336022233088:12345-0@lo:103: Request processed in 355us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459931.651416:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1788459931.651457:0:9536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d3a00/0x5dfa74784542ab3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542ab42 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459931.651465:0:9536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc29d3a00 already unused, calling callback (ffffffffc125ae00) 10000000:00010000:2.0:1788459931.651468:0:9536:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d3a00/0x5dfa74784542ab3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5dfa74784542ab42 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459931.651475:0:9536:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d3a00/0x5dfa74784542ab3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5dfa74784542ab42 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788459931.651490:0:9536:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d3a00/0x5dfa74784542ab3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5dfa74784542ab42 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788459931.651494:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0cf73fe6-82e2-434e-b670-631647721b2c:3662:1875336022233088:0@lo:103: 10000000:01000000:2.0:1788459931.651495:0:9536:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1788459931.651510:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788459931.651516:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac2974700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0cf73fe6-82e2-434e-b670-631647721b2c:3662:1875336022232960:0@lo:103: 00000100:00100000:3.0:1788459931.651540:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459931.651571:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4396d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0cf73fe6-82e2-434e-b670-631647721b2c:3659:1875336022232704:0@lo:103: 00000100:00100000:3.0:1788459931.651592:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459931.651608:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac2976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0cf73fe6-82e2-434e-b670-631647721b2c:3659:1875336022233216:0@lo:103: 00000100:00100000:0.0:1788459931.651625:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022232960 00000100:00100000:3.0:1788459931.651626:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459931.651630:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022232960 00000100:00100000:3.0:1788459931.651640:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0cf73fe6-82e2-434e-b670-631647721b2c:3659:1875336022233344:0@lo:103: 00010000:00010000:0.0:1788459931.651650:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4bef209800/0x5dfa74784542abc7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542abc0 expref: 22 pid: 6525 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788459931.651656:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459931.651663:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022232704 00000100:00100000:3.0:1788459931.651666:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788459931.651666:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022232704 00000100:00100000:3.0:1788459931.651671:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac2974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0cf73fe6-82e2-434e-b670-631647721b2c:3659:1875336022232832:0@lo:103: 00010000:00010000:0.0:1788459931.651675:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4bc29d0200/0x5dfa74784542ac0d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542ac06 expref: 23 pid: 6528 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788459931.651684:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022233216 00000100:00100000:0.0:1788459931.651687:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022233216 00010000:00010000:0.0:1788459931.651696:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4bc29d3800/0x5dfa74784542ab7a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542ab73 expref: 24 pid: 6525 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788459931.651705:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022233344 00000100:00100000:0.0:1788459931.651707:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022233344 00010000:00010000:0.0:1788459931.651716:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4bef208400/0x5dfa74784542ab34 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542ab2d expref: 25 pid: 6528 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788459931.651727:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788459931.651733:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bedf6f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0cf73fe6-82e2-434e-b670-631647721b2c+25:3662:x1875336022232960:12345-0@lo:103: 00010000:00010000:0.0:1788459931.651740:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788459931.651744:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4bef209800/0x5dfa74784542abc7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542abc0 expref: 25 pid: 6525 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459931.651751:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4bef209800/0x5dfa74784542abc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5dfa74784542abc0 expref: 25 pid: 6525 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459931.651761:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4bef209800/0x5dfa74784542abc7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5dfa74784542abc0 expref: 25 pid: 6525 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788459931.651767:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788459931.651769:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788459931.651796:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bedf6f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0cf73fe6-82e2-434e-b670-631647721b2c+24:3662:x1875336022232960:12345-0@lo:103: Request processed in 63us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459931.651808:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788459931.651841:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022232832 00000100:00100000:0.0:1788459931.651844:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022232832 00010000:00010000:0.0:1788459931.651855:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4bef209400/0x5dfa74784542abe3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542abdc expref: 24 pid: 6528 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788459931.651867:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788459931.651873:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac2975500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0cf73fe6-82e2-434e-b670-631647721b2c+24:3659:x1875336022232704:12345-0@lo:103: 00010000:00010000:0.0:1788459931.651879:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788459931.651894:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4bc29d0200/0x5dfa74784542ac0d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542ac06 expref: 24 pid: 6528 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459931.651903:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4bc29d0200/0x5dfa74784542ac0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5dfa74784542ac06 expref: 24 pid: 6528 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459931.651913:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4bc29d0200/0x5dfa74784542ac0d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5dfa74784542ac06 expref: 24 pid: 6528 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459931.651921:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788459931.651927:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4397480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0cf73fe6-82e2-434e-b670-631647721b2c:3661:1875336022232576:0@lo:103: 00000100:00100000:0.0:1788459931.651964:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac2975500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0cf73fe6-82e2-434e-b670-631647721b2c+23:3659:x1875336022232704:12345-0@lo:103: Request processed in 92us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459931.651967:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac2974700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0cf73fe6-82e2-434e-b670-631647721b2c:3662:1875336022232960:0@lo:103: 00000100:00100000:0.0:1788459931.651971:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788459931.651983:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4396d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0cf73fe6-82e2-434e-b670-631647721b2c:3659:1875336022232704:0@lo:103: 00000100:00100000:0.0:1788459931.651983:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788459931.651989:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac2977480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0cf73fe6-82e2-434e-b670-631647721b2c+22:3659:x1875336022233216:12345-0@lo:103: 00010000:00010000:0.0:1788459931.651995:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788459931.652000:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4bc29d3800/0x5dfa74784542ab7a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542ab73 expref: 22 pid: 6525 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459931.652008:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4bc29d3800/0x5dfa74784542ab7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5dfa74784542ab73 expref: 22 pid: 6525 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459931.652023:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4bc29d3800/0x5dfa74784542ab7a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5dfa74784542ab73 expref: 22 pid: 6525 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459931.652032:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788459931.652071:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac2977480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0cf73fe6-82e2-434e-b670-631647721b2c+21:3659:x1875336022233216:12345-0@lo:103: Request processed in 82us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459931.652077:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788459931.652078:0:6518:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788459931.652085:0:6518:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1788459931.652088:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788459931.652093:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac2976680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0cf73fe6-82e2-434e-b670-631647721b2c+20:3659:x1875336022233344:12345-0@lo:103: 00010000:00010000:0.0:1788459931.652101:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788459931.652105:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4bef208400/0x5dfa74784542ab34 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542ab2d expref: 20 pid: 6528 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459931.652113:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4bef208400/0x5dfa74784542ab34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5dfa74784542ab2d expref: 20 pid: 6528 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459931.652123:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4bef208400/0x5dfa74784542ab34 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5dfa74784542ab2d expref: 20 pid: 6528 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459931.652131:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788459931.652151:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac2976680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0cf73fe6-82e2-434e-b670-631647721b2c+19:3659:x1875336022233344:12345-0@lo:103: Request processed in 57us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459931.652156:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788459931.652167:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788459931.652174:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac2976a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0cf73fe6-82e2-434e-b670-631647721b2c+18:3659:x1875336022232832:12345-0@lo:103: 00010000:00010000:1.0:1788459931.652186:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788459931.652192:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4bef209400/0x5dfa74784542abe3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542abdc expref: 18 pid: 6528 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459931.652201:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4bef209400/0x5dfa74784542abe3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5dfa74784542abdc expref: 18 pid: 6528 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788459931.652206:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac2976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0cf73fe6-82e2-434e-b670-631647721b2c:3659:1875336022233216:0@lo:103: 00010000:00010000:1.0:1788459931.652211:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4bef209400/0x5dfa74784542abe3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5dfa74784542abdc expref: 18 pid: 6528 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788459931.652213:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0cf73fe6-82e2-434e-b670-631647721b2c:3659:1875336022233344:0@lo:103: 00010000:00010000:1.0:1788459931.652219:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788459931.652247:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac2976a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0cf73fe6-82e2-434e-b670-631647721b2c+17:3659:x1875336022232832:12345-0@lo:103: Request processed in 74us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459931.652263:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac2974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0cf73fe6-82e2-434e-b670-631647721b2c:3659:1875336022232832:0@lo:103: 00010000:00010000:2.0:1788459931.652432:0:9536:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d3a00/0x5dfa74784542ab3b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542ab42 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459931.652439:0:9536:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788459931.652458:0:9536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d3a00/0x5dfa74784542ab3b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542ab42 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459931.652465:0:9536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d3a00/0x5dfa74784542ab3b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542ab42 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459931.652499:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788459931.652501:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788459931.652502:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788459931.652598:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0cf73fe6-82e2-434e-b670-631647721b2c:3660:1875336022233472:0@lo:103: 00000100:00100000:3.0:1788459931.652624:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459931.652669:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788459931.652671:0:6520:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788459931.652677:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022233472 00000100:00100000:0.0:1788459931.652680:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022233472 00010000:00010000:0.0:1788459931.652693:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4bc29d3000/0x5dfa74784542ab42 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542ab3b expref: 17 pid: 6528 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788459931.652788:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788459931.652797:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac2974e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0cf73fe6-82e2-434e-b670-631647721b2c+17:3660:x1875336022233472:12345-0@lo:103: 00010000:00010000:3.0:1788459931.652806:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788459931.652811:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4bc29d3000/0x5dfa74784542ab42 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542ab3b expref: 17 pid: 6528 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.652819:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4bc29d3000/0x5dfa74784542ab42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5dfa74784542ab3b expref: 17 pid: 6528 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.652829:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4bc29d3000/0x5dfa74784542ab42 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5dfa74784542ab3b expref: 17 pid: 6528 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.652840:0:6518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c4ac2841000/0x5dfa74784542ac76 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.652847:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4ac2841000/0x5dfa74784542ac76 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.652859:0:6518:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c4ac2841000/0x5dfa74784542ac76 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.652866:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c4ac2841000/0x5dfa74784542ac76 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.652873:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c4ac2841000/0x5dfa74784542ac76 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.652938:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c4ac2841000/0x5dfa74784542ac76 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.652968:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac2841000 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:3.0:1788459931.652973:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c4ac2841000/0x5dfa74784542ac76 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.652981:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c4ac2841000/0x5dfa74784542ac76 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.652996:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c4ac2841000/0x5dfa74784542ac76 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.653006:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788459931.653034:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac2974e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0cf73fe6-82e2-434e-b670-631647721b2c+16:3660:x1875336022233472:12345-0@lo:103: Request processed in 240us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459931.653041:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:3.0:1788459931.653146:0:6528:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c4ac2841000/0x5dfa74784542ac76 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.653154:0:6528:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c4ac2841000/0x5dfa74784542ac76 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.653160:0:6528:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4ac2841000/0x5dfa74784542ac76 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788459931.653171:0:6528:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788459931.654174:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0cf73fe6-82e2-434e-b670-631647721b2c:3660:1875336022233472:0@lo:103: 00000100:00100000:3.0:1788459931.655848:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd0a6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+15:9525:x1875336022231168:12345-0@lo:253: Request processed in 23305us (27044us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459931.655862:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788459931.656143:0:9525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:9525:1875336022231168:0@lo:253: 10000000:01000000:2.0:1788459931.656155:0:9525:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788459931.656158:0:9525:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788459931.656160:0:9525:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788459931.656161:0:9525:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788459931.656162:0:9525:0:(tgt_mount.c:1242:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1788459931.656163:0:9525:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788459931.656164:0:9525:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788459931.656166:0:9525:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788459931.656167:0:9525:0:(tgt_mount.c:1260:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788459931.656168:0:9525:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788459931.656169:0:9525:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788459931.656312:0:9525:0:(tgt_mount.c:115:server_register_mount()) register mount ffff8c4bfc4e5800 from lustre-OST0001 10000000:01000000:3.0:1788459931.656347:0:9525:0:(mgc_request.c:2423:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788459931.656350:0:9525:0:(mgc_request.c:424:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788459931.656356:0:9525:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8c4bfc4e5800 10000000:01000000:3.0:1788459931.656361:0:9525:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788459931.656377:0:9525:0:(mgc_request_server.c:106:mgc_fs_setup()) mgc192.168.206.105@tcp: setup lustre-OST0001-osd 00000040:01000000:3.0:1788459931.664168:0:9525:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.206.105@tcp ctxt 1 is initialized 00000040:01000000:2.0:1788459931.674012:0:9525:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.206.105@tcp ctxt 0 is initialized 10000000:01000000:2.0:1788459931.674031:0:9525:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-sptlrpc-ffff8c4bfc4e5800 from 1 10000000:01000000:2.0:1788459931.674034:0:9525:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788459931.674071:0:9525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6a00/0x5dfa74784542ac7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459931.674083:0:9525:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6a00/0x5dfa74784542ac7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459931.674093:0:9525:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6a00/0x5dfa74784542ac7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788459931.674113:0:9525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:9525:1875336022233600:0@lo:101: 00000100:00100000:2.0:1788459931.674173:0:9525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459931.674212:0:9525:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac25b3240 going to sleep for 11 seconds 00000100:00100000:1.0:1788459931.674371:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022233600 00000100:00100000:1.0:1788459931.674378:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022233600 00000100:00100000:1.0:1788459931.674436:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788459931.674446:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd0a6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+15:9525:x1875336022233600:12345-0@lo:101: 00010000:00010000:1.0:1788459931.674458:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788459931.674471:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4bc0030a00/0x5dfa74784542ac84 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542ac7d expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459931.674502:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bc0030a00/0x5dfa74784542ac84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542ac7d expref: 16 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459931.674519:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4bc0030a00/0x5dfa74784542ac84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542ac7d expref: 16 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459931.674528:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc0030a00, rc 0) 00000100:00100000:1.0:1788459931.674579:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd0a6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+16:9525:x1875336022233600:12345-0@lo:101: Request processed in 134us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459931.674586:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788459931.674782:0:9525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:9525:1875336022233600:0@lo:101: 00010000:00010000:3.0:1788459931.674847:0:9525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6a00/0x5dfa74784542ac7d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ac84 expref: -99 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.674857:0:9525:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6a00/0x5dfa74784542ac7d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542ac84 expref: -99 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788459931.674919:0:9525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac2976300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:9525:1875336022233728:0@lo:501: 00000100:00100000:3.0:1788459931.675037:0:9525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459931.675058:0:9525:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4c01849780 going to sleep for 11 seconds 00000100:00100000:1.0:1788459931.675072:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022233728 00000100:00100000:1.0:1788459931.675076:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022233728 00000100:00100000:1.0:1788459931.675109:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788459931.675116:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd0a6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+16:9525:x1875336022233728:12345-0@lo:501: 00000100:00100000:1.0:1788459931.675181:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd0a6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+16:9525:x1875336022233728:12345-0@lo:501: Request processed in 65us (144us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788459931.675188:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788459931.675260:0:9525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac2976300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:9525:1875336022233728:0@lo:501: 10000000:01000000:3.0:1788459931.675273:0:9525:0:(mgc_request_server.c:748:mgc_llog_local_copy()) mgc192.168.206.105@tcp: no remote llog for lustre-sptlrpc, check MGS config 00000100:00100000:3.0:1788459931.675302:0:9525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac2976300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:9525:1875336022233856:0@lo:501: 00000100:00100000:3.0:1788459931.675332:0:9525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459931.675398:0:9525:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4c01849780 going to sleep for 11 seconds 00000100:00100000:1.0:1788459931.675426:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022233856 00000100:00100000:1.0:1788459931.675430:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022233856 00000100:00100000:1.0:1788459931.675458:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788459931.675465:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd0a6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+16:9525:x1875336022233856:12345-0@lo:501: 00000100:00100000:1.0:1788459931.675566:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd0a6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+16:9525:x1875336022233856:12345-0@lo:501: Request processed in 101us (233us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788459931.675573:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788459931.675624:0:9525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac2976300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:9525:1875336022233856:0@lo:501: 10000000:01000000:3.0:1788459931.675641:0:9525:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788459931.675699:0:9525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6a00/0x5dfa74784542ac7d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ac84 expref: -99 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.675708:0:9525:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6a00/0x5dfa74784542ac7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ac84 expref: -99 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788459931.675727:0:9525:0:(mgc_request.c:206:do_config_log_add()) do adding config log params-ffff8c4bfc4e5800 10000000:01000000:3.0:1788459931.675732:0:9525:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788459931.675754:0:9525:0:(mgc_request_server.c:106:mgc_fs_setup()) mgc192.168.206.105@tcp: setup lustre-OST0001-osd 00000040:01000000:3.0:1788459931.675836:0:9525:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.206.105@tcp ctxt 1 is initialized 00000040:01000000:3.0:1788459931.675843:0:9525:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.206.105@tcp ctxt 0 is initialized 10000000:01000000:3.0:1788459931.675851:0:9525:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788459931.675855:0:9525:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788459931.675871:0:9525:0:(mgc_request_server.c:106:mgc_fs_setup()) mgc192.168.206.105@tcp: setup lustre-OST0001-osd 00000040:01000000:3.0:1788459931.675896:0:9525:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.206.105@tcp ctxt 1 is initialized 00000040:01000000:3.0:1788459931.675900:0:9525:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.206.105@tcp ctxt 0 is initialized 10000000:01000000:3.0:1788459931.675906:0:9525:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-mdtir-ffff8c4bfc4e5800 10000000:01000000:3.0:1788459931.675909:0:9525:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788459931.675936:0:9525:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788459931.675939:0:9525:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788459931.675988:0:9525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac2841000/0x5dfa74784542ac8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.675996:0:9525:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4ac2841000/0x5dfa74784542ac8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.676004:0:9525:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4ac2841000/0x5dfa74784542ac8b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788459931.676018:0:9525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac2976300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:9525:1875336022233984:0@lo:101: 00000100:00100000:3.0:1788459931.676046:0:9525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459931.676073:0:9525:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bf7753780 going to sleep for 11 seconds 00000100:00100000:2.0:1788459931.676493:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022233984 00000100:00100000:2.0:1788459931.676508:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022233984 00000100:00100000:2.0:1788459931.676655:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788459931.676664:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd0a6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+16:9525:x1875336022233984:12345-0@lo:101: 00010000:00010000:2.0:1788459931.676674:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788459931.676685:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4bfadc7800/0x5dfa74784542ac92 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542ac8b expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459931.676706:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bfadc7800/0x5dfa74784542ac92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542ac8b expref: 17 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459931.676716:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4bfadc7800/0x5dfa74784542ac92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542ac8b expref: 17 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459931.676725:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bfadc7800, rc 0) 00000100:00100000:2.0:1788459931.676769:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd0a6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+17:9525:x1875336022233984:12345-0@lo:101: Request processed in 107us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459931.676776:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788459931.676870:0:9525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac2976300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:9525:1875336022233984:0@lo:101: 00010000:00010000:3.0:1788459931.676883:0:9525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4ac2841000/0x5dfa74784542ac8b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ac92 expref: -99 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.676898:0:9525:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4ac2841000/0x5dfa74784542ac8b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542ac92 expref: -99 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788459931.676981:0:9525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac2976300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:9525:1875336022234112:0@lo:501: 00000100:00100000:3.0:1788459931.677008:0:9525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459931.677038:0:9525:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bf7753780 going to sleep for 11 seconds 00000100:00100000:1.0:1788459931.677333:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022234112 00000100:00100000:1.0:1788459931.677338:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022234112 00000100:00100000:1.0:1788459931.677373:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788459931.677381:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd0a6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+17:9525:x1875336022234112:12345-0@lo:501: 00000100:00100000:1.0:1788459931.677514:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd0a6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+17:9525:x1875336022234112:12345-0@lo:501: Request processed in 134us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459931.677529:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788459931.677586:0:9525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac2976300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:9525:1875336022234112:0@lo:501: 00000100:00100000:3.0:1788459931.677625:0:9525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac2976300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:9525:1875336022234240:0@lo:503: 00000100:00100000:3.0:1788459931.677661:0:9525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459931.677753:0:9525:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bf7753780 going to sleep for 11 seconds 00000100:00100000:2.0:1788459931.677862:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022234240 00000100:00100000:2.0:1788459931.677867:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022234240 00000100:00100000:2.0:1788459931.678023:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788459931.678031:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd0a6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+17:9525:x1875336022234240:12345-0@lo:503: 00000100:00100000:2.0:1788459931.678120:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd0a6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+17:9525:x1875336022234240:12345-0@lo:503: Request processed in 90us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459931.678127:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788459931.678210:0:9525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac2976300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:9525:1875336022234240:0@lo:503: 00000040:00080000:3.0:1788459931.678429:0:9525:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788459931.678521:0:9525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac2976300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:9525:1875336022234368:0@lo:502: 00000100:00100000:3.0:1788459931.678560:0:9525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459931.678590:0:9525:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bf7753780 going to sleep for 11 seconds 00000100:00100000:1.0:1788459931.678662:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022234368 00000100:00100000:1.0:1788459931.678667:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022234368 00000100:00100000:1.0:1788459931.678698:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788459931.678705:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+17:9525:x1875336022234368:12345-0@lo:502: 00000100:00100000:1.0:1788459931.678784:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+17:9525:x1875336022234368:12345-0@lo:502: Request processed in 78us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459931.678791:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788459931.678864:0:9525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac2976300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:9525:1875336022234368:0@lo:502: 00000040:00080000:3.0:1788459931.679240:0:9525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788459931.679263:0:9525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1788459931.679285:0:9525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1788459931.679298:0:9525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1788459931.679309:0:9525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1788459931.679319:0:9525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1788459931.679339:0:9525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac2976300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:9525:1875336022234496:0@lo:502: 00000100:00100000:3.0:1788459931.679373:0:9525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459931.679442:0:9525:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bf7753780 going to sleep for 11 seconds 00000100:00100000:2.0:1788459931.679476:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022234496 00000100:00100000:2.0:1788459931.679495:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022234496 00000100:00100000:2.0:1788459931.679528:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788459931.679535:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+17:9525:x1875336022234496:12345-0@lo:502: 00000100:00100000:2.0:1788459931.679651:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+17:9525:x1875336022234496:12345-0@lo:502: Request processed in 116us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459931.679664:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788459931.679783:0:9525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac2976300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:9525:1875336022234496:0@lo:502: 00000040:00080000:3.0:1788459931.679890:0:9525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1788459931.679897:0:9525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:0.0:1788459931.680376:0:9539:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788459931.680384:0:9539:0:(obd_mount.c:1049:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:0.0:1788459931.680390:0:9539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788459931.680392:0:9539:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1788459931.680397:0:9539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788459931.680475:0:9539:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8c4c019a0000) 00000020:00000080:0.0:1788459931.680506:0:9539:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788459931.680513:0:9539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788459931.680706:0:9539:0:(tgt_mount.c:167:server_get_mount()) get mount ffff8c4bfc4e5800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1788459931.680714:0:9539:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788459931.680720:0:9539:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x5dfa74784542aca0 00010000:00010000:0.0:1788459931.689234:0:9539:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:0.0:1788459931.689678:0:9539:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:0.0:1788459931.692770:0:9539:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1788459931.693300:0:9539:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1788459931.699535:0:9539:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:1.0:1788459931.699805:0:9539:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:1.0:1788459931.708363:0:9539:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:2.0:1788459931.709707:0:9539:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1788459931.709717:0:9539:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788459931.709722:0:9539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788459931.709724:0:9539:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1788459931.709728:0:9539:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788459931.709732:0:9539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788459931.709733:0:9539:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788459931.709736:0:9539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788459931.709738:0:9539:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788459931.709758:0:9539:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788459931.709761:0:9539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788459931.709762:0:9539:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788459931.709765:0:9539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1788459931.710165:0:9525:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1788459931.710178:0:9525:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788459931.710200:0:9525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac2841000/0x5dfa74784542ac8b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ac92 expref: -99 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.710211:0:9525:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4ac2841000/0x5dfa74784542ac8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ac92 expref: -99 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788459931.710220:0:9525:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-mdtir-ffff8c4bfc4e5800 from 1 10000000:01000000:3.0:1788459931.710223:0:9525:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788459931.710253:0:9525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac2841c00/0x5dfa74784542aca7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.710260:0:9525:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4ac2841c00/0x5dfa74784542aca7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.710269:0:9525:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4ac2841c00/0x5dfa74784542aca7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788459931.710288:0:9525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac2976300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:9525:1875336022234624:0@lo:101: 00000100:00100000:3.0:1788459931.710343:0:9525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459931.710376:0:9525:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bf7753780 going to sleep for 11 seconds 00000100:00100000:0.0:1788459931.711266:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022234624 00000100:00100000:0.0:1788459931.711274:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022234624 00000100:00100000:0.0:1788459931.711320:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788459931.711329:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd0a6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+17:9525:x1875336022234624:12345-0@lo:101: 00010000:00010000:0.0:1788459931.711344:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788459931.711357:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4bef208400/0x5dfa74784542acae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542aca7 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459931.711379:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bef208400/0x5dfa74784542acae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542aca7 expref: 18 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459931.711390:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4bef208400/0x5dfa74784542acae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542aca7 expref: 18 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459931.711410:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bef208400, rc 0) 00000100:00100000:0.0:1788459931.711469:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd0a6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+18:9525:x1875336022234624:12345-0@lo:101: Request processed in 140us (1125us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459931.711476:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788459931.713702:0:9525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac2976300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:9525:1875336022234624:0@lo:101: 00010000:00010000:3.0:1788459931.713728:0:9525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4ac2841c00/0x5dfa74784542aca7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542acae expref: -99 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.713750:0:9525:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4ac2841c00/0x5dfa74784542aca7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542acae expref: -99 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788459931.714336:0:9525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac2976300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:9525:1875336022234752:0@lo:256: 00000100:00100000:3.0:1788459931.714391:0:9525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459931.714433:0:9525:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bf7753780 going to sleep for 11 seconds 00000100:00100000:1.0:1788459931.714828:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022234752 00000100:00100000:1.0:1788459931.714835:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022234752 00000100:00100000:1.0:1788459931.714973:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788459931.714984:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+18:9525:x1875336022234752:12345-0@lo:256: 20000000:01000000:1.0:1788459931.715068:0:6525:0:(mgs_nids.c:1209:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788459931.715085:0:6525:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788459931.715089:0:6525:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788459931.715092:0:6525:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788459931.715094:0:6525:0:(mgs_nids.c:325:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1788459931.715188:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+18:9525:x1875336022234752:12345-0@lo:256: Request processed in 206us (796us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459931.715195:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788459931.715435:0:9525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac2976300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:9525:1875336022234752:0@lo:256: 10000000:01000000:3.0:1788459931.716374:0:9525:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788459931.716388:0:9525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac2841c00/0x5dfa74784542aca7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542acae expref: -99 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.716465:0:9525:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4ac2841c00/0x5dfa74784542aca7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542acae expref: -99 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788459931.716474:0:9525:0:(mgc_request.c:2266:mgc_process_log()) Process log params-ffff8c4bfc4e5800 from 1 10000000:01000000:3.0:1788459931.716476:0:9525:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788459931.717626:0:9525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac2841600/0x5dfa74784542acb5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.717637:0:9525:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4ac2841600/0x5dfa74784542acb5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.717646:0:9525:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4ac2841600/0x5dfa74784542acb5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788459931.717664:0:9525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac2976300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:9525:1875336022234880:0@lo:101: 00000100:00100000:3.0:1788459931.717860:0:9525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459931.719266:0:9525:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bf7753780 going to sleep for 11 seconds 00000100:00100000:0.0:1788459931.719334:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022234880 00000100:00100000:0.0:1788459931.719342:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022234880 00000100:00100000:0.0:1788459931.719391:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788459931.719508:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+18:9525:x1875336022234880:12345-0@lo:101: 00010000:00010000:0.0:1788459931.719525:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788459931.719540:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4bef209800/0x5dfa74784542acbc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542acb5 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459931.719563:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bef209800/0x5dfa74784542acbc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542acb5 expref: 19 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459931.719574:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4bef209800/0x5dfa74784542acbc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542acb5 expref: 19 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459931.719582:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bef209800, rc 0) 00000100:00100000:0.0:1788459931.719672:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+19:9525:x1875336022234880:12345-0@lo:101: Request processed in 272us (1811us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459931.719679:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788459931.720086:0:9525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac2976300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:9525:1875336022234880:0@lo:101: 00010000:00010000:3.0:1788459931.720102:0:9525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4ac2841600/0x5dfa74784542acb5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542acbc expref: -99 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.720112:0:9525:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4ac2841600/0x5dfa74784542acb5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542acbc expref: -99 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788459931.720181:0:9525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac2976300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:9525:1875336022235008:0@lo:501: 00000100:00100000:3.0:1788459931.720209:0:9525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459931.720241:0:9525:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bf7753780 going to sleep for 11 seconds 00000100:00100000:2.0:1788459931.720248:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022235008 00000100:00100000:2.0:1788459931.720253:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022235008 00000100:00100000:2.0:1788459931.720280:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788459931.720287:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+19:9525:x1875336022235008:12345-0@lo:501: 00000100:00100000:2.0:1788459931.720388:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+19:9525:x1875336022235008:12345-0@lo:501: Request processed in 100us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459931.720394:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788459931.720458:0:9525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac2976300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:9525:1875336022235008:0@lo:501: 00000100:00100000:3.0:1788459931.720495:0:9525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac2976300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:9525:1875336022235136:0@lo:503: 00000100:00100000:3.0:1788459931.720532:0:9525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459931.720593:0:9525:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bf7753780 going to sleep for 11 seconds 00000100:00100000:0.0:1788459931.720633:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022235136 00000100:00100000:0.0:1788459931.720637:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022235136 00000100:00100000:0.0:1788459931.720697:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788459931.720705:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+19:9525:x1875336022235136:12345-0@lo:503: 00000100:00100000:0.0:1788459931.720785:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+19:9525:x1875336022235136:12345-0@lo:503: Request processed in 81us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459931.720798:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788459931.720866:0:9525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac2976300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:9525:1875336022235136:0@lo:503: 00000040:00080000:2.0:1788459931.721108:0:9525:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788459931.721171:0:9525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:9525:1875336022235264:0@lo:502: 00000100:00100000:2.0:1788459931.721204:0:9525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459931.721233:0:9525:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc65d6540 going to sleep for 11 seconds 00000100:00100000:0.0:1788459931.721337:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022235264 00000100:00100000:0.0:1788459931.721341:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022235264 00000100:00100000:0.0:1788459931.721369:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788459931.721375:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+19:9525:x1875336022235264:12345-0@lo:502: 00000100:00100000:0.0:1788459931.721571:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+19:9525:x1875336022235264:12345-0@lo:502: Request processed in 194us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459931.721578:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788459931.721724:0:9525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:9525:1875336022235264:0@lo:502: 00000040:00080000:2.0:1788459931.722015:0:9525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1788459931.722050:0:9525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1788459931.722073:0:9525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:9525:1875336022235392:0@lo:502: 00000100:00100000:2.0:1788459931.722109:0:9525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459931.722140:0:9525:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc65d6540 going to sleep for 11 seconds 00000100:00100000:3.0:1788459931.722231:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022235392 00000100:00100000:3.0:1788459931.722235:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022235392 00000100:00100000:3.0:1788459931.722259:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788459931.722270:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+19:9525:x1875336022235392:12345-0@lo:502: 00000100:00100000:3.0:1788459931.722369:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+19:9525:x1875336022235392:12345-0@lo:502: Request processed in 100us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459931.722374:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788459931.722428:0:9525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:9525:1875336022235392:0@lo:502: 00000040:00080000:2.0:1788459931.722463:0:9525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1788459931.722470:0:9525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1788459931.722871:0:9543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788459931.723036:0:9543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788459931.723039:0:9543:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788459931.723048:0:9543:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c4bfc4e5800 00000020:00000080:0.0:1788459931.723050:0:9543:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788459931.723064:0:9543:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788459931.723067:0:9543:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788459931.723068:0:9543:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788459931.723071:0:9543:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1788459931.723203:0:9525:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788459931.723211:0:9525:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788459931.723226:0:9525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac2841600/0x5dfa74784542acb5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542acbc expref: -99 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459931.723236:0:9525:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4ac2841600/0x5dfa74784542acb5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542acbc expref: -99 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788459931.723283:0:9525:0:(mgc_request.c:2423:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788459931.723286:0:9525:0:(mgc_request.c:424:config_log_add()) add config log lustre-client-ffff8c4bfc4e5800 10000000:01000000:2.0:1788459931.723288:0:9525:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-client-ffff8c4bfc4e5800 10000000:01000000:2.0:1788459931.723292:0:9525:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788459931.723306:0:9525:0:(mgc_request_server.c:106:mgc_fs_setup()) mgc192.168.206.105@tcp: setup lustre-OST0001-osd 00000040:01000000:2.0:1788459931.723342:0:9525:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.206.105@tcp ctxt 1 is initialized 00000040:01000000:2.0:1788459931.723350:0:9525:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.206.105@tcp ctxt 0 is initialized 10000000:01000000:2.0:1788459931.723361:0:9525:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-client-ffff8c4bfc4e5800 from 1 10000000:01000000:2.0:1788459931.723364:0:9525:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788459931.723388:0:9525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7400/0x5dfa74784542acc3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459931.723396:0:9525:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7400/0x5dfa74784542acc3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459931.723416:0:9525:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7400/0x5dfa74784542acc3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788459931.723431:0:9525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:9525:1875336022235520:0@lo:101: 00000100:00100000:2.0:1788459931.723468:0:9525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459931.723544:0:9525:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc65d6cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788459931.723576:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022235520 00000100:00100000:1.0:1788459931.723582:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022235520 00000100:00100000:1.0:1788459931.723647:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788459931.723656:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+19:9525:x1875336022235520:12345-0@lo:101: 00010000:00010000:1.0:1788459931.723675:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788459931.723687:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4bc0031c00/0x5dfa74784542acca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542acc3 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459931.723707:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bc0031c00/0x5dfa74784542acca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542acc3 expref: 20 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459931.723718:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4bc0031c00/0x5dfa74784542acca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542acc3 expref: 20 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459931.723726:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc0031c00, rc 0) 00000100:00100000:1.0:1788459931.723766:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+20:9525:x1875336022235520:12345-0@lo:101: Request processed in 111us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459931.723773:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788459931.723831:0:9525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:9525:1875336022235520:0@lo:101: 00010000:00010000:2.0:1788459931.723843:0:9525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7400/0x5dfa74784542acc3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542acca expref: -99 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459931.723852:0:9525:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7400/0x5dfa74784542acc3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542acca expref: -99 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788459931.723909:0:9525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:9525:1875336022235648:0@lo:501: 00000100:00100000:2.0:1788459931.723932:0:9525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459931.724122:0:9525:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc65d6cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788459931.724191:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022235648 00000100:00100000:0.0:1788459931.724195:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022235648 00000100:00100000:0.0:1788459931.724218:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788459931.724224:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+20:9525:x1875336022235648:12345-0@lo:501: 00000100:00100000:0.0:1788459931.724356:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+20:9525:x1875336022235648:12345-0@lo:501: Request processed in 131us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459931.724373:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788459931.724446:0:9525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:9525:1875336022235648:0@lo:501: 00000100:00100000:2.0:1788459931.724471:0:9525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:9525:1875336022235776:0@lo:503: 00000100:00100000:2.0:1788459931.724520:0:9525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459931.724573:0:9525:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc65d6cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788459931.724601:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022235776 00000100:00100000:3.0:1788459931.724605:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022235776 00000100:00100000:0.0:1788459931.724645:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788459931.724652:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+20:9525:x1875336022235776:12345-0@lo:503: 00000100:00100000:0.0:1788459931.724727:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+20:9525:x1875336022235776:12345-0@lo:503: Request processed in 75us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459931.724740:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788459931.724802:0:9525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:9525:1875336022235776:0@lo:503: 00000040:00080000:2.0:1788459931.725079:0:9525:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788459931.725141:0:9525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:9525:1875336022235904:0@lo:502: 00000100:00100000:2.0:1788459931.725174:0:9525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459931.725197:0:9525:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc65d6cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788459931.725262:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022235904 00000100:00100000:1.0:1788459931.725266:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022235904 00000100:00100000:1.0:1788459931.725299:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788459931.725305:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+20:9525:x1875336022235904:12345-0@lo:502: 00000100:00100000:1.0:1788459931.725378:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+20:9525:x1875336022235904:12345-0@lo:502: Request processed in 73us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459931.725385:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788459931.725501:0:9525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:9525:1875336022235904:0@lo:502: 00000040:00080000:2.0:1788459931.725657:0:9525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788459931.725691:0:9525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788459931.725706:0:9525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788459931.725720:0:9525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788459931.725732:0:9525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788459931.725744:0:9525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788459931.725756:0:9525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788459931.725769:0:9525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788459931.725781:0:9525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788459931.725793:0:9525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788459931.725806:0:9525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788459931.725817:0:9525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788459931.725829:0:9525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788459931.725841:0:9525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788459931.725853:0:9525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788459931.725864:0:9525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788459931.726035:0:9525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788459931.726066:0:9525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788459931.726082:0:9525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788459931.726093:0:9525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788459931.726105:0:9525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788459931.726118:0:9525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788459931.726130:0:9525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788459931.726143:0:9525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788459931.726159:0:9525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1788459931.726172:0:9525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1788459931.726186:0:9525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1788459931.726200:0:9525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:2.0:1788459931.726215:0:9525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1788459931.726230:0:9525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:2.0:1788459931.726245:0:9525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:2.0:1788459931.726270:0:9525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:2.0:1788459931.726285:0:9525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:2.0:1788459931.726312:0:9525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:2.0:1788459931.726328:0:9525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:2.0:1788459931.726342:0:9525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:2.0:1788459931.726357:0:9525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:2.0:1788459931.726377:0:9525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:2.0:1788459931.726393:0:9525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:2.0:1788459931.726404:0:9525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:2.0:1788459931.726417:0:9525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:2.0:1788459931.726429:0:9525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:2.0:1788459931.726441:0:9525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:2.0:1788459931.726453:0:9525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:2.0:1788459931.726465:0:9525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:2.0:1788459931.726476:0:9525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:2.0:1788459931.726515:0:9525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:9525:1875336022236032:0@lo:502: 00000100:00100000:2.0:1788459931.726559:0:9525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459931.726594:0:9525:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc65d6cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788459931.726649:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022236032 00000100:00100000:1.0:1788459931.726655:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022236032 00000100:00100000:1.0:1788459931.726690:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788459931.726697:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+20:9525:x1875336022236032:12345-0@lo:502: 00000100:00100000:1.0:1788459931.726788:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+20:9525:x1875336022236032:12345-0@lo:502: Request processed in 91us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459931.726794:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788459931.726890:0:9525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:9525:1875336022236032:0@lo:502: 00000040:00080000:0.0:1788459931.726935:0:9525:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:0.0:1788459931.726974:0:9525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:0.0:1788459931.728026:0:9544:0:(obd_mount.c:308:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788459931.728044:0:9544:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8c4c019a4c98) 00000020:00000080:0.0:1788459931.728065:0:9544:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:0.0:1788459931.728130:0:9544:0:(tgt_mount.c:167:server_get_mount()) get mount ffff8c4bfc4e5800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788459931.728134:0:9544:0:(tgt_mount.c:201:server_put_mount()) put mount ffff8c4bfc4e5800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788459931.728137:0:9544:0:(obd_mount.c:798:lustre_put_lsi()) put ffff8c4bfc4e5800 3 00010000:00080000:0.0:1788459931.728173:0:9544:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c4ac2be5800@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.105@tcp at head 00010000:00010000:0.0:1788459931.730234:0:9544:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:0.0:1788459931.730409:0:9544:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1788459931.730577:0:9544:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788459931.730587:0:9544:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x5dfa74784542acd8 00000100:00080000:0.0:1788459931.730596:0:9544:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788459931.730601:0:9544:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8c4ac2be5800 using connection 192.168.206.105@tcp/0@lo 00000100:00100000:0.0:1788459931.730631:0:9544:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4bf7713100 x1875336022236160/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788459931.730696:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf7713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1875336022236160:0@lo:38: 00000100:00100000:3.0:1788459931.730768:0:3658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459931.730847:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022236160 00000100:00100000:2.0:1788459931.730855:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022236160 00000100:00100000:2.0:1788459931.730895:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788459931.730902:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac2974700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3658:x1875336022236160:12345-0@lo:38: 00010000:00080000:2.0:1788459931.730924:0:6533:0:(ldlm_lib.c:1461:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 228 last 0 00000020:00000080:2.0:1788459931.730993:0:6533:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x5dfa74784542acdf 00000004:00100000:2.0:1788459931.731006:0:6533:0:(mdt_handler.c:7310:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788459931.731031:0:6533:0:(import.c:65:import_set_state_nolock()) ffff8c4ac2a1c800 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1788459931.731122:0:9544:0:(pinger.c:380:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788459931.732285:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac2974700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1875336022236160:12345-0@lo:38: Request processed in 1377us (1522us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459931.732296:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788459931.732364:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4bf7713100 x1875336022236160/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788459941 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788459931.732381:0:3658:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788459931.732390:0:3658:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1788459931.732399:0:3658:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788459931.732403:0:3658:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788459931.732406:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c4ac2be5800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788459931.732412:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf7713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1875336022236160:0@lo:38: 00000100:00100000:2.0:1788459931.732554:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac2975f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875336022236288:0@lo:400: 00000100:00100000:2.0:1788459931.732605:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459931.733096:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac2976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022236416:0@lo:400: 00000100:00100000:1.0:1788459931.733130:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459931.733985:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac383b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3661:1875336022236800:0@lo:400: 00000100:00100000:2.0:1788459931.734023:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459931.734044:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788459931.734049:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3839f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1875336022236928:0@lo:400: 00000100:00100000:2.0:1788459931.734068:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459931.734097:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022236288 00000100:00100000:2.0:1788459931.734103:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022236288 00000100:00100000:2.0:1788459931.734138:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022236800 00000100:00100000:2.0:1788459931.734141:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022236800 00000100:00100000:2.0:1788459931.734162:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022236928 00000100:00100000:2.0:1788459931.734164:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022236928 00000100:00100000:2.0:1788459931.734179:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788459931.734186:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf75e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1875336022236288:12345-0@lo:400: 00000100:00100000:2.0:1788459931.734228:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf75e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1875336022236288:12345-0@lo:400: Request processed in 42us (1622us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459931.734236:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788459931.734250:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788459931.734256:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf75e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1875336022236800:12345-0@lo:400: 00000100:00100000:2.0:1788459931.734281:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf75e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1875336022236800:12345-0@lo:400: Request processed in 25us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459931.734391:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3839c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022236672:0@lo:400: 00000100:00100000:3.0:1788459931.734420:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459931.734440:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac383aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022237184:0@lo:400: 00000100:00100000:3.0:1788459931.734461:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459931.734495:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788459931.734502:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac2976d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3660:1875336022236544:0@lo:400: 00000100:00100000:3.0:1788459931.734523:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459931.734535:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3838e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022237056:0@lo:400: 00000100:00100000:3.0:1788459931.734552:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459931.734577:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022236416 00000100:00100000:3.0:1788459931.734581:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022236416 00000100:00100000:3.0:1788459931.734601:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022236672 00000100:00100000:3.0:1788459931.734603:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022236672 00000100:00100000:3.0:1788459931.734615:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788459931.734620:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac1e61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022236416:12345-0@lo:400: 00000100:00100000:3.0:1788459931.734651:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac1e61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022236416:12345-0@lo:400: Request processed in 31us (1521us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459931.734657:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788459931.734670:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788459931.734681:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3838700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022236672:12345-0@lo:400: 00000100:00100000:3.0:1788459931.734711:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3838700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022236672:12345-0@lo:400: Request processed in 30us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459931.734716:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788459931.734735:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022237184 00000100:00100000:3.0:1788459931.734738:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022237184 00000100:00100000:3.0:1788459931.734758:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022237056 00000100:00100000:3.0:1788459931.734761:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022237056 00000100:00100000:3.0:1788459931.734776:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788459931.734782:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac383a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022237184:12345-0@lo:400: 00000100:00100000:3.0:1788459931.734810:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac383a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022237184:12345-0@lo:400: Request processed in 28us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459931.734816:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788459931.734826:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788459931.734831:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac383b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022237056:12345-0@lo:400: 00000100:00100000:3.0:1788459931.734856:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac383b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022237056:12345-0@lo:400: Request processed in 25us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459931.734861:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788459931.734966:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788459931.734981:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022236544 00000100:00100000:2.0:1788459931.734984:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022236544 00000100:00100000:2.0:1788459931.734999:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788459931.735004:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf75e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1875336022236928:12345-0@lo:400: 00000100:00080000:0.0:1788459931.735005:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788459931.735009:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788459931.735011:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788459931.735024:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788459931.735032:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac383a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1875336022236544:12345-0@lo:400: 00000100:00100000:2.0:1788459931.735033:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf75e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1875336022236928:12345-0@lo:400: Request processed in 30us (965us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459931.735045:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788459931.735061:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac383a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1875336022236544:12345-0@lo:400: Request processed in 31us (537us total) trans 0 rc 0/0 00010000:00080000:2.0:1788459931.735075:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4ac3839f80 x1875336022236928/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788459947 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788459931.735075:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788459931.735087:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3839f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1875336022236928:0@lo:400: 00010000:00080000:2.0:1788459931.735098:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4ac383b800 x1875336022236800/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788459947 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788459931.735105:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac383b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3661:1875336022236800:0@lo:400: 00010000:00080000:2.0:1788459931.735115:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4ac2975f80 x1875336022236288/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788459947 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788459931.735123:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac2975f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875336022236288:0@lo:400: 00010000:00080000:3.0:1788459931.735800:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4ac2976d80 x1875336022236544/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788459947 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788459931.735812:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac2976d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3660:1875336022236544:0@lo:400: 00010000:00080000:3.0:1788459931.735822:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4ac3838e00 x1875336022237056/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788459947 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788459931.735830:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3838e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022237056:0@lo:400: 00000100:00100000:3.0:1788459931.735840:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3839c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022236672:0@lo:400: 00010000:00080000:3.0:1788459931.735848:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4ac383aa00 x1875336022237184/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788459947 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788459931.735863:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac383aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022237184:0@lo:400: 00000100:00100000:3.0:1788459931.735999:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac2976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022236416:0@lo:400: 00000020:01000004:1.0:1788459931.736608:0:9544:0:(obd_mount.c:308:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788459931.736623:0:9544:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8c4ac1ef4c98) 00000020:00000080:1.0:1788459931.736656:0:9544:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:1.0:1788459931.736731:0:9544:0:(tgt_mount.c:167:server_get_mount()) get mount ffff8c4bfc4e5800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788459931.736735:0:9544:0:(tgt_mount.c:201:server_put_mount()) put mount ffff8c4bfc4e5800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788459931.736738:0:9544:0:(obd_mount.c:798:lustre_put_lsi()) put ffff8c4bfc4e5800 3 00010000:00080000:1.0:1788459931.736775:0:9544:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c4ac3845000@lustre-MDT0001-lwp-OST0001: add connection 192.168.206.105@tcp at head 00000100:00100000:3.0:1788459931.738045:0:9545:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac383aa00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9545:1875336022237312:0@lo:901: 00000100:00100000:3.0:1788459931.738100:0:9545:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459931.738125:0:9545:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bf7753840 going to sleep for 11 seconds 00000100:00100000:2.0:1788459931.738316:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022237312 00000100:00100000:2.0:1788459931.738323:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022237312 00010000:00010000:1.0:1788459931.738330:0:9544:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000100:00100000:2.0:1788459931.738395:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788459931.738406:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3839c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9545:x1875336022237312:12345-0@lo:901: 00000100:00080000:3.0:1788459931.738418:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788459931.738521:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3839c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9545:x1875336022237312:12345-0@lo:901: Request processed in 117us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459931.738530:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000020:00000080:1.0:1788459931.738539:0:9544:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1788459931.738574:0:9544:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788459931.738584:0:9544:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x5dfa74784542aced 00000100:00080000:1.0:1788459931.738591:0:9544:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788459931.738596:0:9544:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8c4ac3845000 using connection 192.168.206.105@tcp/0@lo 00000100:00100000:1.0:1788459931.738617:0:9544:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4ac1e61880 x1875336022237440/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788459931.738642:0:9544:0:(pinger.c:380:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00010000:00080000:3.0:1788459931.738648:0:9545:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4ac383aa00 x1875336022237312/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788459947 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788459931.738660:0:9545:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac383aa00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9545:1875336022237312:0@lo:901: 00000100:00100000:2.0:1788459931.738854:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3658:1875336022237440:0@lo:38: 00000100:00100000:2.0:1788459931.738889:0:3658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459931.739049:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022237440 00000100:00100000:3.0:1788459931.739055:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022237440 00000100:00100000:3.0:1788459931.739153:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788459931.739159:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf75e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3658:x1875336022237440:12345-0@lo:38: 00010000:00080000:3.0:1788459931.739179:0:6535:0:(ldlm_lib.c:1461:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 228 last 0 00000020:00000080:3.0:1788459931.739215:0:6535:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x5dfa74784542acf4 00000004:00100000:3.0:1788459931.739228:0:6535:0:(mdt_handler.c:7310:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788459931.739258:0:6535:0:(import.c:65:import_set_state_nolock()) ffff8c4ac2bb1000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788459931.739354:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf75e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1875336022237440:12345-0@lo:38: Request processed in 193us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459931.739361:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788459931.739414:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4ac1e61880 x1875336022237440/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788459941 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788459931.739423:0:3658:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788459931.739429:0:3658:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1788459931.739435:0:3658:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788459931.739446:0:3658:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788459931.739448:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c4ac3845000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788459931.739454:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3658:1875336022237440:0@lo:38: 00000040:00080000:2.0:1788459931.742082:0:9544:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:1.0:1788459931.742526:0:9525:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:1.0:1788459931.742539:0:9525:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788459931.742552:0:9525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7400/0x5dfa74784542acc3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542acca expref: -99 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459931.742562:0:9525:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7400/0x5dfa74784542acc3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542acca expref: -99 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788459931.742617:0:9525:0:(tgt_mount.c:1239:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788459931.742619:0:9525:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788459931.742620:0:9525:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788459931.742626:0:9525:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:1.0:1788459931.742627:0:9525:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:1.0:1788459931.742628:0:9525:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:1.0:1788459931.742629:0:9525:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788459931.742631:0:9525:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788459931.742632:0:9525:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788459931.742634:0:9525:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788459931.742635:0:9525:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788459931.742638:0:9525:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1788459931.742640:0:9525:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788459931.742641:0:9525:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788459931.742642:0:9525:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788459931.742643:0:9525:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:1.0:1788459931.742644:0:9525:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:1.0:1788459931.742645:0:9525:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:1.0:1788459931.742646:0:9525:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788459931.742647:0:9525:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788459931.742648:0:9525:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788459931.742648:0:9525:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788459931.742649:0:9525:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788459931.742671:0:9525:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788459931.742687:0:9525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e60a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:9525:1875336022237568:0@lo:253: 00000100:00100000:1.0:1788459931.742746:0:9525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459931.743352:0:9525:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bfa298e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788459931.743635:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022237568 00000100:00100000:3.0:1788459931.743643:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022237568 00000100:00100000:3.0:1788459931.743692:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788459931.743700:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+20:9525:x1875336022237568:12345-0@lo:253: 20000000:01000000:3.0:1788459931.743734:0:6525:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788459931.743746:0:6525:0:(mgs_nids.c:475:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788459931.753099:0:6525:0:(mgs_nids.c:842:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788459931.753118:0:6525:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788459931.753437:0:6549:0:(mgs_nids.c:739:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788459931.753505:0:6549:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788459931.753526:0:6549:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c4bfadc7600/0x5dfa74784542acfb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459931.753542:0:6549:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4bc29d2a00/0x5dfa74784542abb9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542abb2 expref: 20 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459931.753551:0:6549:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4bc29d1e00/0x5dfa74784542abd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542abce expref: 20 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459931.753558:0:6549:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4bc29d0c00/0x5dfa74784542ac29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542ac22 expref: 20 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459931.753575:0:6549:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4bef208400/0x5dfa74784542acae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542aca7 expref: 20 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459931.753583:0:6549:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c4bfadc7600/0x5dfa74784542acfb lrc: 7/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788459931.753610:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+20:9525:x1875336022237568:12345-0@lo:253: Request processed in 9908us (10861us total) trans 0 rc 0/0 00010000:00010000:2.0:1788459931.753619:0:6549:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4bef208400/0x5dfa74784542acae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5dfa74784542aca7 expref: 20 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788459931.753624:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00010000:00010000:2.0:1788459931.753639:0:6549:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c4bef208400/0x5dfa74784542acae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5dfa74784542aca7 expref: 20 pid: 6526 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788459931.753653:0:6549:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e2680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6549:1875336022237696:0@lo:104: 00000100:00100000:1.0:1788459931.753722:0:9525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e60a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0cf73fe6-82e2-434e-b670-631647721b2c:9525:1875336022237568:0@lo:253: 10000000:01000000:1.0:1788459931.753735:0:9525:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788459931.753738:0:9525:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788459931.753740:0:9525:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788459931.753741:0:9525:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788459931.753742:0:9525:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:1.0:1788459931.753743:0:9525:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:1.0:1788459931.753745:0:9525:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:1.0:1788459931.753746:0:9525:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788459931.753748:0:9525:0:(tgt_mount.c:1256:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788459931.753749:0:9525:0:(tgt_mount.c:1258:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788459931.753751:0:9525:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788459931.753752:0:9525:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788459931.753765:0:9525:0:(tgt_mount.c:2880:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1788459931.753775:0:6549:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788459931.753823:0:6549:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4bc29d0c00/0x5dfa74784542ac29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5dfa74784542ac22 expref: 19 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459931.753833:0:6549:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c4bc29d0c00/0x5dfa74784542ac29 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5dfa74784542ac22 expref: 19 pid: 6526 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788459931.753841:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022237696 00000100:00100000:2.0:1788459931.753843:0:6549:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e2300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6549:1875336022237824:0@lo:104: 00000100:00100000:0.0:1788459931.753850:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022237696 00000100:00100000:2.0:1788459931.753871:0:6549:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788459931.754046:0:6549:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4bc29d1e00/0x5dfa74784542abd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5dfa74784542abce expref: 19 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459931.754056:0:6549:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c4bc29d1e00/0x5dfa74784542abd5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5dfa74784542abce expref: 19 pid: 6528 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788459931.754066:0:6549:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e1c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6549:1875336022237952:0@lo:104: 00000100:00100000:2.0:1788459931.754092:0:6549:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788459931.754113:0:6549:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4bc29d2a00/0x5dfa74784542abb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5dfa74784542abb2 expref: 19 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459931.754122:0:6549:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c4bc29d2a00/0x5dfa74784542abb9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5dfa74784542abb2 expref: 19 pid: 6526 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788459931.754131:0:6549:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac2976300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6549:1875336022238080:0@lo:104: 00000100:00100000:2.0:1788459931.754151:0:6549:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc65d6000 going to sleep for 11 seconds 00000100:00100000:0.0:1788459931.754977:0:6517:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788459931.755004:0:6517:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459931.755020:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022237824 00000100:00100000:0.0:1788459931.755025:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022237824 00000100:00100000:0.0:1788459931.755160:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022237952 00000100:00100000:0.0:1788459931.755165:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022237952 00000100:00100000:0.0:1788459931.755181:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022238080 00000100:00100000:0.0:1788459931.755184:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022238080 00000100:00100000:0.0:1788459931.755196:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788459931.755204:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf75e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0cf73fe6-82e2-434e-b670-631647721b2c+6:6549:x1875336022237696:12345-0@lo:104: 00010000:00010000:0.0:1788459931.755219:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.206.105@tcp lock: ffff8c4ac2841c00/0x5dfa74784542aca7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542acae expref: -99 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459931.755291:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788459931.755296:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf75e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0cf73fe6-82e2-434e-b670-631647721b2c+6:6549:x1875336022237696:12345-0@lo:104: Request processed in 94us (1521us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459931.755303:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788459931.755319:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788459931.755325:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf75e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0cf73fe6-82e2-434e-b670-631647721b2c+5:6549:x1875336022237824:12345-0@lo:104: 00010000:00010000:0.0:1788459931.755333:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0800/0x5dfa74784542ac22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542ac29 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788459931.755358:0:6549:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e2680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6549:1875336022237696:0@lo:104: 00000100:00100000:2.0:1788459931.755371:0:6549:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e2300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6549:1875336022237824:0@lo:104: 00010000:00010000:0.0:1788459931.755372:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788459931.755382:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf75e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0cf73fe6-82e2-434e-b670-631647721b2c+5:6549:x1875336022237824:12345-0@lo:104: Request processed in 57us (1511us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459931.755388:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788459931.755415:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788459931.755421:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac1ed8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0cf73fe6-82e2-434e-b670-631647721b2c+4:6549:x1875336022237952:12345-0@lo:104: 00010000:00010000:0.0:1788459931.755428:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2600/0x5dfa74784542abce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542abd5 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459931.755523:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788459931.755530:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac1ed8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0cf73fe6-82e2-434e-b670-631647721b2c+4:6549:x1875336022237952:12345-0@lo:104: Request processed in 109us (1438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459931.755536:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788459931.755567:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788459931.755575:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf7710380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0cf73fe6-82e2-434e-b670-631647721b2c+3:6549:x1875336022238080:12345-0@lo:104: 00010000:00010000:0.0:1788459931.755582:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7c00/0x5dfa74784542abb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542abb9 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459931.755615:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788459931.755620:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf7710380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0cf73fe6-82e2-434e-b670-631647721b2c+3:6549:x1875336022238080:12345-0@lo:104: Request processed in 47us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459931.755625:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:0.0:1788459931.755642:0:9537:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788459931.755648:0:9537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: ffff8c4ac2841c00/0x5dfa74784542aca7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542acae expref: -99 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459931.755654:0:9537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac2841c00 already unused, calling callback (ffffffffc125ae00) 10000000:00010000:0.0:1788459931.755658:0:9537:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: ffff8c4ac2841c00/0x5dfa74784542aca7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5dfa74784542acae expref: -99 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459931.755667:0:9537:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: ffff8c4ac2841c00/0x5dfa74784542aca7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5dfa74784542acae expref: -99 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788459931.755699:0:9537:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: ffff8c4ac2841c00/0x5dfa74784542aca7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5dfa74784542acae expref: -99 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788459931.755705:0:9537:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788459931.755737:0:9537:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.206.105@tcp lock: ffff8c4ac2841c00/0x5dfa74784542aca7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542acae expref: -99 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459931.755743:0:9537:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788459931.755760:0:9537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: ffff8c4ac2841c00/0x5dfa74784542aca7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542acae expref: -99 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459931.755767:0:9537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: ffff8c4ac2841c00/0x5dfa74784542aca7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542acae expref: -99 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459931.755779:0:9537:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788459931.755782:0:9537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0800/0x5dfa74784542ac22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542ac29 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459931.755799:0:9537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc29d0800 already unused, calling callback (ffffffffc125ae00) 10000000:00010000:0.0:1788459931.755802:0:9537:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0800/0x5dfa74784542ac22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5dfa74784542ac29 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459931.755822:0:9537:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0800/0x5dfa74784542ac22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5dfa74784542ac29 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788459931.755829:0:9537:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0800/0x5dfa74784542ac22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5dfa74784542ac29 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788459931.755834:0:9537:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788459931.755856:0:9537:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0800/0x5dfa74784542ac22 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542ac29 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459931.755862:0:9537:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788459931.755868:0:9537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0800/0x5dfa74784542ac22 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542ac29 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459931.755874:0:9537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0800/0x5dfa74784542ac22 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542ac29 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459931.755883:0:9537:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788459931.755886:0:9537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2600/0x5dfa74784542abce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542abd5 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459931.755892:0:9537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc29d2600 already unused, calling callback (ffffffffc125ae00) 10000000:00010000:0.0:1788459931.755895:0:9537:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2600/0x5dfa74784542abce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5dfa74784542abd5 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459931.755902:0:9537:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2600/0x5dfa74784542abce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5dfa74784542abd5 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788459931.755908:0:9537:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2600/0x5dfa74784542abce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5dfa74784542abd5 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788459931.755913:0:9537:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788459931.755925:0:9537:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2600/0x5dfa74784542abce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542abd5 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459931.755931:0:9537:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788459931.755963:0:9537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2600/0x5dfa74784542abce lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542abd5 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459931.755980:0:9537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2600/0x5dfa74784542abce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542abd5 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459931.755990:0:9537:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788459931.755993:0:9537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7c00/0x5dfa74784542abb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542abb9 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459931.755998:0:9537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bfadc7c00 already unused, calling callback (ffffffffc125ae00) 10000000:00010000:0.0:1788459931.756001:0:9537:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7c00/0x5dfa74784542abb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5dfa74784542abb9 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459931.756008:0:9537:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7c00/0x5dfa74784542abb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5dfa74784542abb9 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788459931.756014:0:9537:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7c00/0x5dfa74784542abb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5dfa74784542abb9 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788459931.756020:0:9537:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788459931.756040:0:9537:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7c00/0x5dfa74784542abb2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542abb9 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459931.756047:0:9537:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788459931.756052:0:9537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7c00/0x5dfa74784542abb2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542abb9 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459931.756059:0:9537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7c00/0x5dfa74784542abb2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542abb9 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788459931.756287:0:6549:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e1c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6549:1875336022237952:0@lo:104: 00010000:00010000:3.0:1788459931.756300:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788459931.756311:0:6549:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac2976300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6549:1875336022238080:0@lo:104: 00000100:00100000:3.0:1788459931.756317:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf7711180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0cf73fe6-82e2-434e-b670-631647721b2c:3662:1875336022238336:0@lo:103: 00010000:00010000:2.0:1788459931.756334:0:6549:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c4bfadc7600/0x5dfa74784542acfb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459931.756353:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788459931.756362:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf7713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0cf73fe6-82e2-434e-b670-631647721b2c:3661:1875336022238208:0@lo:103: 00000100:00100000:2.0:1788459931.756395:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459931.756425:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459931.756530:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf7711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0cf73fe6-82e2-434e-b670-631647721b2c:3660:1875336022238592:0@lo:103: 00000100:00100000:3.0:1788459931.756553:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459931.756638:0:9538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022238208 00000100:00100000:3.0:1788459931.756646:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788459931.756646:0:9538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022238208 00000100:00100000:3.0:1788459931.756656:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf7710a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0cf73fe6-82e2-434e-b670-631647721b2c:3660:1875336022238464:0@lo:103: 00010000:00010000:0.0:1788459931.756660:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788459931.756670:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788459931.756673:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788459931.756674:0:9538:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4bef208400/0x5dfa74784542acae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542aca7 expref: 20 pid: 6526 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788459931.756686:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459931.756711:0:9538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022238336 00000100:00100000:2.0:1788459931.756715:0:9538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022238336 00000100:00100000:3.0:1788459931.756718:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022238592 00000100:00100000:3.0:1788459931.756724:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022238592 00010000:00010000:2.0:1788459931.756729:0:9538:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4bc29d0c00/0x5dfa74784542ac29 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542ac22 expref: 22 pid: 6526 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788459931.756732:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022238464 00000100:00100000:0.0:1788459931.756739:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022238464 00010000:00010000:3.0:1788459931.756743:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4bc29d2a00/0x5dfa74784542abb9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542abb2 expref: 22 pid: 6526 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788459931.756752:0:9538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00010000:00010000:0.0:1788459931.756761:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4bc29d1e00/0x5dfa74784542abd5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542abce expref: 23 pid: 6528 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788459931.756763:0:9538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac2976300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0cf73fe6-82e2-434e-b670-631647721b2c+23:3661:x1875336022238208:12345-0@lo:103: 00010000:00010000:2.0:1788459931.756779:0:9538:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788459931.756785:0:9538:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4bef208400/0x5dfa74784542acae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542aca7 expref: 23 pid: 6526 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459931.756794:0:9538:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4bef208400/0x5dfa74784542acae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5dfa74784542aca7 expref: 23 pid: 6526 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459931.756807:0:9538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4bef208400/0x5dfa74784542acae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5dfa74784542aca7 expref: 23 pid: 6526 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459931.756818:0:9538:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788459931.756846:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788459931.756854:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bedf6d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0cf73fe6-82e2-434e-b670-631647721b2c+22:3662:x1875336022238336:12345-0@lo:103: 00010000:00010000:3.0:1788459931.756863:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788459931.756867:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4bc29d0c00/0x5dfa74784542ac29 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542ac22 expref: 22 pid: 6526 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.756877:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4bc29d0c00/0x5dfa74784542ac29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5dfa74784542ac22 expref: 22 pid: 6526 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788459931.756890:0:6520:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:0.0:1788459931.756898:0:6520:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00010000:00010000:3.0:1788459931.756979:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4bc29d0c00/0x5dfa74784542ac29 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5dfa74784542ac22 expref: 22 pid: 6526 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.756990:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788459931.757001:0:9538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac2976300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0cf73fe6-82e2-434e-b670-631647721b2c+21:3661:x1875336022238208:12345-0@lo:103: Request processed in 239us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459931.757009:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf7713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0cf73fe6-82e2-434e-b670-631647721b2c:3661:1875336022238208:0@lo:103: 00000100:00100000:2.0:1788459931.757012:0:9538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788459931.757091:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bedf6d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0cf73fe6-82e2-434e-b670-631647721b2c+21:3662:x1875336022238336:12345-0@lo:103: Request processed in 238us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459931.757098:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788459931.757160:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf7711180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0cf73fe6-82e2-434e-b670-631647721b2c:3662:1875336022238336:0@lo:103: 00000100:00100000:2.0:1788459931.757221:0:9538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788459931.757230:0:9538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac383aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0cf73fe6-82e2-434e-b670-631647721b2c+19:3660:x1875336022238592:12345-0@lo:103: 00010000:00010000:2.0:1788459931.757240:0:9538:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1788459931.757241:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00010000:00010000:2.0:1788459931.757249:0:9538:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4bc29d2a00/0x5dfa74784542abb9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542abb2 expref: 19 pid: 6526 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788459931.757254:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3838e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0cf73fe6-82e2-434e-b670-631647721b2c+19:3660:x1875336022238464:12345-0@lo:103: 00010000:00010000:2.0:1788459931.757267:0:9538:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4bc29d2a00/0x5dfa74784542abb9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5dfa74784542abb2 expref: 19 pid: 6526 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.757268:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788459931.757276:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4bc29d1e00/0x5dfa74784542abd5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542abce expref: 19 pid: 6528 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.757287:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4bc29d1e00/0x5dfa74784542abd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5dfa74784542abce expref: 19 pid: 6528 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.757298:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4bc29d1e00/0x5dfa74784542abd5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5dfa74784542abce expref: 19 pid: 6528 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459931.757307:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788459931.757343:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3838e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0cf73fe6-82e2-434e-b670-631647721b2c+18:3660:x1875336022238464:12345-0@lo:103: Request processed in 93us (661us total) trans 0 rc 0/0 00010000:00010000:2.0:1788459931.757351:0:9538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4bc29d2a00/0x5dfa74784542abb9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5dfa74784542abb2 expref: 18 pid: 6526 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459931.757367:0:9538:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c4bfadc7600/0x5dfa74784542acfb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788459931.757371:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf7710a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0cf73fe6-82e2-434e-b670-631647721b2c:3660:1875336022238464:0@lo:103: 00010000:00010000:2.0:1788459931.757380:0:9538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bfadc7600/0x5dfa74784542acfb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788459931.757395:0:9538:0:(mgs_nids.c:715:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.010918397s 00010000:00010000:2.0:1788459931.757399:0:9538:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c4bfadc7600/0x5dfa74784542acfb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459931.757406:0:9538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c4bfadc7600/0x5dfa74784542acfb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459931.757413:0:9538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c4bfadc7600/0x5dfa74784542acfb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459931.757432:0:9538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c4bfadc7600/0x5dfa74784542acfb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459931.757438:0:9538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bfadc7600 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:2.0:1788459931.757441:0:9538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c4bfadc7600/0x5dfa74784542acfb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459931.758052:0:9538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c4bfadc7600/0x5dfa74784542acfb lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459931.758081:0:9538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c4bfadc7600/0x5dfa74784542acfb lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459931.758094:0:9538:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788459931.758153:0:6549:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c4bfadc7600/0x5dfa74784542acfb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459931.758164:0:6549:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c4bfadc7600/0x5dfa74784542acfb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459931.758171:0:6549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4bfadc7600/0x5dfa74784542acfb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6549 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788459931.758275:0:9538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac383aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0cf73fe6-82e2-434e-b670-631647721b2c+17:3660:x1875336022238592:12345-0@lo:103: Request processed in 1045us (1719us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459931.758284:0:9538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788459931.758322:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf7711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0cf73fe6-82e2-434e-b670-631647721b2c:3660:1875336022238592:0@lo:103: 00000100:00100000:3.0:1788459931.758692:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:0.0:1788459931.761005:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:1.0:1788459931.761423:0:9525:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1788459931.761625:0:9525:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1788459931.761845:0:9525:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1788459931.762033:0:9525:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1788459931.762253:0:9525:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:1.0:1788459931.762594:0:9525:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:1.0:1788459931.764249:0:9525:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1788459931.775843:0:9525:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1788459931.775853:0:9525:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1788459931.775889:0:9525:0:(tgt_mount.c:2600:server_fill_super_common()) Server sb, dev=50 00000080:00000004:1.0:1788459931.775907:0:9525:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:1.0:1788459931.777168:0:9525:0:(tgt_mount.c:2486:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788459931.777350:0:9525:0:(tgt_mount.c:2501:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1788459932.433151:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788459932.609193:0:9601:0:(tgt_mount.c:2486:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788459932.609418:0:9601:0:(tgt_mount.c:2501:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788459933.457718:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788459934.290005:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac2976d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022238720:0@lo:13: 00000100:00100000:2.0:1788459934.290067:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459934.290135:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022238720 00000100:00100000:2.0:1788459934.290142:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022238720 00000100:00100000:2.0:1788459934.290193:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788459934.290202:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac2975f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1875336022238720:12345-0@lo:13: 00002000:00000024:2.0:1788459934.290227:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788459934.290268:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac2975f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1875336022238720:12345-0@lo:13: Request processed in 68us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459934.290285:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1788459934.290306:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788459934.290332:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac2976d80 x1875336022238720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788459950 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788459934.290349:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac2976d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022238720:0@lo:13: 00010000:00010000:0.0:1788459934.481198:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788459934.801211:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788459934.801233:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac2976d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022238848:0@lo:41: 00000100:00100000:1.0:1788459934.801293:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459934.801525:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022238848 00000100:00100000:2.0:1788459934.801532:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022238848 00000100:00100000:2.0:1788459934.801590:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788459934.801599:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac1e60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022238848:12345-0@lo:41: 00000004:00000024:2.0:1788459934.801628:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:2.0:1788459934.801681:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac1e60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022238848:12345-0@lo:41: Request processed in 82us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459934.801688:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788459934.801793:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac2976d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022238848:0@lo:41: 00000100:00100000:3.0:1788459934.802229:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788459934.802240:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022238976:0@lo:13: 00000100:00100000:3.0:1788459934.802293:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459934.802365:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022238976 00000100:00100000:1.0:1788459934.802370:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022238976 00000100:00100000:1.0:1788459934.802417:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788459934.802424:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac383ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022238976:12345-0@lo:13: 00002000:00000024:1.0:1788459934.802439:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788459934.802484:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac383ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022238976:12345-0@lo:13: Request processed in 60us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459934.802491:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1788459934.802532:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788459934.802556:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac1e61180 x1875336022238976/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788459950 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788459934.802579:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e61180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022238976:0@lo:13: 00010000:00010000:1.0:1788459935.509306:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788459935.825665:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788459935.825687:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac2976d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022239104:0@lo:41: 00000100:00100000:2.0:1788459935.825749:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459935.825807:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022239104 00000100:00100000:2.0:1788459935.825815:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022239104 00000100:00100000:2.0:1788459935.826367:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788459935.826380:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac2975500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022239104:12345-0@lo:41: 00000004:00000024:2.0:1788459935.826411:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446502400 avail 1300262912 00000100:00100000:2.0:1788459935.826470:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac2975500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022239104:12345-0@lo:41: Request processed in 95us (721us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459935.826478:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788459935.826526:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac2976d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022239104:0@lo:41: 00010000:00010000:0.0:1788459936.531035:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788459936.852655:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac2976d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0cf73fe6-82e2-434e-b670-631647721b2c:3661:1875336022239232:0@lo:400: 00000100:00100000:1.0:1788459936.852724:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459936.852821:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022239232 00000100:00100000:0.0:1788459936.852829:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022239232 00000100:00100000:0.0:1788459936.852873:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788459936.852882:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+16:3661:x1875336022239232:12345-0@lo:400: 00000100:00100000:0.0:1788459936.853628:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+16:3661:x1875336022239232:12345-0@lo:400: Request processed in 743us (900us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459936.853644:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788459936.854084:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac2977480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3662:1875336022239360:0@lo:400: 00000100:00100000:2.0:1788459936.854127:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459936.854150:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac2976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3662:1875336022239872:0@lo:400: 00000100:00100000:2.0:1788459936.854168:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459936.854182:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc43f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3662:1875336022240384:0@lo:400: 00000100:00100000:2.0:1788459936.854204:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459936.854223:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788459936.854229:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac2974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022239744:0@lo:400: 00000100:00100000:2.0:1788459936.854261:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459936.854280:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc43f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022240256:0@lo:400: 00000100:00100000:2.0:1788459936.854301:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459936.854333:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022239360 00000100:00100000:2.0:1788459936.854338:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022239360 00000100:00100000:2.0:1788459936.854370:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022239872 00000100:00100000:2.0:1788459936.854373:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022239872 00000100:00100000:2.0:1788459936.854392:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022240384 00000100:00100000:2.0:1788459936.854394:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022240384 00000100:00100000:2.0:1788459936.854407:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788459936.854414:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc43f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1875336022239360:12345-0@lo:400: 00000100:00100000:2.0:1788459936.854556:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc43f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1875336022239360:12345-0@lo:400: Request processed in 141us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459936.854562:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788459936.854577:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788459936.854583:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc43f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1875336022239872:12345-0@lo:400: 00000100:00100000:2.0:1788459936.854611:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc43f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1875336022239872:12345-0@lo:400: Request processed in 29us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459936.854617:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788459936.854626:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788459936.854637:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc43f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1875336022240384:12345-0@lo:400: 00000100:00100000:2.0:1788459936.854663:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc43f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1875336022240384:12345-0@lo:400: Request processed in 27us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459936.854669:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788459936.854693:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022239744 00000100:00100000:2.0:1788459936.854696:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022239744 00000100:00100000:2.0:1788459936.854717:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788459936.854723:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3672d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1875336022239744:12345-0@lo:400: 00000100:00100000:2.0:1788459936.854759:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3672d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1875336022239744:12345-0@lo:400: Request processed in 36us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459936.854765:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788459936.854780:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022240256 00000100:00100000:2.0:1788459936.854783:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022240256 00000100:00100000:2.0:1788459936.854805:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788459936.854811:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3671500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1875336022240256:12345-0@lo:400: 00000100:00100000:2.0:1788459936.854836:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3671500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3662:x1875336022240256:12345-0@lo:400: Request processed in 25us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459936.854841:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1788459936.854857:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788459936.854862:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788459936.854887:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac2974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022239744:0@lo:400: 00010000:00080000:2.0:1788459936.854899:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bc43f8000 x1875336022240256/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788459952 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788459936.854909:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc43f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022240256:0@lo:400: 00010000:00080000:2.0:1788459936.854919:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac2977480 x1875336022239360/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788459952 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788459936.854939:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac2977480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3662:1875336022239360:0@lo:400: 00000100:00100000:0.0:1788459936.855621:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac2976680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022239488:0@lo:400: 00000100:00100000:0.0:1788459936.855661:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459936.855685:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc471a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1875336022240000:0@lo:400: 00000100:00100000:0.0:1788459936.855710:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459936.855725:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc43fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1875336022240512:0@lo:400: 00000100:00100000:0.0:1788459936.855744:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459936.855762:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788459936.855768:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac2976a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1875336022239616:0@lo:400: 00000100:00100000:0.0:1788459936.855787:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459936.855801:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc471a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022240128:0@lo:400: 00000100:00100000:0.0:1788459936.855820:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459936.855846:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022240128 00000100:00100000:0.0:1788459936.855851:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022240128 00000100:00100000:0.0:1788459936.855891:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788459936.855898:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf7712300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022240128:12345-0@lo:400: 00000100:00100000:0.0:1788459936.855936:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf7712300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022240128:12345-0@lo:400: Request processed in 39us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459936.856192:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788459936.856220:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022240000 00000100:00100000:0.0:1788459936.856225:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022240000 00000100:00100000:0.0:1788459936.856248:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022240512 00000100:00100000:0.0:1788459936.856251:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022240512 00000100:00100000:0.0:1788459936.856263:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022239616 00000100:00100000:0.0:1788459936.856265:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022239616 00000100:00100000:0.0:1788459936.856276:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788459936.856282:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf7711180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1875336022240000:12345-0@lo:400: 00000100:00100000:0.0:1788459936.856326:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf7711180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1875336022240000:12345-0@lo:400: Request processed in 44us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459936.856333:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788459936.856346:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788459936.856352:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf7713100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1875336022240512:12345-0@lo:400: 00000100:00100000:0.0:1788459936.856377:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf7713100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1875336022240512:12345-0@lo:400: Request processed in 26us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459936.856383:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788459936.856394:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788459936.856399:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf7711500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1875336022239616:12345-0@lo:400: 00000100:00100000:0.0:1788459936.856424:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf7711500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1875336022239616:12345-0@lo:400: Request processed in 25us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459936.856429:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1788459936.856461:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788459936.856465:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788459936.856491:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac2976a00 x1875336022239616/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788459952 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788459936.856503:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac2976a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1875336022239616:0@lo:400: 00010000:00080000:0.0:1788459936.856514:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bc471a680 x1875336022240128/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788459952 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788459936.856522:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc471a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022240128:0@lo:400: 00010000:00080000:0.0:1788459936.856531:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bc471a300 x1875336022240000/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788459952 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788459936.856538:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc471a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1875336022240000:0@lo:400: 00010000:00080000:0.0:1788459936.856557:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bc43fb800 x1875336022240512/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788459952 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788459936.856565:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc43fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1875336022240512:0@lo:400: 00010000:00080000:2.0:1788459936.856993:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac2976300 x1875336022239872/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788459952 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788459936.857004:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac2976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3662:1875336022239872:0@lo:400: 00010000:00080000:2.0:1788459936.857016:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bc43f9f80 x1875336022240384/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788459952 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788459936.857023:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc43f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3662:1875336022240384:0@lo:400: 00000100:00100000:2.0:1788459936.857055:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022239488 00000100:00100000:2.0:1788459936.857058:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022239488 00000100:00100000:2.0:1788459936.857080:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788459936.857087:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf7710a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022239488:12345-0@lo:400: 00000100:00100000:2.0:1788459936.857133:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf7710a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022239488:12345-0@lo:400: Request processed in 47us (1472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459936.857140:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788459936.857626:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac2976d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0cf73fe6-82e2-434e-b670-631647721b2c:3661:1875336022239232:0@lo:400: 00000100:00100000:0.0:1788459936.857801:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac2976680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022239488:0@lo:400: 00000001:02000400:0.0:1788459937.237337:0:9890:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788459937.554041:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788459938.038118:0:9942:0:(tgt_mount.c:2486:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788459938.038374:0:9942:0:(tgt_mount.c:2501:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788459938.585036:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788459939.409413:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3671880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022240640:0@lo:13: 00000100:00100000:1.0:1788459939.409500:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459939.409667:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022240640 00000100:00100000:2.0:1788459939.409676:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022240640 00000100:00100000:2.0:1788459939.409741:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788459939.409750:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac1e63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022240640:12345-0@lo:13: 00002000:00000024:2.0:1788459939.409777:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788459939.409820:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac1e63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022240640:12345-0@lo:13: Request processed in 72us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459939.409828:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1788459939.410748:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788459939.410785:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3671880 x1875336022240640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788459955 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788459939.410806:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3671880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022240640:0@lo:13: 00010000:00010000:1.0:1788459939.601275:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788459939.921290:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788459939.921316:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022240896:0@lo:13: 00000100:00100000:0.0:1788459939.921390:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459939.921474:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3670a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022240768:0@lo:41: 00000100:00100000:0.0:1788459939.921499:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459939.922070:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022240768 00000100:00100000:3.0:1788459939.922078:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022240768 00000100:00100000:3.0:1788459939.922133:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788459939.922143:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf7712680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022240768:12345-0@lo:41: 00000004:00000024:3.0:1788459939.922175:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:3.0:1788459939.922235:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf7712680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022240768:12345-0@lo:41: Request processed in 93us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459939.922242:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788459939.922328:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3670a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022240768:0@lo:41: 00000100:00100000:2.0:1788459939.922459:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022240896 00000100:00100000:2.0:1788459939.922476:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022240896 00000100:00100000:2.0:1788459939.922528:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788459939.922534:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf7710000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022240896:12345-0@lo:13: 00002000:00000024:2.0:1788459939.922548:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788459939.922585:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf7710000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022240896:12345-0@lo:13: Request processed in 51us (1196us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459939.922592:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1788459939.922683:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788459939.922706:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac1e60380 x1875336022240896/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788459955 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788459939.922720:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022240896:0@lo:13: 00010000:00010000:0.0:1788459940.625812:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788459940.876998:0:10044:0:(tgt_mount.c:2486:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788459940.877234:0:10044:0:(tgt_mount.c:2501:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788459940.945647:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3839500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022241024:0@lo:41: 10000000:01000000:0.0:1788459940.945710:0:6530:0:(mgc_request.c:715:do_requeue()) updating log lustre-mdtir 00000100:00100000:1.0:1788459940.945716:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:0.0:1788459940.945717:0:6530:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-mdtir-ffff8c4bfc4e5800 from 6 10000000:01000000:0.0:1788459940.945722:0:6530:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788459940.945754:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bef209200/0x5dfa74784542ad02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459940.945765:0:6530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4bef209200/0x5dfa74784542ad02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459940.945776:0:6530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4bef209200/0x5dfa74784542ad02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788459940.945789:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022241024 00000100:00100000:0.0:1788459940.945793:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf7711f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022241152:0@lo:101: 00000100:00100000:1.0:1788459940.945797:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022241024 00000100:00100000:0.0:1788459940.945834:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459940.945845:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788459940.945855:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac1e60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022241024:12345-0@lo:41: 00000100:00100000:0.0:1788459940.945875:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac2558780 going to sleep for 11 seconds 00000004:00000024:1.0:1788459940.945883:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446502400 avail 1300262912 00000100:00100000:1.0:1788459940.946030:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac1e60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022241024:12345-0@lo:41: Request processed in 164us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459940.946038:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788459940.950027:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022241152 00000100:00100000:2.0:1788459940.950041:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022241152 00000100:00100000:2.0:1788459940.950111:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788459940.950122:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+16:6530:x1875336022241152:12345-0@lo:101: 00010000:00010000:2.0:1788459940.950137:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788459940.950158:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4bfadc6600/0x5dfa74784542ad09 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542ad02 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459940.950183:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bfadc6600/0x5dfa74784542ad09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542ad02 expref: 17 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459940.950195:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4bfadc6600/0x5dfa74784542ad09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542ad02 expref: 17 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459940.950204:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bfadc6600, rc 0) 00000100:00100000:2.0:1788459940.950290:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+17:6530:x1875336022241152:12345-0@lo:101: Request processed in 171us (4456us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459940.950297:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788459940.950738:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3839500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022241024:0@lo:41: 00000100:00100000:0.0:1788459940.950777:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf7711f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022241152:0@lo:101: 00010000:00010000:0.0:1788459940.950791:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4bef209200/0x5dfa74784542ad02 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ad09 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459940.950801:0:6530:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4bef209200/0x5dfa74784542ad02 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542ad09 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788459940.950858:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf7711f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022241280:0@lo:256: 00000100:00100000:0.0:1788459940.950894:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459940.950929:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac2558780 going to sleep for 11 seconds 00000100:00100000:2.0:1788459940.954288:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022241280 00000100:00100000:2.0:1788459940.954301:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022241280 00000100:00100000:2.0:1788459940.954350:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788459940.954360:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4c02042850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+17:6530:x1875336022241280:12345-0@lo:256: 20000000:01000000:2.0:1788459940.954396:0:6528:0:(mgs_nids.c:1209:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788459940.954411:0:6528:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788459940.954414:0:6528:0:(mgs_nids.c:325:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1788459940.954911:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4c02042850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+17:6530:x1875336022241280:12345-0@lo:256: Request processed in 552us (4014us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459940.954920:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788459940.955033:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf7711f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022241280:0@lo:256: 10000000:01000000:1.0:1788459940.955075:0:6530:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788459940.955084:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bef209200/0x5dfa74784542ad02 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ad09 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459940.955095:0:6530:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4bef209200/0x5dfa74784542ad02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ad09 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788459940.955108:0:6530:0:(mgc_request.c:715:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788459940.955111:0:6530:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-client-ffff8c4bef21b800 from 39 10000000:01000000:1.0:1788459940.955114:0:6530:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788459940.955144:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bc0031800/0x5dfa74784542ad10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459940.955152:0:6530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4bc0031800/0x5dfa74784542ad10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459940.955161:0:6530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4bc0031800/0x5dfa74784542ad10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788459940.955176:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e61180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022241408:0@lo:101: 00000100:00100000:1.0:1788459940.955209:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459940.955246:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac25b3000 going to sleep for 11 seconds 00000100:00100000:3.0:1788459940.955324:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022241408 00000100:00100000:3.0:1788459940.955330:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022241408 00000100:00100000:3.0:1788459940.955370:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788459940.955378:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc844a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+17:6530:x1875336022241408:12345-0@lo:101: 00010000:00010000:3.0:1788459940.955389:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788459940.955410:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4ac2841400/0x5dfa74784542ad17 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542ad10 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459940.955443:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4ac2841400/0x5dfa74784542ad17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542ad10 expref: 18 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459940.955455:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4ac2841400/0x5dfa74784542ad17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542ad10 expref: 18 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459940.955464:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ac2841400, rc 0) 00000100:00100000:3.0:1788459940.955515:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc844a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+18:6530:x1875336022241408:12345-0@lo:101: Request processed in 137us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459940.955520:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788459940.955718:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e61180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022241408:0@lo:101: 00010000:00010000:1.0:1788459940.955731:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4bc0031800/0x5dfa74784542ad10 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ad17 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459940.955740:0:6530:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4bc0031800/0x5dfa74784542ad10 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542ad17 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788459940.955868:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1788459940.956183:0:6530:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788459940.956702:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1788459940.956732:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 120 off8536 00000040:00080000:1.0:1788459940.956747:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 168 off8704 00000040:00080000:1.0:1788459940.956759:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8928 00000040:00080000:1.0:1788459940.956773:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9152 00000040:00080000:1.0:1788459940.956787:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 120 off9272 00000040:00080000:1.0:1788459940.956798:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 168 off9440 00000040:00080000:1.0:1788459940.956810:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].8, 224 off9664 00000040:00080000:1.0:1788459940.956821:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].9, 224 off9888 00000040:00080000:1.0:1788459940.956835:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].10, 120 off10008 00000040:00080000:1.0:1788459940.956849:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].11, 224 off10232 00000040:00080000:1.0:1788459940.956862:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].12, 224 off10456 00000040:00080000:1.0:1788459940.956876:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].13, 88 off10544 00000040:00080000:1.0:1788459940.956889:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].14, 128 off10672 00000040:00080000:1.0:1788459940.956902:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].15, 144 off10816 00000040:00080000:1.0:1788459940.956914:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].16, 160 off10976 00000040:00080000:1.0:1788459940.956925:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].17, 224 off11200 00000040:00080000:1.0:1788459940.956935:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].18, 224 off11424 00000040:00080000:1.0:1788459940.956971:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].19, 80 off11504 00000040:00080000:1.0:1788459940.956988:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].20, 224 off11728 00000040:00080000:1.0:1788459940.957000:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].21, 224 off11952 00000040:00080000:1.0:1788459940.957012:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].22, 88 off12040 00000040:00080000:1.0:1788459940.957107:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].23, 128 off12168 00000040:00080000:1.0:1788459940.957122:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].24, 144 off12312 00000040:00080000:1.0:1788459940.957133:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].25, 160 off12472 00000040:00080000:1.0:1788459940.957144:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].26, 224 off12696 00000040:00080000:1.0:1788459940.957156:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].27, 224 off12920 00000040:00080000:1.0:1788459940.957167:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].28, 80 off13000 00000040:00080000:1.0:1788459940.957178:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].29, 224 off13224 00000040:00080000:1.0:1788459940.957201:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].30, 224 off13448 00000040:00080000:1.0:1788459940.957214:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].31, 88 off13536 00000040:00080000:1.0:1788459940.957225:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].32, 128 off13664 00000040:00080000:1.0:1788459940.957236:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].33, 144 off13808 00000040:00080000:1.0:1788459940.957248:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].34, 128 off13936 00000040:00080000:1.0:1788459940.958241:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].35, 224 off14160 00000040:00080000:1.0:1788459940.958350:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].36, 224 off14384 00000040:00080000:1.0:1788459940.958367:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].37, 80 off14464 00000040:00080000:1.0:1788459940.958392:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].38, 224 off14688 00000040:00080000:1.0:1788459940.958398:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1788459940.958505:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e61180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022241536:0@lo:501: 00000100:00100000:1.0:1788459940.959146:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459940.959177:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac25b3000 going to sleep for 11 seconds 00000100:00100000:2.0:1788459940.960386:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022241536 00000100:00100000:2.0:1788459940.960396:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022241536 00000100:00100000:2.0:1788459940.960459:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788459940.960469:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bca61bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+18:6530:x1875336022241536:12345-0@lo:501: 00000100:00100000:2.0:1788459940.961739:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bca61bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+18:6530:x1875336022241536:12345-0@lo:501: Request processed in 1267us (2589us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459940.961750:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788459940.962135:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e61180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022241536:0@lo:501: 00000100:00100000:1.0:1788459940.962179:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e61180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022241664:0@lo:503: 00000100:00100000:1.0:1788459940.962223:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459940.962626:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022241664 00000100:00100000:0.0:1788459940.962633:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022241664 00000100:00100000:0.0:1788459940.962675:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788459940.962683:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bca61a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+18:6530:x1875336022241664:12345-0@lo:503: 00000100:00100000:0.0:1788459940.962783:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bca61a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+18:6530:x1875336022241664:12345-0@lo:503: Request processed in 101us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459940.962790:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788459940.963642:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac25b3000 going to sleep for 11 seconds 00000100:00100000:1.0:1788459940.963666:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e61180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022241664:0@lo:503: 00000040:00080000:1.0:1788459940.964889:0:6530:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788459940.965528:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e61180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022241792:0@lo:502: 00000100:00100000:1.0:1788459940.965675:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459940.965717:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac25b3000 going to sleep for 11 seconds 00000100:00100000:2.0:1788459940.965770:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022241792 00000100:00100000:2.0:1788459940.965779:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022241792 00000100:00100000:2.0:1788459940.965828:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788459940.965837:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+18:6530:x1875336022241792:12345-0@lo:502: 00000100:00100000:2.0:1788459940.965998:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+18:6530:x1875336022241792:12345-0@lo:502: Request processed in 162us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459940.966005:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788459940.966679:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e61180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022241792:0@lo:502: 00000040:00080000:1.0:1788459940.966887:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1788459940.966917:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 120 off8536 00000040:00080000:1.0:1788459940.966931:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 168 off8704 00000040:00080000:1.0:1788459940.966979:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8928 00000040:00080000:1.0:1788459940.966995:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9152 00000040:00080000:1.0:1788459940.967017:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 120 off9272 00000040:00080000:1.0:1788459940.967165:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 168 off9440 00000040:00080000:1.0:1788459940.967181:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9664 00000040:00080000:1.0:1788459940.967194:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 224 off9888 00000040:00080000:1.0:1788459940.967208:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 120 off10008 00000040:00080000:1.0:1788459940.967222:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10232 00000040:00080000:1.0:1788459940.967236:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 224 off10456 00000040:00080000:1.0:1788459940.967249:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 88 off10544 00000040:00080000:1.0:1788459940.967266:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].14, 128 off10672 00000040:00080000:1.0:1788459940.967283:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].15, 144 off10816 00000040:00080000:1.0:1788459940.967302:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].16, 160 off10976 00000040:00080000:1.0:1788459940.967322:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].17, 224 off11200 00000040:00080000:1.0:1788459940.967345:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].18, 224 off11424 00000040:00080000:1.0:1788459940.967361:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].19, 80 off11504 00000040:00080000:1.0:1788459940.967373:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].20, 224 off11728 00000040:00080000:1.0:1788459940.967386:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].21, 224 off11952 00000040:00080000:1.0:1788459940.967400:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].22, 88 off12040 00000040:00080000:1.0:1788459940.967414:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].23, 128 off12168 00000040:00080000:1.0:1788459940.967438:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].24, 144 off12312 00000040:00080000:1.0:1788459940.967457:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].25, 160 off12472 00000040:00080000:1.0:1788459940.967473:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].26, 224 off12696 00000040:00080000:1.0:1788459940.967488:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].27, 224 off12920 00000040:00080000:1.0:1788459940.967505:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].28, 80 off13000 00000040:00080000:1.0:1788459940.967519:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].29, 224 off13224 00000040:00080000:1.0:1788459940.967532:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].30, 224 off13448 00000040:00080000:1.0:1788459940.967625:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].31, 88 off13536 00000040:00080000:1.0:1788459940.967638:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].32, 128 off13664 00000040:00080000:1.0:1788459940.967650:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].33, 144 off13808 00000040:00080000:1.0:1788459940.967663:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].34, 128 off13936 00000040:00080000:1.0:1788459940.967675:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].35, 224 off14160 00000040:00080000:1.0:1788459940.967686:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].36, 224 off14384 00000040:00080000:1.0:1788459940.967711:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].37, 80 off14464 00000040:00080000:1.0:1788459940.967724:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].38, 224 off14688 00000040:00080000:1.0:1788459940.967745:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].39, 224 off14912 00000040:00080000:1.0:1788459940.967759:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].40, 88 off15000 00000040:00080000:1.0:1788459940.967769:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].41, 128 off15128 00000040:00080000:1.0:1788459940.967783:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].42, 144 off15272 00000040:00080000:1.0:1788459940.967797:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].43, 128 off15400 00000040:00080000:1.0:1788459940.967814:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].44, 224 off15624 00000040:00080000:1.0:1788459940.967830:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].45, 224 off15848 00000040:00080000:1.0:1788459940.967844:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].46, 80 off15928 00000100:00100000:1.0:1788459940.967878:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e61180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022241920:0@lo:502: 00000100:00100000:1.0:1788459940.967938:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459940.968011:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac25b3000 going to sleep for 11 seconds 00000100:00100000:0.0:1788459940.968197:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022241920 00000100:00100000:0.0:1788459940.968203:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022241920 00000100:00100000:0.0:1788459940.968252:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788459940.968261:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+18:6530:x1875336022241920:12345-0@lo:502: 00000100:00100000:0.0:1788459940.968369:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+18:6530:x1875336022241920:12345-0@lo:502: Request processed in 109us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459940.968378:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788459940.968495:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e61180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022241920:0@lo:502: 00000040:00080000:1.0:1788459940.968622:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].47, 224 off16152 00000040:00080000:1.0:1788459940.968632:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000040:00080000:2.0:1788459940.970532:0:10048:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 48 count 48 00000020:01000000:1.0:1788459940.970612:0:6530:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1788459940.970626:0:6530:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788459940.970636:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bc0031800/0x5dfa74784542ad10 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ad17 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459940.970647:0:6530:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4bc0031800/0x5dfa74784542ad10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ad17 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788459940.970656:0:6530:0:(mgc_request.c:715:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788459940.970658:0:6530:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-mdtir-ffff8c4bef21b800 from 6 10000000:01000000:1.0:1788459940.970661:0:6530:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788459940.970691:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bc0030400/0x5dfa74784542ad1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459940.970699:0:6530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4bc0030400/0x5dfa74784542ad1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459940.970720:0:6530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4bc0030400/0x5dfa74784542ad1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788459940.970741:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e61180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022242048:0@lo:101: 00000100:00100000:1.0:1788459940.970798:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459940.970841:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac25b3000 going to sleep for 11 seconds 00000100:00100000:2.0:1788459940.970871:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022242048 00000100:00100000:2.0:1788459940.970879:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022242048 00000100:00100000:2.0:1788459940.970977:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788459940.970989:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+18:6530:x1875336022242048:12345-0@lo:101: 00010000:00010000:2.0:1788459940.971004:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788459940.971055:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4ac395f800/0x5dfa74784542ad25 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542ad1e expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459940.971079:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4ac395f800/0x5dfa74784542ad25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542ad1e expref: 19 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459940.971090:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4ac395f800/0x5dfa74784542ad25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542ad1e expref: 19 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459940.971098:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ac395f800, rc 0) 00000100:00100000:1.0:1788459940.971145:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+19:6530:x1875336022242048:12345-0@lo:101: Request processed in 160us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459940.971152:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788459940.971285:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e61180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022242048:0@lo:101: 00010000:00010000:2.0:1788459940.971306:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4bc0030400/0x5dfa74784542ad1e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ad25 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459940.971314:0:6530:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4bc0030400/0x5dfa74784542ad1e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542ad25 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788459940.971361:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3671180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022242176:0@lo:256: 00000100:00100000:2.0:1788459940.971393:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459940.971635:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc4e73cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788459940.971808:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022242176 00000100:00100000:3.0:1788459940.971814:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022242176 00000100:00100000:3.0:1788459940.971914:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788459940.971925:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+19:6530:x1875336022242176:12345-0@lo:256: 20000000:01000000:3.0:1788459940.971958:0:6525:0:(mgs_nids.c:1209:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788459940.971976:0:6525:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788459940.971979:0:6525:0:(mgs_nids.c:325:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1788459940.972058:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+19:6530:x1875336022242176:12345-0@lo:256: Request processed in 136us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459940.972065:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788459940.972295:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3671180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022242176:0@lo:256: 10000000:01000000:2.0:1788459940.972333:0:6530:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788459940.972341:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bc0030400/0x5dfa74784542ad1e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ad25 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459940.972350:0:6530:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4bc0030400/0x5dfa74784542ad1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ad25 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788459940.972362:0:6530:0:(mgc_request.c:715:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1788459940.972363:0:6530:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1788459940.972366:0:6530:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788459940.972395:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6800/0x5dfa74784542ad2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459940.972403:0:6530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6800/0x5dfa74784542ad2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459940.972411:0:6530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6800/0x5dfa74784542ad2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788459940.972446:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3671180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022242304:0@lo:101: 00000100:00100000:2.0:1788459940.972475:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459940.972496:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc4e73cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788459940.972926:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022242304 00000100:00100000:3.0:1788459940.972932:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022242304 00000100:00100000:3.0:1788459940.972993:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788459940.973001:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+19:6530:x1875336022242304:12345-0@lo:101: 00010000:00010000:3.0:1788459940.973010:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788459940.973023:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4ac2841800/0x5dfa74784542ad33 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542ad2c expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459940.973044:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4ac2841800/0x5dfa74784542ad33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542ad2c expref: 20 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459940.973054:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4ac2841800/0x5dfa74784542ad33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542ad2c expref: 20 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459940.973062:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ac2841800, rc 0) 00000100:00100000:3.0:1788459940.973098:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+20:6530:x1875336022242304:12345-0@lo:101: Request processed in 99us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459940.973112:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788459940.973311:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3671180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022242304:0@lo:101: 00010000:00010000:2.0:1788459940.973324:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6800/0x5dfa74784542ad2c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ad33 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459940.973333:0:6530:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6800/0x5dfa74784542ad2c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542ad33 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788459940.973500:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1788459940.973788:0:6530:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788459940.974022:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1788459940.974047:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 128 off8544 00000040:00080000:2.0:1788459940.974063:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 112 off8656 00000040:00080000:2.0:1788459940.974082:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].4, 224 off8880 00000040:00080000:2.0:1788459940.974100:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].5, 224 off9104 00000040:00080000:2.0:1788459940.974116:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].6, 80 off9184 00000040:00080000:2.0:1788459940.974136:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].7, 224 off9408 00000040:00080000:2.0:1788459940.974143:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1788459940.974390:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3671180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022242432:0@lo:501: 00000100:00100000:2.0:1788459940.974446:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459940.974472:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc4e73e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788459940.974712:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022242432 00000100:00100000:3.0:1788459940.974718:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022242432 00000100:00100000:3.0:1788459940.974815:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788459940.974824:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+20:6530:x1875336022242432:12345-0@lo:501: 00000100:00100000:3.0:1788459940.974939:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+20:6530:x1875336022242432:12345-0@lo:501: Request processed in 117us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459940.974965:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788459940.975300:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3671180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022242432:0@lo:501: 00000100:00100000:2.0:1788459940.975334:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3671180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022242560:0@lo:503: 00000100:00100000:2.0:1788459940.975375:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459940.975455:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc4e73e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788459940.976371:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022242560 00000100:00100000:3.0:1788459940.976379:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022242560 00000100:00100000:3.0:1788459940.977142:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788459940.977170:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+20:6530:x1875336022242560:12345-0@lo:503: 00000100:00100000:3.0:1788459940.977495:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+20:6530:x1875336022242560:12345-0@lo:503: Request processed in 160us (1939us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459940.977504:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788459940.978042:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3671180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022242560:0@lo:503: 00000040:00080000:3.0:1788459940.979269:0:6530:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788459940.979421:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3839880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022242688:0@lo:502: 00000100:00100000:3.0:1788459940.979503:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459940.979614:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac286ccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788459940.980456:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022242688 00000100:00100000:0.0:1788459940.980474:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022242688 00000100:00100000:0.0:1788459940.980564:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788459940.981258:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+20:6530:x1875336022242688:12345-0@lo:502: 00000100:00100000:0.0:1788459940.981508:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+20:6530:x1875336022242688:12345-0@lo:502: Request processed in 936us (2004us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459940.981518:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788459940.983809:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3839880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022242688:0@lo:502: 00000040:00080000:3.0:1788459940.984309:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1788459940.984370:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 00000040:00080000:3.0:1788459940.984385:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:3.0:1788459940.984396:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:3.0:1788459940.984407:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:3.0:1788459940.984417:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:3.0:1788459940.984440:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 00000040:00080000:3.0:1788459940.984467:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:3.0:1788459940.984478:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000100:00100000:3.0:1788459940.984514:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3838a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022242816:0@lo:502: 00000100:00100000:3.0:1788459940.984589:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459940.984639:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac286cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788459940.985263:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022242816 00000100:00100000:0.0:1788459940.985270:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022242816 00000100:00100000:0.0:1788459940.985398:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788459940.985407:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+20:6530:x1875336022242816:12345-0@lo:502: 00000100:00100000:0.0:1788459940.985535:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+20:6530:x1875336022242816:12345-0@lo:502: Request processed in 128us (957us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459940.985542:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788459940.985632:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3838a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022242816:0@lo:502: 00000040:00080000:1.0:1788459940.985698:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 00000040:00080000:1.0:1788459940.985708:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:1.0:1788459940.986133:0:10051:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788459940.986140:0:10051:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788459940.986142:0:10051:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788459940.986146:0:10051:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788459940.986148:0:10051:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788459940.986152:0:10051:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788459940.986172:0:10051:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788459940.986174:0:10051:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788459940.986177:0:10051:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:1.0:1788459940.986210:0:6530:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1788459940.986218:0:6530:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788459940.986228:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6800/0x5dfa74784542ad2c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ad33 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459940.986238:0:6530:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6800/0x5dfa74784542ad2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ad33 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788459940.986248:0:6530:0:(mgc_request.c:715:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788459940.986250:0:6530:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-sptlrpc-ffff8c4bef21b800 from 1 10000000:01000000:1.0:1788459940.986252:0:6530:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788459940.986277:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac395ea00/0x5dfa74784542ad3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459940.986285:0:6530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4ac395ea00/0x5dfa74784542ad3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459940.986294:0:6530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4ac395ea00/0x5dfa74784542ad3a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788459940.986309:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e61880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022242944:0@lo:101: 00000100:00100000:1.0:1788459940.986352:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459940.993568:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac25b3180 going to sleep for 11 seconds 00000100:00100000:3.0:1788459940.994550:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022242944 00000100:00100000:3.0:1788459940.994561:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022242944 00000100:00100000:3.0:1788459940.995342:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788459940.995353:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+20:6530:x1875336022242944:12345-0@lo:101: 00010000:00010000:3.0:1788459940.995370:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788459940.995387:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4ac2840a00/0x5dfa74784542ad41 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542ad3a expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459940.995413:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4ac2840a00/0x5dfa74784542ad41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542ad3a expref: 21 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459940.995423:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4ac2840a00/0x5dfa74784542ad41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542ad3a expref: 21 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459940.995444:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ac2840a00, rc 0) 00000100:00100000:3.0:1788459940.995505:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+21:6530:x1875336022242944:12345-0@lo:101: Request processed in 154us (9152us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459940.995511:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788459940.995573:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e61880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022242944:0@lo:101: 00010000:00010000:1.0:1788459940.995606:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4ac395ea00/0x5dfa74784542ad3a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ad41 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459940.995616:0:6530:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4ac395ea00/0x5dfa74784542ad3a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542ad41 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788459940.995733:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e61880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022243072:0@lo:501: 00000100:00100000:1.0:1788459940.995766:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459941.000270:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022243072 00000100:00100000:0.0:1788459941.000280:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022243072 00000100:00100000:0.0:1788459941.000321:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788459941.000328:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+21:6530:x1875336022243072:12345-0@lo:501: 00000100:00100000:0.0:1788459941.000443:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+21:6530:x1875336022243072:12345-0@lo:501: Request processed in 115us (4676us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788459941.000451:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788459941.001015:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac25b3180 going to sleep for 10 seconds 00000100:00100000:0.0:1788459941.001040:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e61880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022243072:0@lo:501: 10000000:01000000:0.0:1788459941.001061:0:6530:0:(mgc_request_server.c:748:mgc_llog_local_copy()) mgc192.168.206.105@tcp: no remote llog for lustre-sptlrpc, check MGS config 00000100:00100000:0.0:1788459941.001126:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf7712a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022243200:0@lo:501: 00000100:00100000:0.0:1788459941.001259:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459941.001281:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac25589c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788459941.001306:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022243200 00000100:00100000:0.0:1788459941.001310:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022243200 00000100:00100000:0.0:1788459941.001331:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788459941.001338:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+21:6530:x1875336022243200:12345-0@lo:501: 00000100:00100000:0.0:1788459941.001389:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+21:6530:x1875336022243200:12345-0@lo:501: Request processed in 52us (130us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788459941.001396:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788459941.001438:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf7712a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022243200:0@lo:501: 10000000:01000000:0.0:1788459941.001456:0:6530:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788459941.001465:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac395ea00/0x5dfa74784542ad3a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ad41 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459941.001476:0:6530:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4ac395ea00/0x5dfa74784542ad3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ad41 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788459941.001486:0:6530:0:(mgc_request.c:715:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788459941.001489:0:6530:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-client-ffff8c4bc438f000 from 39 10000000:01000000:0.0:1788459941.001491:0:6530:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788459941.001510:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bef208800/0x5dfa74784542ad48 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459941.001518:0:6530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4bef208800/0x5dfa74784542ad48 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459941.001527:0:6530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4bef208800/0x5dfa74784542ad48 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788459941.001537:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf7712a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022243328:0@lo:101: 00000100:00100000:0.0:1788459941.001561:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459941.001660:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac25589c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788459941.001672:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022243328 00000100:00100000:0.0:1788459941.001675:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022243328 00000100:00100000:0.0:1788459941.001690:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788459941.001696:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+21:6530:x1875336022243328:12345-0@lo:101: 00010000:00010000:0.0:1788459941.001703:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788459941.001712:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4bef208000/0x5dfa74784542ad4f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542ad48 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459941.001731:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bef208000/0x5dfa74784542ad4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542ad48 expref: 22 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459941.001741:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4bef208000/0x5dfa74784542ad4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542ad48 expref: 22 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459941.001749:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bef208000, rc 0) 00000100:00100000:0.0:1788459941.001783:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+22:6530:x1875336022243328:12345-0@lo:101: Request processed in 77us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459941.001789:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788459941.001814:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf7712a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022243328:0@lo:101: 00010000:00010000:0.0:1788459941.001824:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4bef208800/0x5dfa74784542ad48 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ad4f expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459941.001832:0:6530:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4bef208800/0x5dfa74784542ad48 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542ad4f expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788459941.002274:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 39 count 39 00000040:00080000:0.0:1788459941.003135:0:6530:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788459941.004082:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:0.0:1788459941.004111:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 120 off8536 00000040:00080000:0.0:1788459941.004144:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 168 off8704 00000040:00080000:0.0:1788459941.004511:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8928 00000040:00080000:0.0:1788459941.004530:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9152 00000040:00080000:0.0:1788459941.004541:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9272 00000040:00080000:0.0:1788459941.004552:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 168 off9440 00000040:00080000:0.0:1788459941.004562:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 224 off9664 00000040:00080000:0.0:1788459941.004573:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:0.0:1788459941.004584:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 120 off10008 00000040:00080000:0.0:1788459941.004796:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 224 off10232 00000040:00080000:0.0:1788459941.004816:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10456 00000040:00080000:0.0:1788459941.004829:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 88 off10544 00000040:00080000:0.0:1788459941.004843:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 128 off10672 00000040:00080000:0.0:1788459941.004994:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 144 off10816 00000040:00080000:0.0:1788459941.005006:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 160 off10976 00000040:00080000:0.0:1788459941.005016:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 224 off11200 00000040:00080000:0.0:1788459941.005027:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11424 00000040:00080000:0.0:1788459941.005051:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 80 off11504 00000040:00080000:0.0:1788459941.005063:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 224 off11728 00000040:00080000:0.0:1788459941.005075:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11952 00000040:00080000:0.0:1788459941.005089:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 88 off12040 00000040:00080000:0.0:1788459941.005102:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 128 off12168 00000040:00080000:0.0:1788459941.005116:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 144 off12312 00000040:00080000:0.0:1788459941.005129:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 160 off12472 00000040:00080000:0.0:1788459941.005141:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 224 off12696 00000040:00080000:0.0:1788459941.005152:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 224 off12920 00000040:00080000:0.0:1788459941.007266:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 80 off13000 00000040:00080000:0.0:1788459941.007316:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 224 off13224 00000040:00080000:0.0:1788459941.007333:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13448 00000040:00080000:0.0:1788459941.007346:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 88 off13536 00000040:00080000:0.0:1788459941.007358:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 128 off13664 00000040:00080000:0.0:1788459941.007370:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 144 off13808 00000040:00080000:0.0:1788459941.007383:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 128 off13936 00000040:00080000:0.0:1788459941.007413:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 224 off14160 00000040:00080000:0.0:1788459941.007456:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 224 off14384 00000040:00080000:0.0:1788459941.007470:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 80 off14464 00000040:00080000:0.0:1788459941.007492:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 224 off14688 00000040:00080000:0.0:1788459941.007497:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 38 count 39 00000100:00100000:0.0:1788459941.008493:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf7712a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022243456:0@lo:501: 00000100:00100000:0.0:1788459941.008563:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459941.008685:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac25589c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788459941.008839:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022243456 00000100:00100000:0.0:1788459941.008908:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022243456 00000100:00100000:0.0:1788459941.008965:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788459941.008974:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+22:6530:x1875336022243456:12345-0@lo:501: 00000100:00100000:0.0:1788459941.009389:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+22:6530:x1875336022243456:12345-0@lo:501: Request processed in 415us (823us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459941.009397:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788459941.009454:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf7712a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022243456:0@lo:501: 00000100:00100000:0.0:1788459941.009489:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf7712a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022243584:0@lo:503: 00000100:00100000:0.0:1788459941.009530:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459941.009552:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc65d7540 going to sleep for 11 seconds 00000100:00100000:0.0:1788459941.009563:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022243584 00000100:00100000:0.0:1788459941.009567:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022243584 00000100:00100000:0.0:1788459941.013320:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788459941.013342:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+22:6530:x1875336022243584:12345-0@lo:503: 00000100:00100000:0.0:1788459941.014474:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+22:6530:x1875336022243584:12345-0@lo:503: Request processed in 1137us (4938us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459941.014486:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788459941.014609:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf7712a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022243584:0@lo:503: 00000040:00080000:2.0:1788459941.015190:0:6530:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788459941.015271:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3673100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022243712:0@lo:502: 00000100:00100000:2.0:1788459941.015329:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459941.015368:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc4e73600 going to sleep for 11 seconds 00000100:00100000:0.0:1788459941.015989:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022243712 00000100:00100000:0.0:1788459941.015997:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022243712 00000100:00100000:0.0:1788459941.016042:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788459941.016050:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+22:6530:x1875336022243712:12345-0@lo:502: 00000100:00100000:0.0:1788459941.016173:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+22:6530:x1875336022243712:12345-0@lo:502: Request processed in 123us (844us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459941.016180:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788459941.016215:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3673100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022243712:0@lo:502: 00000040:00080000:3.0:1788459941.016424:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1788459941.016466:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 120 off8536 00000040:00080000:3.0:1788459941.016481:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 168 off8704 00000040:00080000:3.0:1788459941.016493:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8928 00000040:00080000:3.0:1788459941.016505:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9152 00000040:00080000:3.0:1788459941.016530:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9272 00000040:00080000:3.0:1788459941.016544:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 168 off9440 00000040:00080000:3.0:1788459941.016556:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 224 off9664 00000040:00080000:3.0:1788459941.016568:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:3.0:1788459941.016580:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 120 off10008 00000040:00080000:3.0:1788459941.016613:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 224 off10232 00000040:00080000:3.0:1788459941.016627:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10456 00000040:00080000:3.0:1788459941.016639:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 88 off10544 00000040:00080000:3.0:1788459941.016651:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 128 off10672 00000040:00080000:3.0:1788459941.016665:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 144 off10816 00000040:00080000:3.0:1788459941.016677:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 160 off10976 00000040:00080000:3.0:1788459941.016689:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 224 off11200 00000040:00080000:3.0:1788459941.016702:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11424 00000040:00080000:2.0:1788459941.020250:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 80 off11504 00000040:00080000:2.0:1788459941.020306:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 224 off11728 00000040:00080000:2.0:1788459941.020328:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11952 00000040:00080000:2.0:1788459941.020346:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 88 off12040 00000040:00080000:2.0:1788459941.020361:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 128 off12168 00000040:00080000:2.0:1788459941.020395:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 144 off12312 00000040:00080000:2.0:1788459941.020413:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 160 off12472 00000040:00080000:2.0:1788459941.020443:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 224 off12696 00000040:00080000:2.0:1788459941.020462:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 224 off12920 00000040:00080000:2.0:1788459941.020478:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 80 off13000 00000040:00080000:2.0:1788459941.020493:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 224 off13224 00000040:00080000:2.0:1788459941.020506:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13448 00000040:00080000:2.0:1788459941.020520:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 88 off13536 00000040:00080000:2.0:1788459941.020535:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 128 off13664 00000040:00080000:2.0:1788459941.020550:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 144 off13808 00000040:00080000:2.0:1788459941.020563:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 128 off13936 00000040:00080000:2.0:1788459941.020923:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 224 off14160 00000040:00080000:2.0:1788459941.021133:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 224 off14384 00000040:00080000:2.0:1788459941.021152:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 80 off14464 00000040:00080000:2.0:1788459941.021248:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 224 off14688 00000040:00080000:2.0:1788459941.021264:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14912 00000040:00080000:2.0:1788459941.021294:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 88 off15000 00000040:00080000:2.0:1788459941.021311:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 128 off15128 00000040:00080000:2.0:1788459941.021337:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 144 off15272 00000040:00080000:2.0:1788459941.021352:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 128 off15400 00000040:00080000:2.0:1788459941.021367:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 224 off15624 00000040:00080000:2.0:1788459941.021380:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off15848 00000040:00080000:2.0:1788459941.021393:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].46, 80 off15928 00000100:00100000:2.0:1788459941.021450:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3670380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022243840:0@lo:502: 00000100:00100000:2.0:1788459941.021524:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459941.021680:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc4e736c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788459941.022111:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022243840 00000100:00100000:0.0:1788459941.022120:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022243840 00000100:00100000:2.0:1788459941.022279:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788459941.022288:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf363f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+22:6530:x1875336022243840:12345-0@lo:502: 00000100:00100000:2.0:1788459941.022536:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf363f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+22:6530:x1875336022243840:12345-0@lo:502: Request processed in 248us (1011us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459941.022546:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788459941.022935:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3670380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022243840:0@lo:502: 00000040:00080000:0.0:1788459941.023211:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].47, 224 off16152 00000040:00080000:0.0:1788459941.023225:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000040:00080000:0.0:1788459941.025099:0:10053:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 48 count 48 00000020:01000000:1.0:1788459941.025461:0:6530:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1788459941.025476:0:6530:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788459941.025487:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bef208800/0x5dfa74784542ad48 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ad4f expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459941.025500:0:6530:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4bef208800/0x5dfa74784542ad48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ad4f expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788459941.025512:0:6530:0:(mgc_request.c:715:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788459941.025514:0:6530:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-mdtir-ffff8c4bc438f000 from 6 10000000:01000000:1.0:1788459941.025517:0:6530:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788459941.025557:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac395ee00/0x5dfa74784542ad56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459941.025567:0:6530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4ac395ee00/0x5dfa74784542ad56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459941.025915:0:6530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4ac395ee00/0x5dfa74784542ad56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788459941.025941:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e62d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022243968:0@lo:101: 00000100:00100000:2.0:1788459941.026105:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459941.026154:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac25b3c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788459941.026258:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022243968 00000100:00100000:3.0:1788459941.026265:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022243968 00000100:00100000:3.0:1788459941.026316:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788459941.026325:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf363d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+22:6530:x1875336022243968:12345-0@lo:101: 00010000:00010000:3.0:1788459941.026336:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788459941.026357:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4ac2840e00/0x5dfa74784542ad5d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542ad56 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459941.026381:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4ac2840e00/0x5dfa74784542ad5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542ad56 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459941.026392:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4ac2840e00/0x5dfa74784542ad5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542ad56 expref: 23 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459941.026400:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ac2840e00, rc 0) 00000100:00100000:3.0:1788459941.026453:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf363d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+23:6530:x1875336022243968:12345-0@lo:101: Request processed in 128us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459941.026461:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788459941.026542:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e62d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022243968:0@lo:101: 00010000:00010000:2.0:1788459941.026557:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4ac395ee00/0x5dfa74784542ad56 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ad5d expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459941.026566:0:6530:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4ac395ee00/0x5dfa74784542ad56 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542ad5d expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788459941.026618:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3673b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022244096:0@lo:256: 00000100:00100000:2.0:1788459941.026652:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459941.026673:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc4e736c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788459941.026716:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022244096 00000100:00100000:3.0:1788459941.026721:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022244096 00000100:00100000:3.0:1788459941.026764:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788459941.026771:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf363cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+23:6530:x1875336022244096:12345-0@lo:256: 20000000:01000000:3.0:1788459941.026785:0:6528:0:(mgs_nids.c:1209:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788459941.026801:0:6528:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788459941.026804:0:6528:0:(mgs_nids.c:325:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1788459941.027040:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf363cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+23:6530:x1875336022244096:12345-0@lo:256: Request processed in 268us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459941.027048:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788459941.027410:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3673b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022244096:0@lo:256: 10000000:01000000:2.0:1788459941.027474:0:6530:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788459941.027481:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac395ee00/0x5dfa74784542ad56 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ad5d expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459941.027497:0:6530:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4ac395ee00/0x5dfa74784542ad56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ad5d expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788459941.027508:0:6530:0:(mgc_request.c:715:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1788459941.027509:0:6530:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:2.0:1788459941.027512:0:6530:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1788459941.027535:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7200/0x5dfa74784542ad64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459941.027542:0:6530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7200/0x5dfa74784542ad64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459941.027550:0:6530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7200/0x5dfa74784542ad64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788459941.027563:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3673b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022244224:0@lo:101: 00000100:00100000:2.0:1788459941.027594:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459941.027671:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc4e736c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788459941.027709:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022244224 00000100:00100000:3.0:1788459941.027715:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022244224 00000100:00100000:3.0:1788459941.027841:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788459941.027852:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf363dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+23:6530:x1875336022244224:12345-0@lo:101: 00010000:00010000:3.0:1788459941.027861:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788459941.027872:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4ac2840000/0x5dfa74784542ad6b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542ad64 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459941.027891:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4ac2840000/0x5dfa74784542ad6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542ad64 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459941.027900:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4ac2840000/0x5dfa74784542ad6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542ad64 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459941.027908:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ac2840000, rc 0) 00000100:00100000:3.0:1788459941.027973:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf363dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+24:6530:x1875336022244224:12345-0@lo:101: Request processed in 124us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459941.027979:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788459941.028048:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3673b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022244224:0@lo:101: 00010000:00010000:2.0:1788459941.028061:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7200/0x5dfa74784542ad64 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ad6b expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459941.028069:0:6530:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7200/0x5dfa74784542ad64 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542ad6b expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788459941.028233:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 34 count 34 00000040:00080000:2.0:1788459941.028498:0:6530:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788459941.028679:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1788459941.028707:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 136 off8552 00000040:00080000:2.0:1788459941.028720:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 176 off8728 00000040:00080000:2.0:1788459941.028732:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8952 00000040:00080000:2.0:1788459941.028744:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9176 00000040:00080000:2.0:1788459941.028770:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9296 00000040:00080000:2.0:1788459941.028786:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 112 off9408 00000040:00080000:2.0:1788459941.028798:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 160 off9568 00000040:00080000:2.0:1788459941.028810:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9792 00000040:00080000:2.0:1788459941.028822:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10016 00000040:00080000:2.0:1788459941.028835:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 88 off10104 00000040:00080000:2.0:1788459941.028847:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 144 off10248 00000040:00080000:2.0:1788459941.028858:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 152 off10400 00000040:00080000:2.0:1788459941.028870:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 168 off10568 00000040:00080000:2.0:1788459941.028881:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 224 off10792 00000040:00080000:2.0:1788459941.028906:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 224 off11016 00000040:00080000:2.0:1788459941.028920:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 80 off11096 00000040:00080000:2.0:1788459941.028932:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11320 00000040:00080000:2.0:1788459941.028969:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 224 off11544 00000040:00080000:2.0:1788459941.028983:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 160 off11704 00000040:00080000:2.0:1788459941.028996:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11928 00000040:00080000:2.0:1788459941.029009:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 224 off12152 00000040:00080000:2.0:1788459941.029023:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 80 off12232 00000040:00080000:2.0:1788459941.029041:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 224 off12456 00000040:00080000:2.0:1788459941.029057:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 224 off12680 00000040:00080000:2.0:1788459941.029072:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 88 off12768 00000040:00080000:2.0:1788459941.029087:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 144 off12912 00000040:00080000:2.0:1788459941.029104:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 152 off13064 00000040:00080000:2.0:1788459941.029119:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 136 off13200 00000040:00080000:2.0:1788459941.029137:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13424 00000040:00080000:2.0:1788459941.029151:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 224 off13648 00000040:00080000:2.0:1788459941.029177:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 80 off13728 00000040:00080000:2.0:1788459941.029196:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 224 off13952 00000040:00080000:2.0:1788459941.029201:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 33 count 34 00000100:00100000:2.0:1788459941.029273:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3673b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022244352:0@lo:501: 00000100:00100000:2.0:1788459941.029319:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459941.029712:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022244352 00000100:00100000:0.0:1788459941.029720:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022244352 00000100:00100000:0.0:1788459941.029773:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788459941.029783:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf363f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+24:6530:x1875336022244352:12345-0@lo:501: 00000100:00100000:0.0:1788459941.029885:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf363f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+24:6530:x1875336022244352:12345-0@lo:501: Request processed in 104us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459941.029892:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788459941.030051:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc4e736c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788459941.030071:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3673b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022244352:0@lo:501: 00000100:00100000:0.0:1788459941.030101:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf7712a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022244480:0@lo:503: 00000100:00100000:0.0:1788459941.030199:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459941.030218:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022244480 00000100:00100000:0.0:1788459941.030222:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022244480 00000100:00100000:0.0:1788459941.030238:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788459941.030244:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf363d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+24:6530:x1875336022244480:12345-0@lo:503: 00000100:00100000:0.0:1788459941.030314:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf363d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+24:6530:x1875336022244480:12345-0@lo:503: Request processed in 70us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459941.030327:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788459941.030528:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bd253d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788459941.030545:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf7712a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022244480:0@lo:503: 00000040:00080000:0.0:1788459941.031001:0:6530:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788459941.031060:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf7712a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022244608:0@lo:502: 00000100:00100000:0.0:1788459941.031098:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459941.031136:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022244608 00000100:00100000:0.0:1788459941.031140:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022244608 00000100:00100000:0.0:1788459941.031161:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788459941.031167:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf363f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+24:6530:x1875336022244608:12345-0@lo:502: 00000100:00100000:0.0:1788459941.031240:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf363f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+24:6530:x1875336022244608:12345-0@lo:502: Request processed in 72us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459941.031246:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788459941.031283:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4be03290c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788459941.031295:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf7712a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022244608:0@lo:502: 00000040:00080000:0.0:1788459941.031520:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:0.0:1788459941.031545:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 136 off8552 00000040:00080000:0.0:1788459941.031558:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 176 off8728 00000040:00080000:0.0:1788459941.031569:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8952 00000040:00080000:0.0:1788459941.031579:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9176 00000040:00080000:0.0:1788459941.031590:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9296 00000040:00080000:0.0:1788459941.031602:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 112 off9408 00000040:00080000:0.0:1788459941.031616:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 160 off9568 00000040:00080000:0.0:1788459941.031630:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9792 00000040:00080000:0.0:1788459941.031644:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10016 00000040:00080000:0.0:1788459941.031657:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 88 off10104 00000040:00080000:0.0:1788459941.031671:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 144 off10248 00000040:00080000:0.0:1788459941.031697:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 152 off10400 00000040:00080000:0.0:1788459941.031713:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 168 off10568 00000040:00080000:0.0:1788459941.031726:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 224 off10792 00000040:00080000:0.0:1788459941.031739:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 224 off11016 00000040:00080000:0.0:1788459941.031900:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 80 off11096 00000040:00080000:0.0:1788459941.031935:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11320 00000040:00080000:0.0:1788459941.031983:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 224 off11544 00000040:00080000:0.0:1788459941.032000:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 160 off11704 00000040:00080000:0.0:1788459941.032014:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11928 00000040:00080000:0.0:1788459941.032028:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 224 off12152 00000040:00080000:0.0:1788459941.032042:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 80 off12232 00000040:00080000:0.0:1788459941.032058:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 224 off12456 00000040:00080000:0.0:1788459941.032071:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 224 off12680 00000040:00080000:0.0:1788459941.032085:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 88 off12768 00000040:00080000:0.0:1788459941.032099:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 144 off12912 00000040:00080000:0.0:1788459941.032177:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 152 off13064 00000040:00080000:0.0:1788459941.032197:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 136 off13200 00000040:00080000:0.0:1788459941.032211:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13424 00000040:00080000:0.0:1788459941.032225:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 224 off13648 00000040:00080000:0.0:1788459941.032239:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 80 off13728 00000040:00080000:0.0:1788459941.032252:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 224 off13952 00000040:00080000:0.0:1788459941.032278:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 224 off14176 00000040:00080000:0.0:1788459941.032294:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 88 off14264 00000040:00080000:0.0:1788459941.032306:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 144 off14408 00000040:00080000:0.0:1788459941.032319:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 152 off14560 00000040:00080000:0.0:1788459941.032333:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 136 off14696 00000040:00080000:0.0:1788459941.032345:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14920 00000040:00080000:0.0:1788459941.032537:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 224 off15144 00000040:00080000:0.0:1788459941.032556:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 80 off15224 00000100:00100000:0.0:1788459941.032589:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf7712a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022244736:0@lo:502: 00000100:00100000:0.0:1788459941.032641:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459941.032727:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4be03290c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788459941.033032:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022244736 00000100:00100000:2.0:1788459941.033040:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022244736 00000100:00100000:2.0:1788459941.033308:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1788459941.033318:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf363fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+24:6530:x1875336022244736:12345-0@lo:502: 00000100:00100000:2.0:1788459941.033451:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf363fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+24:6530:x1875336022244736:12345-0@lo:502: Request processed in 134us (809us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459941.033459:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788459941.033528:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf7712a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022244736:0@lo:502: 00000040:00080000:0.0:1788459941.033575:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 224 off15448 00000040:00080000:0.0:1788459941.033582:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 42 count 43 00000020:01000000:0.0:1788459941.034143:0:10055:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788459941.034150:0:10055:0:(obd_mount.c:1049:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1788459941.034156:0:10055:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788459941.034158:0:10055:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788459941.034162:0:10055:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788459941.034166:0:10055:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.105@tcp to nid 0x20000c0a8ce69 (192.168.206.105@tcp) 00000020:01000000:0.0:1788459941.034186:0:10055:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1788459941.034188:0:10055:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788459941.034202:0:10055:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8c4c019a1988) 00000020:00000080:0.0:1788459941.034221:0:10055:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:0.0:1788459941.034226:0:10055:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788459941.034302:0:10055:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:0.0:1788459941.034308:0:10055:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788459941.034315:0:10055:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5dfa74784542ad79 00010000:00080000:0.0:1788459941.034341:0:10055:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c4bced6d000@lustre-OST0001-osc-MDT0001: add connection 192.168.206.105@tcp at head 00010000:00010000:0.0:1788459941.034577:0:10055:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:0.0:1788459941.034660:0:10055:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1788459941.034670:0:10055:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1788459941.034813:0:10055:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788459941.034921:0:10055:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788459941.035051:0:10055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1788459941.035137:0:10055:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1788459941.035890:0:10056:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788459941.035895:0:10056:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788459941.036721:0:10055:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788459941.036732:0:10055:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788459941.036834:0:10055:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788459941.036859:0:10055:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5dfa74784542ad80 00000100:00080000:2.0:1788459941.036869:0:10055:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788459941.036875:0:10055:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8c4bced6d000 using connection 192.168.206.105@tcp/0@lo 00000100:00100000:2.0:1788459941.036911:0:10055:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4ac3670000 x1875336022244864/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788459941.037031:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3670000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1875336022244864:0@lo:8: 00000100:00100000:0.0:1788459941.037096:0:3658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788459941.037289:0:10055:0:(pinger.c:380:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788459941.037349:0:10055:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788459941.037363:0:10055:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788459941.037364:0:10055:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788459941.037368:0:10055:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788459941.037372:0:10055:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788459941.037373:0:10055:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788459941.037377:0:10055:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788459941.037379:0:10055:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788459941.037401:0:10055:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788459941.037410:0:10055:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788459941.037412:0:10055:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788459941.037417:0:10055:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 43 count 43 00000100:00100000:3.0:1788459941.039096:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022244864 00000100:00100000:3.0:1788459941.039178:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022244864 00000100:00100000:3.0:1788459941.039265:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788459941.039273:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf7712a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3658:x1875336022244864:12345-0@lo:8: 00010000:00080000:3.0:1788459941.039305:0:8450:0:(ldlm_lib.c:1461:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 238 last 0 00000020:00000080:3.0:1788459941.039332:0:8450:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5dfa74784542ad87 00002000:00100000:3.0:1788459941.039344:0:8450:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8c4ac2bb6000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a07 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1788459941.039348:0:8450:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:3.0:1788459941.039359:0:8450:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1788459941.039415:0:8450:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788459941.039674:0:8450:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1788459941.039703:0:8450:0:(import.c:65:import_set_state_nolock()) ffff8c4ac2bb1800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788459941.040041:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf7712a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3658:x1875336022244864:12345-0@lo:8: Request processed in 767us (2944us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459941.040050:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1788459941.040237:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3670000 x1875336022244864/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788459951 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788459941.040249:0:3658:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788459941.040265:0:3658:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1788459941.040272:0:3658:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788459941.040278:0:3658:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788459941.040281:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c4bced6d000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788459941.040338:0:3658:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788459941.040344:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3670000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1875336022244864:0@lo:8: 00000100:00100000:0.0:1788459941.040488:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf7711f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3660:1875336022244992:0@lo:400: 00000100:00100000:0.0:1788459941.040526:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459941.040551:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc43fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3660:1875336022245504:0@lo:400: 00000100:00100000:0.0:1788459941.040569:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459941.040583:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac2976d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3660:1875336022246016:0@lo:400: 00000100:00100000:0.0:1788459941.040599:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459941.040616:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788459941.040621:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc43f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3660:1875336022245376:0@lo:400: 00000100:00100000:0.0:1788459941.040654:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459941.040669:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac2976680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3660:1875336022245888:0@lo:400: 00000100:00100000:0.0:1788459941.040689:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459941.040709:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf7711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022245120:0@lo:400: 00000100:00100000:0.0:1788459941.040731:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459941.040749:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc471a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022245632:0@lo:400: 00000100:00100000:0.0:1788459941.040912:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459941.040934:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788459941.040939:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc43f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875336022245248:0@lo:400: 00000100:00100000:0.0:1788459941.040994:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459941.041005:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc471a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022245760:0@lo:400: 00000100:00100000:0.0:1788459941.041027:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459941.041053:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022244992 00000100:00100000:0.0:1788459941.041057:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022244992 00000100:00100000:0.0:1788459941.041083:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022245504 00000100:00100000:0.0:1788459941.041085:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022245504 00000100:00100000:0.0:1788459941.041100:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022246016 00000100:00100000:0.0:1788459941.041103:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022246016 00000100:00100000:0.0:1788459941.041112:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022245376 00000100:00100000:0.0:1788459941.041178:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022245376 00000100:00100000:0.0:1788459941.041192:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022245888 00000100:00100000:0.0:1788459941.041194:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022245888 00000100:00100000:0.0:1788459941.041204:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022245248 00000100:00100000:0.0:1788459941.041206:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022245248 00000100:00100000:0.0:1788459941.041217:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788459941.041223:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac2976300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1875336022244992:12345-0@lo:400: 00000100:00100000:0.0:1788459941.041262:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac2976300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1875336022244992:12345-0@lo:400: Request processed in 38us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459941.041268:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788459941.041281:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788459941.041286:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac2977480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1875336022245504:12345-0@lo:400: 00000100:00100000:0.0:1788459941.041306:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac2977480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1875336022245504:12345-0@lo:400: Request processed in 21us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459941.041311:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788459941.041320:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788459941.041326:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac2974e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1875336022246016:12345-0@lo:400: 00000100:00100000:0.0:1788459941.041346:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac2974e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1875336022246016:12345-0@lo:400: Request processed in 20us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459941.041412:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788459941.041423:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788459941.041444:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac2976a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1875336022245376:12345-0@lo:400: 00000100:00100000:0.0:1788459941.041470:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac2976a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1875336022245376:12345-0@lo:400: Request processed in 28us (817us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459941.041476:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788459941.041486:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788459941.041491:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf75e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1875336022245888:12345-0@lo:400: 00000100:00100000:0.0:1788459941.041509:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf75e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1875336022245888:12345-0@lo:400: Request processed in 19us (820us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459941.041515:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788459941.041522:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788459941.041527:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf75e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1875336022245248:12345-0@lo:400: 00000100:00100000:1.0:1788459941.042424:0:8832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022245632 00000100:00100000:1.0:1788459941.042444:0:8832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022245632 00000100:00100000:1.0:1788459941.042488:0:8832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022245760 00000100:00100000:1.0:1788459941.042491:0:8832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022245760 00000100:00100000:1.0:1788459941.042512:0:8832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788459941.042529:0:8832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf75e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022245632:12345-0@lo:400: 00000004:00080000:2.0:1788459941.043071:0:10056:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788459941.043152:0:10056:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 238146207404ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788459941.043158:0:10056:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1788459941.044288:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf75e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1875336022245248:12345-0@lo:400: Request processed in 2756us (3289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459941.044300:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788459941.044515:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022245120 00000100:00100000:0.0:1788459941.044523:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022245120 00000100:00100000:0.0:1788459941.044565:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788459941.044573:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf75e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022245120:12345-0@lo:400: 00000100:00100000:0.0:1788459941.044615:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf75e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022245120:12345-0@lo:400: Request processed in 43us (3884us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459941.044620:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788459941.044682:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788459941.044691:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf75e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1875336022245760:12345-0@lo:400: 00000100:00100000:0.0:1788459941.044728:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf75e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1875336022245760:12345-0@lo:400: Request processed in 39us (3700us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459941.044734:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788459941.044750:0:8832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf75e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022245632:12345-0@lo:400: Request processed in 2219us (3835us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459941.044760:0:8832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1788459941.045247:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bc43f9f80 x1875336022245248/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788459957 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788459941.045261:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc43f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875336022245248:0@lo:400: 00010000:00080000:2.0:1788459941.045272:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bc471a680 x1875336022245760/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788459957 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788459941.045281:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc471a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022245760:0@lo:400: 00000100:00100000:2.0:1788459941.045292:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf7711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022245120:0@lo:400: 00010000:00080000:2.0:1788459941.045302:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bc471a300 x1875336022245632/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788459957 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788459941.045310:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc471a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022245632:0@lo:400: 00000100:00080000:0.0:1788459941.045524:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788459941.045530:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788459941.045533:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788459941.045644:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bc43f8000 x1875336022245376/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788459957 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788459941.045655:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc43f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3660:1875336022245376:0@lo:400: 00010000:00080000:0.0:1788459941.045669:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac2976680 x1875336022245888/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788459957 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788459941.045677:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac2976680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3660:1875336022245888:0@lo:400: 00010000:00080000:0.0:1788459941.045689:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bf7711f80 x1875336022244992/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788459957 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788459941.045697:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf7711f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3660:1875336022244992:0@lo:400: 00010000:00080000:0.0:1788459941.045708:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bc43fb800 x1875336022245504/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788459957 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788459941.045716:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc43fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3660:1875336022245504:0@lo:400: 00010000:00080000:0.0:1788459941.045726:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac2976d80 x1875336022246016/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788459957 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788459941.045734:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac2976d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3660:1875336022246016:0@lo:400: 00000020:01000000:0.0:1788459941.047223:0:6530:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:0.0:1788459941.047243:0:6530:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788459941.047253:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7200/0x5dfa74784542ad64 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ad6b expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459941.047266:0:6530:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7200/0x5dfa74784542ad64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ad6b expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788459941.047374:0:6530:0:(mgc_request.c:715:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788459941.047378:0:6530:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-sptlrpc-ffff8c4bc438f000 from 1 10000000:01000000:1.0:1788459941.047381:0:6530:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788459941.047425:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac395e000/0x5dfa74784542ad8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459941.047444:0:6530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4ac395e000/0x5dfa74784542ad8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459941.047454:0:6530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4ac395e000/0x5dfa74784542ad8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788459941.047474:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e60700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022246144:0@lo:101: 00000100:00100000:1.0:1788459941.047531:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459941.047573:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac25b3c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788459941.048055:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022246144 00000100:00100000:0.0:1788459941.048063:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022246144 00000100:00100000:0.0:1788459941.048102:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788459941.048110:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf363e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+24:6530:x1875336022246144:12345-0@lo:101: 00010000:00010000:0.0:1788459941.048564:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788459941.048580:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4bef209a00/0x5dfa74784542ad95 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542ad8e expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459941.048604:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bef209a00/0x5dfa74784542ad95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542ad8e expref: 25 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459941.048615:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4bef209a00/0x5dfa74784542ad95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542ad8e expref: 25 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459941.048624:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bef209a00, rc 0) 00000100:00100000:0.0:1788459941.048682:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf363e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+25:6530:x1875336022246144:12345-0@lo:101: Request processed in 572us (1150us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459941.048689:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788459941.048839:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e60700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022246144:0@lo:101: 00010000:00010000:1.0:1788459941.048865:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4ac395e000/0x5dfa74784542ad8e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ad95 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459941.048875:0:6530:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4ac395e000/0x5dfa74784542ad8e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542ad95 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788459941.048980:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e60700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022246272:0@lo:501: 00000100:00100000:1.0:1788459941.049011:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459941.049055:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac25b3c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788459941.049073:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022246272 00000100:00100000:1.0:1788459941.049077:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022246272 00000100:00100000:1.0:1788459941.049109:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1788459941.049117:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf363e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+25:6530:x1875336022246272:12345-0@lo:501: 00000100:00100000:1.0:1788459941.049176:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf363e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+25:6530:x1875336022246272:12345-0@lo:501: Request processed in 60us (164us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788459941.049183:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1788459941.049214:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e60700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022246272:0@lo:501: 10000000:01000000:1.0:1788459941.049225:0:6530:0:(mgc_request_server.c:748:mgc_llog_local_copy()) mgc192.168.206.105@tcp: no remote llog for lustre-sptlrpc, check MGS config 00000100:00100000:1.0:1788459941.049254:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e60700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022246400:0@lo:501: 00000100:00100000:1.0:1788459941.049277:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459941.049292:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac25b3c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788459941.049303:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022246400 00000100:00100000:1.0:1788459941.049307:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022246400 00000100:00100000:1.0:1788459941.049328:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1788459941.049335:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf363c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+25:6530:x1875336022246400:12345-0@lo:501: 00000100:00100000:1.0:1788459941.049380:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf363c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+25:6530:x1875336022246400:12345-0@lo:501: Request processed in 45us (102us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788459941.049386:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1788459941.049415:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e60700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022246400:0@lo:501: 10000000:01000000:1.0:1788459941.049445:0:6530:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788459941.049452:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac395e000/0x5dfa74784542ad8e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ad95 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459941.049461:0:6530:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4ac395e000/0x5dfa74784542ad8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ad95 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788459941.049477:0:6530:0:(mgc_request.c:715:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788459941.049480:0:6530:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-client-ffff8c4be2d81000 from 39 10000000:01000000:1.0:1788459941.049482:0:6530:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788459941.049501:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac395ec00/0x5dfa74784542ad9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459941.049508:0:6530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4ac395ec00/0x5dfa74784542ad9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459941.049517:0:6530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4ac395ec00/0x5dfa74784542ad9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788459941.049528:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e60700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022246528:0@lo:101: 00000100:00100000:1.0:1788459941.049552:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459941.049567:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac25b3c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788459941.049577:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022246528 00000100:00100000:1.0:1788459941.049580:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022246528 00000100:00100000:1.0:1788459941.049630:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1788459941.049635:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf363d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+25:6530:x1875336022246528:12345-0@lo:101: 00010000:00010000:1.0:1788459941.049643:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788459941.049652:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4ac395fe00/0x5dfa74784542ada3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542ad9c expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459941.049669:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4ac395fe00/0x5dfa74784542ada3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542ad9c expref: 26 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459941.049678:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4ac395fe00/0x5dfa74784542ada3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542ad9c expref: 26 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459941.050023:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ac395fe00, rc 0) 00000100:00100000:1.0:1788459941.050057:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf363d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+26:6530:x1875336022246528:12345-0@lo:101: Request processed in 421us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459941.050063:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1788459941.050172:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e60700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022246528:0@lo:101: 00010000:00010000:1.0:1788459941.050184:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4ac395ec00/0x5dfa74784542ad9c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ada3 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459941.050191:0:6530:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4ac395ec00/0x5dfa74784542ad9c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542ada3 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788459941.050217:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e60700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022246656:0@lo:501: 00000100:00100000:1.0:1788459941.050241:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459941.050255:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac25b3c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788459941.050266:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022246656 00000100:00100000:1.0:1788459941.050269:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022246656 00000100:00100000:1.0:1788459941.050291:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1788459941.050297:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf363e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+26:6530:x1875336022246656:12345-0@lo:501: 00000100:00100000:1.0:1788459941.050385:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf363e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+26:6530:x1875336022246656:12345-0@lo:501: Request processed in 87us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459941.050392:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1788459941.050422:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e60700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022246656:0@lo:501: 00000100:00100000:1.0:1788459941.050457:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e60700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022246784:0@lo:503: 00000100:00100000:1.0:1788459941.050495:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459941.050508:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac25b3c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788459941.050525:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022246784 00000100:00100000:1.0:1788459941.050528:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022246784 00000100:00100000:1.0:1788459941.050545:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1788459941.050550:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf363c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+26:6530:x1875336022246784:12345-0@lo:503: 00000100:00100000:1.0:1788459941.050630:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf363c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+26:6530:x1875336022246784:12345-0@lo:503: Request processed in 78us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459941.050637:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1788459941.050677:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e60700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022246784:0@lo:503: 00000004:00080000:2.0:1788459941.052001:0:7465:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:0.0:1788459941.053331:0:10059:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac2976d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0cf73fe6-82e2-434e-b670-631647721b2c:10059:1875336022246912:0@lo:502: 00000100:00100000:0.0:1788459941.053415:0:10059:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459941.053464:0:10059:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bd253dcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788459941.054048:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022246912 00000100:00100000:1.0:1788459941.054061:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022246912 00000100:00100000:1.0:1788459941.054110:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1788459941.054120:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf363c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+26:10059:x1875336022246912:12345-0@lo:502: 00000100:00100000:3.0:1788459941.054252:0:10057:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3839180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10057:1875336022247040:0@lo:700: 00000100:00100000:1.0:1788459941.054254:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf363c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+26:10059:x1875336022246912:12345-0@lo:502: Request processed in 134us (837us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459941.054267:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1788459941.054297:0:10057:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459941.054330:0:8457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022247040 00000100:00100000:3.0:1788459941.054334:0:8457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022247040 00000100:00100000:3.0:1788459941.054387:0:8457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788459941.054394:0:8457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac383b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:10057:x1875336022247040:12345-0@lo:700: 00000100:00100000:3.0:1788459941.054423:0:8457:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3838380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8457:1875336022247168:0@lo:700: 00000100:00100000:3.0:1788459941.054461:0:8457:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459941.054477:0:8457:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac286ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1788459941.054491:0:10057:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac286ccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788459941.054825:0:10059:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac2976d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0cf73fe6-82e2-434e-b670-631647721b2c:10059:1875336022246912:0@lo:502: 00000100:00100000:0.0:1788459941.054874:0:10059:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac2976d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0cf73fe6-82e2-434e-b670-631647721b2c:10059:1875336022247296:0@lo:502: 00000100:00100000:0.0:1788459941.054909:0:10059:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459941.054929:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022247296 00000100:00100000:0.0:1788459941.054933:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022247296 00000100:00100000:0.0:1788459941.054980:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1788459941.054986:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd0a6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+26:10059:x1875336022247296:12345-0@lo:502: 00000100:00100000:0.0:1788459941.055064:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd0a6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+26:10059:x1875336022247296:12345-0@lo:502: Request processed in 77us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459941.055072:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1788459941.055108:0:10059:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bd253dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788459941.055134:0:10059:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac2976d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0cf73fe6-82e2-434e-b670-631647721b2c:10059:1875336022247296:0@lo:502: 00000040:00080000:0.0:1788459941.055152:0:10059:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000100:00080000:1.0:1788459941.055648:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788459941.055663:0:6540:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022247168 00000100:00100000:1.0:1788459941.055668:0:6540:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022247168 00000100:00100000:1.0:1788459941.055707:0:6540:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788459941.055714:0:6540:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac383bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8457:x1875336022247168:12345-0@lo:700: 00000020:01000000:1.0:1788459941.055821:0:6530:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1788459941.055909:0:6530:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788459941.055919:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac395ec00/0x5dfa74784542ad9c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ada3 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459941.055930:0:6530:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4ac395ec00/0x5dfa74784542ad9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ada3 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788459941.055966:0:6530:0:(mgc_request.c:715:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788459941.055968:0:6530:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-mdtir-ffff8c4be2d81000 from 6 10000000:01000000:1.0:1788459941.055970:0:6530:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788459941.055996:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac395e200/0x5dfa74784542adaa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459941.056004:0:6530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4ac395e200/0x5dfa74784542adaa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459941.056012:0:6530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4ac395e200/0x5dfa74784542adaa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788459941.056026:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e60700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022247424:0@lo:101: 00000100:00100000:1.0:1788459941.056066:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459941.056446:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc55edc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788459941.059186:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022247424 00000100:00100000:3.0:1788459941.059198:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022247424 00000100:00100000:3.0:1788459941.059244:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1788459941.059259:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd0a6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+26:6530:x1875336022247424:12345-0@lo:101: 00010000:00010000:3.0:1788459941.059273:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788459941.059289:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4ac2840c00/0x5dfa74784542adb1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542adaa expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459941.059313:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4ac2840c00/0x5dfa74784542adb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542adaa expref: 27 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459941.059323:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4ac2840c00/0x5dfa74784542adb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542adaa expref: 27 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459941.059332:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ac2840c00, rc 0) 00000100:00100000:3.0:1788459941.059400:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd0a6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+27:6530:x1875336022247424:12345-0@lo:101: Request processed in 142us (3333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459941.059406:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1788459941.059555:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e60700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022247424:0@lo:101: 00010000:00010000:1.0:1788459941.059573:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4ac395e200/0x5dfa74784542adaa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542adb1 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459941.059582:0:6530:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4ac395e200/0x5dfa74784542adaa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542adb1 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788459941.059643:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e60700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022247552:0@lo:256: 00000100:00100000:1.0:1788459941.059688:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459941.059723:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc55edc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788459941.059772:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022247552 00000100:00100000:3.0:1788459941.059776:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022247552 00000100:00100000:3.0:1788459941.059807:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1788459941.059815:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd0a6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+27:6530:x1875336022247552:12345-0@lo:256: 20000000:01000000:3.0:1788459941.059841:0:6526:0:(mgs_nids.c:1209:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788459941.059862:0:6526:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788459941.059866:0:6526:0:(mgs_nids.c:325:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1788459941.059960:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd0a6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+27:6530:x1875336022247552:12345-0@lo:256: Request processed in 127us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459941.059967:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1788459941.060065:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e60700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022247552:0@lo:256: 10000000:01000000:1.0:1788459941.060112:0:6530:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788459941.060124:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac395e200/0x5dfa74784542adaa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542adb1 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459941.060132:0:6530:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4ac395e200/0x5dfa74784542adaa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542adb1 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788459941.060140:0:6530:0:(mgc_request.c:715:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788459941.060143:0:6530:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1788459941.060145:0:6530:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788459941.060164:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac395fa00/0x5dfa74784542adb8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459941.060182:0:6530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4ac395fa00/0x5dfa74784542adb8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459941.060191:0:6530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4ac395fa00/0x5dfa74784542adb8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788459941.060205:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e60700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022247680:0@lo:101: 00000100:00100000:1.0:1788459941.060237:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459941.060260:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022247680 00000100:00100000:1.0:1788459941.060263:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc55edc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788459941.060267:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022247680 00000100:00100000:0.0:1788459941.060317:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1788459941.060326:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd0a6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+27:6530:x1875336022247680:12345-0@lo:101: 00010000:00010000:0.0:1788459941.060334:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788459941.060344:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4bef209600/0x5dfa74784542adbf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542adb8 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459941.060362:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bef209600/0x5dfa74784542adbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542adb8 expref: 28 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459941.060371:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4bef209600/0x5dfa74784542adbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542adb8 expref: 28 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459941.060379:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bef209600, rc 0) 00000100:00100000:0.0:1788459941.060412:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd0a6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+28:6530:x1875336022247680:12345-0@lo:101: Request processed in 87us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459941.060418:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1788459941.060498:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e60700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022247680:0@lo:101: 00010000:00010000:1.0:1788459941.060510:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4ac395fa00/0x5dfa74784542adb8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542adbf expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459941.060518:0:6530:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4ac395fa00/0x5dfa74784542adb8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542adbf expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788459941.060547:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e60700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022247808:0@lo:501: 00000100:00100000:1.0:1788459941.060581:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459941.060596:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc55edc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788459941.060608:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022247808 00000100:00100000:1.0:1788459941.060611:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022247808 00000100:00100000:1.0:1788459941.060642:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1788459941.060650:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd0a6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+28:6530:x1875336022247808:12345-0@lo:501: 00000100:00100000:1.0:1788459941.060767:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd0a6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+28:6530:x1875336022247808:12345-0@lo:501: Request processed in 106us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459941.060774:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1788459941.060806:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e60700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022247808:0@lo:501: 00000100:00100000:1.0:1788459941.060832:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e60700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022247936:0@lo:503: 00000100:00100000:1.0:1788459941.060871:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459941.060895:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc55edc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788459941.061328:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022247936 00000100:00100000:3.0:1788459941.061333:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022247936 00000100:00100000:3.0:1788459941.061378:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1788459941.061386:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd0a6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+28:6530:x1875336022247936:12345-0@lo:503: 00000100:00100000:3.0:1788459941.061500:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd0a6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+28:6530:x1875336022247936:12345-0@lo:503: Request processed in 114us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459941.061508:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1788459941.061647:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e60700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022247936:0@lo:503: 40000000:02000000:3.0:1788459941.062799:0:6540:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:1.0:1788459941.065219:0:10060:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e62300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0cf73fe6-82e2-434e-b670-631647721b2c:10060:1875336022248064:0@lo:502: 00000100:00100000:1.0:1788459941.065299:0:10060:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459941.065337:0:10060:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bd0b68b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788459941.066020:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022248064 00000100:00100000:2.0:1788459941.066028:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022248064 00000100:00100000:2.0:1788459941.066068:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1788459941.066076:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd0a6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+28:10060:x1875336022248064:12345-0@lo:502: 00000100:00100000:2.0:1788459941.066211:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd0a6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+28:10060:x1875336022248064:12345-0@lo:502: Request processed in 134us (911us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459941.066219:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1788459941.068087:0:10060:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e62300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0cf73fe6-82e2-434e-b670-631647721b2c:10060:1875336022248064:0@lo:502: 00000020:01000000:0.0:1788459941.068208:0:10060:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788459941.068221:0:10060:0:(obd_mount.c:1049:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1788459941.068227:0:10060:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788459941.068230:0:10060:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788459941.068235:0:10060:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788459941.068240:0:10060:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.105@tcp to nid 0x20000c0a8ce69 (192.168.206.105@tcp) 00000020:01000000:0.0:1788459941.068263:0:10060:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788459941.068266:0:10060:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788459941.068281:0:10060:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8c4c019a6620) 00000020:00000080:0.0:1788459941.068304:0:10060:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:0.0:1788459941.068311:0:10060:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788459941.068406:0:10060:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1788459941.068412:0:10060:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:0.0:1788459941.068419:0:10060:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5dfa74784542adcd 00010000:00080000:0.0:1788459941.068465:0:10060:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c4ac35dd000@lustre-OST0001-osc-MDT0000: add connection 192.168.206.105@tcp at head 00010000:00010000:0.0:1788459941.068706:0:10060:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:0.0:1788459941.070324:0:10060:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1788459941.070342:0:10060:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788459941.070533:0:10060:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788459941.070657:0:10060:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788459941.070784:0:10060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1788459941.070877:0:10060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000100:00100000:3.0:1788459941.071969:0:6540:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac383bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8457:x1875336022247168:12345-0@lo:700: Request processed in 16225us (17477us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459941.071982:0:6540:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:00080000:0.0:1788459941.073395:0:10062:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788459941.073402:0:10062:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788459941.074004:0:10060:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788459941.074017:0:10060:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00010000:00080000:2.0:1788459941.074050:0:8457:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3838380 x1875336022247168/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788459957 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000004:01000000:0.0:1788459941.074051:0:10060:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000100:00100000:2.0:1788459941.074080:0:8457:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3838380 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8457:1875336022247168:0@lo:700: 40000000:02000000:2.0:1788459941.074093:0:8457:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000020:00000080:0.0:1788459941.074365:0:10060:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5dfa74784542add4 00000100:00080000:0.0:1788459941.074377:0:10060:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788459941.074382:0:10060:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8c4ac35dd000 using connection 192.168.206.105@tcp/0@lo 00000100:00100000:0.0:1788459941.074415:0:10060:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4ac2976d80 x1875336022248192/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788459941.074456:0:10060:0:(pinger.c:380:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788459941.074515:0:10060:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788459941.074519:0:10060:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788459941.074521:0:10060:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788459941.074524:0:10060:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788459941.074527:0:10060:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788459941.074529:0:10060:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788459941.074531:0:10060:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788459941.074533:0:10060:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788459941.074554:0:10060:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac2976680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0cf73fe6-82e2-434e-b670-631647721b2c:10060:1875336022248320:0@lo:502: 00000100:00100000:0.0:1788459941.074635:0:10060:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459941.074677:0:10060:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bf77a0c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788459941.074692:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac2976d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1875336022248192:0@lo:8: 00000100:00100000:0.0:1788459941.074723:0:3658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459941.074782:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022248320 00000100:00100000:0.0:1788459941.074787:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022248320 00000100:00100000:0.0:1788459941.074824:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788459941.074844:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd0a6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+28:10060:x1875336022248320:12345-0@lo:502: 00000100:00100000:0.0:1788459941.074984:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd0a6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+28:10060:x1875336022248320:12345-0@lo:502: Request processed in 141us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459941.074991:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788459941.075041:0:10060:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac2976680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0cf73fe6-82e2-434e-b670-631647721b2c:10060:1875336022248320:0@lo:502: 00000020:01000000:0.0:1788459941.075078:0:10060:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788459941.075082:0:10060:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788459941.075083:0:10060:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788459941.075087:0:10060:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000100:00100000:1.0:1788459941.075622:0:8832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022248192 00000100:00100000:1.0:1788459941.075628:0:8832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022248192 00000100:00100000:1.0:1788459941.075664:0:8832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788459941.075670:0:8832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc4396d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3658:x1875336022248192:12345-0@lo:8: 00010000:00080000:1.0:1788459941.075693:0:8832:0:(ldlm_lib.c:1461:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 238 last 0 00000020:00000080:1.0:1788459941.075827:0:8832:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5dfa74784542addb 00002000:00100000:1.0:1788459941.075840:0:8832:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8c4ac3846800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a07 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788459941.075844:0:8832:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1788459941.075847:0:8832:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788459941.075906:0:8832:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788459941.075932:0:8832:0:(import.c:65:import_set_state_nolock()) ffff8c4ac3846000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788459941.076002:0:8832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc4396d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3658:x1875336022248192:12345-0@lo:8: Request processed in 331us (1277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459941.076011:0:8832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000020:01000000:1.0:1788459941.076030:0:6530:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:1.0:1788459941.076041:0:6530:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788459941.076051:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac395fa00/0x5dfa74784542adb8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542adbf expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459941.076061:0:6530:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4ac395fa00/0x5dfa74784542adb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542adbf expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788459941.076071:0:6530:0:(mgc_request.c:715:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788459941.076074:0:6530:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-sptlrpc-ffff8c4be2d81000 from 1 10000000:01000000:1.0:1788459941.076076:0:6530:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788459941.076101:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac395e600/0x5dfa74784542ade2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459941.076109:0:6530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4ac395e600/0x5dfa74784542ade2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459941.076132:0:6530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4ac395e600/0x5dfa74784542ade2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788459941.076147:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e63480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022248448:0@lo:101: 00000100:00100000:1.0:1788459941.076175:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459941.076207:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac286ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1788459941.076247:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022248448 00000100:00100000:3.0:1788459941.076252:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022248448 00000100:00100000:3.0:1788459941.076280:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1788459941.076286:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd0a6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+28:6530:x1875336022248448:12345-0@lo:101: 00010000:00010000:3.0:1788459941.076293:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788459941.076305:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4ac2841e00/0x5dfa74784542ade9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542ade2 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459941.076325:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4ac2841e00/0x5dfa74784542ade9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542ade2 expref: 29 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459941.076336:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4ac2841e00/0x5dfa74784542ade9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542ade2 expref: 29 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459941.076345:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ac2841e00, rc 0) 00000100:00100000:3.0:1788459941.076392:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd0a6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+29:6530:x1875336022248448:12345-0@lo:101: Request processed in 105us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459941.076398:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1788459941.076408:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e63480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022248448:0@lo:101: 00010000:00010000:1.0:1788459941.076424:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4ac395e600/0x5dfa74784542ade2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ade9 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459941.076457:0:6530:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4ac395e600/0x5dfa74784542ade2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542ade9 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788459941.076490:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e63480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022248576:0@lo:501: 00000100:00100000:1.0:1788459941.076517:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459941.076543:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac286ca80 going to sleep for 11 seconds 00010000:00080000:0.0:1788459941.076546:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac2976d80 x1875336022248192/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788459951 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788459941.076568:0:3658:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788459941.076574:0:3658:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788459941.076581:0:3658:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788459941.076586:0:3658:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788459941.076589:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c4ac35dd000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788459941.076599:0:3658:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788459941.076603:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac2976d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1875336022248192:0@lo:8: 00000004:00080000:0.0:1788459941.076622:0:10062:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788459941.076669:0:10062:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 238179724404ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788459941.076674:0:10062:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1788459941.076924:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022248576 00000100:00100000:3.0:1788459941.076935:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022248576 00000100:00100000:3.0:1788459941.076980:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1788459941.076987:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd0a6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+29:6530:x1875336022248576:12345-0@lo:501: 00000100:00100000:3.0:1788459941.077065:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd0a6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+29:6530:x1875336022248576:12345-0@lo:501: Request processed in 77us (546us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788459941.077077:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e63480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022248576:0@lo:501: 00000100:00100000:3.0:1788459941.077090:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 10000000:01000000:1.0:1788459941.077097:0:6530:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788459941.077104:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac395e600/0x5dfa74784542ade2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ade9 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459941.077112:0:6530:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4ac395e600/0x5dfa74784542ade2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ade9 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788459941.085006:0:6513:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000001:00100000:0.0:1788459941.095735:0:9527:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788459941.095745:0:9527:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1788459941.099381:0:8457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac383b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:10057:x1875336022247040:12345-0@lo:700: Request processed in 44979us (45075us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459941.099395:0:8457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788459941.099459:0:10057:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3839180 x1875336022247040/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788459957 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788459941.099476:0:10057:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3839180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10057:1875336022247040:0@lo:700: 00000100:00100000:3.0:1788459941.104656:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788459941.104679:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3838000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022248704:0@lo:13: 00000100:00100000:3.0:1788459941.104744:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1788459941.104780:0:10063:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1788459941.104803:0:10063:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3838380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10063:1875336022248832:0@lo:7: 00000100:00100000:3.0:1788459941.104843:0:10063:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459941.104871:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022248832 00000100:00100000:3.0:1788459941.104878:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022248832 00000100:00100000:3.0:1788459941.104931:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788459941.104940:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3838a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:10063:x1875336022248832:12345-0@lo:7: 00000100:00080000:0.0:1788459941.111258:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788459941.111279:0:10063:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc55edc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788459941.112441:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022248704 00000100:00100000:2.0:1788459941.112451:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022248704 00000100:00100000:2.0:1788459941.112509:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788459941.112519:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3839180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3662:x1875336022248704:12345-0@lo:13: 00002000:00000024:2.0:1788459941.112545:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923812352 avail 3692290048 00000100:00100000:2.0:1788459941.112618:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3839180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3662:x1875336022248704:12345-0@lo:13: Request processed in 101us (7875us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459941.112625:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1788459941.114179:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3838000 x1875336022248704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788459957 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788459941.114206:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3838000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022248704:0@lo:13: 00002000:00080000:3.0:1788459941.115294:0:8448:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1788459941.115302:0:8448:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1788459941.116075:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3838a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:10063:x1875336022248832:12345-0@lo:7: Request processed in 11132us (11236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459941.116088:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1788459941.116148:0:10063:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3838380 x1875336022248832/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788459957 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788459941.116162:0:10063:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3838380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10063:1875336022248832:0@lo:7: 00000004:00080000:3.0:1788459941.116176:0:10063:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1788459941.116211:0:10063:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3838380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10063:1875336022248960:0@lo:5: 00000100:00100000:3.0:1788459941.116249:0:10063:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459941.116279:0:10063:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bd1c903c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788459941.116295:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022248960 00000100:00100000:3.0:1788459941.116300:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022248960 00000100:00100000:3.0:1788459941.116344:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788459941.117809:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3838000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:10063:x1875336022248960:12345-0@lo:5: 00002000:00080000:3.0:1788459941.117850:0:8450:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1788459941.117854:0:8450:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1788459941.118217:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3838000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:10063:x1875336022248960:12345-0@lo:5: Request processed in 1864us (1965us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788459941.118226:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1788459941.118270:0:10063:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3838380 x1875336022248960/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788459957 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788459941.118285:0:10063:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3838380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10063:1875336022248960:0@lo:5: 00000004:00080000:3.0:1788459941.118296:0:10063:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1788459941.118330:0:10063:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3839880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10063:1875336022249088:0@lo:700: 00000100:00100000:3.0:1788459941.118374:0:10063:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459941.119653:0:10063:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bd1c903c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788459941.119678:0:8456:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022249088 00000100:00100000:3.0:1788459941.119686:0:8456:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022249088 00000100:00100000:3.0:1788459941.119735:0:8456:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788459941.119752:0:8456:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3839500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:10063:x1875336022249088:12345-0@lo:700: 00000004:00080000:3.0:1788459941.122048:0:10057:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1788459941.122080:0:10057:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3839f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10057:1875336022249344:0@lo:7: 00000100:00100000:3.0:1788459941.122151:0:10057:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459941.122191:0:10057:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bd1c90a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788459941.122210:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022249344 00000100:00100000:3.0:1788459941.122216:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022249344 00000100:00100000:3.0:1788459941.122259:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788459941.122267:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfa1e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:10057:x1875336022249344:12345-0@lo:7: 00000100:00100000:2.0:1788459941.122663:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac383b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022249216:0@lo:13: 00000100:00100000:2.0:1788459941.122701:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459941.122764:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022249216 00000100:00100000:2.0:1788459941.122769:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022249216 00000100:00100000:2.0:1788459941.122796:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788459941.122803:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3671c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3662:x1875336022249216:12345-0@lo:13: 00002000:00000024:2.0:1788459941.122817:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923812352 avail 3692290048 00000100:00100000:2.0:1788459941.123031:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3671c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3662:x1875336022249216:12345-0@lo:13: Request processed in 227us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459941.123038:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1788459941.123075:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac383b800 x1875336022249216/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788459957 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788459941.123094:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac383b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022249216:0@lo:13: 00000001:00080000:2.0:1788459941.123232:0:9527:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:2.0:1788459941.123306:0:8456:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3839500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:10063:x1875336022249088:12345-0@lo:700: Request processed in 3554us (4929us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459941.123314:0:8456:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788459941.123347:0:10063:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3839880 x1875336022249088/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788459957 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788459941.124080:0:10063:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788459941.124096:0:10063:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3839880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10063:1875336022249088:0@lo:700: 00000004:02000040:2.0:1788459941.126725:0:10063:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00002000:00080000:3.0:1788459941.133166:0:8449:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1788459941.133174:0:8449:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1788459941.133251:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfa1e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:10057:x1875336022249344:12345-0@lo:7: Request processed in 10982us (11096us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459941.133261:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1788459941.133309:0:10057:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3839f80 x1875336022249344/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788459957 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788459941.133322:0:10057:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3839f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10057:1875336022249344:0@lo:7: 00000004:00080000:3.0:1788459941.133335:0:10057:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1788459941.133408:0:10057:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfa1e1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10057:1875336022249472:0@lo:5: 00000100:00100000:3.0:1788459941.133452:0:10057:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459941.133485:0:10057:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4c01849300 going to sleep for 11 seconds 00000100:00100000:3.0:1788459941.133502:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022249472 00000100:00100000:3.0:1788459941.133508:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022249472 00000100:00100000:3.0:1788459941.133546:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788459941.133554:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfa1e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:10057:x1875336022249472:12345-0@lo:5: 00002000:00080000:3.0:1788459941.133593:0:8450:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:3.0:1788459941.133630:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfa1e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:10057:x1875336022249472:12345-0@lo:5: Request processed in 76us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459941.133636:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1788459941.133664:0:10057:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bfa1e1f80 x1875336022249472/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788459957 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788459941.133673:0:10057:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfa1e1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10057:1875336022249472:0@lo:5: 00000004:00080000:3.0:1788459941.133680:0:10057:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1788459941.133702:0:10057:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfa1e1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10057:1875336022249600:0@lo:5: 00000100:00100000:3.0:1788459941.133724:0:10057:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459941.133737:0:10057:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4c01849300 going to sleep for 11 seconds 00000100:00100000:3.0:1788459941.133747:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022249600 00000100:00100000:3.0:1788459941.133751:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022249600 00000100:00100000:3.0:1788459941.133770:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788459941.133775:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfa1e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:10057:x1875336022249600:12345-0@lo:5: 00002000:00080000:3.0:1788459941.133794:0:8450:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:2.0:1788459941.136425:0:10063:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3673800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10063:1875336022249728:0@lo:5: 00000100:00100000:2.0:1788459941.136499:0:10063:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459941.136523:0:10063:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc65d7300 going to sleep for 11 seconds 00000100:00100000:3.0:1788459941.139300:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfa1e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:10057:x1875336022249600:12345-0@lo:5: Request processed in 5519us (5569us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788459941.139313:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788459941.139338:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022249728 00000100:00100000:3.0:1788459941.139345:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022249728 00000100:00100000:3.0:1788459941.139388:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788459941.139402:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3671f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:10063:x1875336022249728:12345-0@lo:5: 00010000:00080000:2.0:1788459941.140488:0:10057:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bfa1e1f80 x1875336022249600/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788459957 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788459941.140507:0:10057:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfa1e1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:10057:1875336022249600:0@lo:5: 00000004:00080000:2.0:1788459941.140521:0:10057:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1788459941.140557:0:10057:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3670e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:10057:1875336022249856:0@lo:900: 00000100:00100000:2.0:1788459941.140597:0:10057:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459941.140621:0:10057:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc65d7b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788459941.140639:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022249856 00000100:00100000:2.0:1788459941.140643:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022249856 00000100:00100000:2.0:1788459941.140676:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788459941.140683:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3672a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:10057:x1875336022249856:12345-0@lo:900: 00000100:00100000:2.0:1788459941.140738:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3672a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:10057:x1875336022249856:12345-0@lo:900: Request processed in 56us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459941.140746:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788459941.140785:0:10057:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3670e00 x1875336022249856/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788459957 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788459941.140796:0:10057:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3670e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:10057:1875336022249856:0@lo:900: 00002000:00080000:3.0:1788459941.145504:0:8450:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1788459941.145523:0:8450:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:3.0:1788459941.149304:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3671f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:10063:x1875336022249728:12345-0@lo:5: Request processed in 9899us (12799us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788459941.149317:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1788459941.149494:0:10063:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3673800 x1875336022249728/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788459957 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788459941.149511:0:10063:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3673800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:10063:1875336022249728:0@lo:5: 00000004:00080000:2.0:1788459941.149526:0:10063:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00010000:00010000:2.0:1788459941.653087:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788459941.694800:0:10102:0:(tgt_mount.c:2486:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788459941.694809:0:10102:0:(tgt_mount.c:2501:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:1.0:1788459942.231674:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788459942.232121:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003321984 00000100:00100000:0.0:1788459942.232131:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003321984 00000100:00100000:0.0:1788459942.232178:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 202 00000100:00100000:0.0:1788459942.232185:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd0a6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2392:x1875336003321984:12345-192.168.206.5@tcp:250: 00010000:00080000:0.0:1788459942.232211:0:6525:0:(ldlm_lib.c:1461:target_handle_connect()) MGS: connection from bed032f6-c389-485e-b2f7-e2ea34763c65@192.168.206.5@tcp t0 exp 0000000000000000 cur 239 last 0 00000020:00000080:0.0:1788459942.232256:0:6525:0:(genops.c:1385:class_connect()) connect: client bed032f6-c389-485e-b2f7-e2ea34763c65, cookie 0x5dfa74784542adf0 00000100:00080000:3.0:1788459942.239146:0:6525:0:(import.c:65:import_set_state_nolock()) ffff8c4ac35df800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788459942.239231:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd0a6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bed032f6-c389-485e-b2f7-e2ea34763c65+5:2392:x1875336003321984:12345-192.168.206.5@tcp:250: Request processed in 7041us (7563us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459942.239243:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 202 00000100:00100000:1.0:1788459942.246338:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788459942.246403:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003322112 00000100:00100000:0.0:1788459942.246413:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003322112 00000100:00100000:0.0:1788459942.246480:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 203 00000100:00100000:0.0:1788459942.246507:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd0a6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bed032f6-c389-485e-b2f7-e2ea34763c65+5:6149:x1875336003322112:12345-192.168.206.5@tcp:101: 00010000:00010000:0.0:1788459942.246524:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788459942.246541:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4bef209c00/0x5dfa74784542adf7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a48c expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459942.246575:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bef209c00/0x5dfa74784542adf7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a48c expref: 6 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459942.246587:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4bef209c00/0x5dfa74784542adf7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a48c expref: 6 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459942.246596:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bef209c00, rc 0) 00000100:00100000:0.0:1788459942.246652:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd0a6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bed032f6-c389-485e-b2f7-e2ea34763c65+6:6149:x1875336003322112:12345-192.168.206.5@tcp:101: Request processed in 143us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459942.246659:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 203 00000100:00100000:3.0:1788459942.256671:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788459942.256781:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003322240 00000100:00100000:0.0:1788459942.256791:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003322240 00000100:00100000:0.0:1788459942.256925:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 204 00000100:00100000:0.0:1788459942.256935:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bed032f6-c389-485e-b2f7-e2ea34763c65+6:6149:x1875336003322240:12345-192.168.206.5@tcp:501: 00000100:00100000:0.0:1788459942.257067:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bed032f6-c389-485e-b2f7-e2ea34763c65+6:6149:x1875336003322240:12345-192.168.206.5@tcp:501: Request processed in 133us (406us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788459942.257076:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 204 00000100:00100000:2.0:1788459942.260074:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788459942.260149:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003322368 00000100:00100000:1.0:1788459942.260160:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003322368 00000100:00100000:1.0:1788459942.260211:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 205 00000100:00100000:1.0:1788459942.260221:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bed032f6-c389-485e-b2f7-e2ea34763c65+6:6149:x1875336003322368:12345-192.168.206.5@tcp:101: 00010000:00010000:1.0:1788459942.260236:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788459942.260254:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4ac395fc00/0x5dfa74784542adfe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a493 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459942.260283:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4ac395fc00/0x5dfa74784542adfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a493 expref: 7 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459942.260314:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4ac395fc00/0x5dfa74784542adfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a493 expref: 7 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459942.260323:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ac395fc00, rc 0) 00000100:00100000:1.0:1788459942.260378:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bed032f6-c389-485e-b2f7-e2ea34763c65+7:6149:x1875336003322368:12345-192.168.206.5@tcp:101: Request processed in 159us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459942.260385:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 205 00000100:00100000:1.0:1788459942.262213:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788459942.262289:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003322496 00000100:00100000:3.0:1788459942.262297:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003322496 00000100:00100000:3.0:1788459942.262368:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 206 00000100:00100000:3.0:1788459942.262378:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd0a6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bed032f6-c389-485e-b2f7-e2ea34763c65+7:6149:x1875336003322496:12345-192.168.206.5@tcp:501: 00000100:00100000:3.0:1788459942.262522:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd0a6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bed032f6-c389-485e-b2f7-e2ea34763c65+8:6149:x1875336003322496:12345-192.168.206.5@tcp:501: Request processed in 145us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459942.262530:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 206 00000100:00100000:1.0:1788459942.267129:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788459942.269359:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003322624 00000100:00100000:0.0:1788459942.269374:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003322624 00000100:00100000:0.0:1788459942.269485:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 207 00000100:00100000:0.0:1788459942.269496:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bed032f6-c389-485e-b2f7-e2ea34763c65+8:6149:x1875336003322624:12345-192.168.206.5@tcp:503: 00000100:00100000:0.0:1788459942.269646:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bed032f6-c389-485e-b2f7-e2ea34763c65+8:6149:x1875336003322624:12345-192.168.206.5@tcp:503: Request processed in 151us (2524us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459942.269661:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 207 00000100:00100000:1.0:1788459942.284544:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788459942.284811:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003322752 00000100:00100000:3.0:1788459942.284821:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003322752 00000100:00100000:3.0:1788459942.285033:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 208 00000100:00100000:3.0:1788459942.285044:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bed032f6-c389-485e-b2f7-e2ea34763c65+8:6167:x1875336003322752:12345-192.168.206.5@tcp:502: 00000100:00100000:3.0:1788459942.285280:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bed032f6-c389-485e-b2f7-e2ea34763c65+8:6167:x1875336003322752:12345-192.168.206.5@tcp:502: Request processed in 237us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459942.285288:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 208 00000100:00100000:1.0:1788459942.320240:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788459942.324133:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003322880 00000100:00100000:0.0:1788459942.324148:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003322880 00000100:00100000:2.0:1788459942.327203:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 209 00000100:00100000:2.0:1788459942.327216:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bed032f6-c389-485e-b2f7-e2ea34763c65+8:6167:x1875336003322880:12345-192.168.206.5@tcp:502: 00000100:00100000:2.0:1788459942.327376:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bed032f6-c389-485e-b2f7-e2ea34763c65+8:6167:x1875336003322880:12345-192.168.206.5@tcp:502: Request processed in 161us (7144us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459942.327384:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 209 00000100:00100000:1.0:1788459942.332703:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788459942.332829:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003323008 00000100:00100000:3.0:1788459942.333103:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003323008 00000100:00100000:3.0:1788459942.333156:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 210 00000100:00100000:3.0:1788459942.333166:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bed032f6-c389-485e-b2f7-e2ea34763c65+8:6149:x1875336003323008:12345-192.168.206.5@tcp:101: 00010000:00010000:3.0:1788459942.333182:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788459942.333199:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4ac2840200/0x5dfa74784542ae05 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a4c4 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459942.333245:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4ac2840200/0x5dfa74784542ae05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a4c4 expref: 9 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459942.333255:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4ac2840200/0x5dfa74784542ae05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a4c4 expref: 9 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459942.333264:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ac2840200, rc 0) 00000100:00100000:3.0:1788459942.333320:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bed032f6-c389-485e-b2f7-e2ea34763c65+9:6149:x1875336003323008:12345-192.168.206.5@tcp:101: Request processed in 155us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459942.333327:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 210 00000100:00100000:1.0:1788459942.342108:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788459942.342194:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003323136 00000100:00100000:0.0:1788459942.342203:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003323136 00000100:00100000:0.0:1788459942.342261:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 211 00000100:00100000:0.0:1788459942.342269:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bed032f6-c389-485e-b2f7-e2ea34763c65+9:6149:x1875336003323136:12345-192.168.206.5@tcp:256: 20000000:01000000:0.0:1788459942.342290:0:6528:0:(mgs_nids.c:1209:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788459942.342310:0:6528:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788459942.342314:0:6528:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788459942.342317:0:6528:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788459942.342320:0:6528:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1788459942.342322:0:6528:0:(mgs_nids.c:325:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1788459942.348587:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bed032f6-c389-485e-b2f7-e2ea34763c65+9:6149:x1875336003323136:12345-192.168.206.5@tcp:256: Request processed in 6300us (6470us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459942.348602:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 211 00000100:00100000:1.0:1788459942.357304:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788459942.357451:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003323264 00000100:00100000:2.0:1788459942.357462:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003323264 00000100:00100000:2.0:1788459942.357513:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 212 00000100:00100000:2.0:1788459942.357522:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bed032f6-c389-485e-b2f7-e2ea34763c65+9:6149:x1875336003323264:12345-192.168.206.5@tcp:101: 00010000:00010000:2.0:1788459942.357537:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788459942.357553:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4bfadc7e00/0x5dfa74784542ae0c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a4cb expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459942.357580:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bfadc7e00/0x5dfa74784542ae0c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a4cb expref: 10 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459942.357611:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4bfadc7e00/0x5dfa74784542ae0c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a4cb expref: 10 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459942.357619:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bfadc7e00, rc 0) 00000100:00100000:2.0:1788459942.357675:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bed032f6-c389-485e-b2f7-e2ea34763c65+10:6149:x1875336003323264:12345-192.168.206.5@tcp:101: Request processed in 155us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459942.357682:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 212 00000100:00100000:1.0:1788459942.359530:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788459942.359657:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003323392 00000100:00100000:0.0:1788459942.359666:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003323392 00000100:00100000:0.0:1788459942.359718:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 213 00000100:00100000:0.0:1788459942.359727:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bed032f6-c389-485e-b2f7-e2ea34763c65+10:6149:x1875336003323392:12345-192.168.206.5@tcp:501: 00000100:00100000:0.0:1788459942.360010:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bed032f6-c389-485e-b2f7-e2ea34763c65+10:6149:x1875336003323392:12345-192.168.206.5@tcp:501: Request processed in 283us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459942.360018:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 213 00000100:00100000:1.0:1788459942.366067:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788459942.366192:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003323520 00000100:00100000:3.0:1788459942.366202:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003323520 00000100:00100000:3.0:1788459942.366257:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 214 00000100:00100000:3.0:1788459942.366268:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bed032f6-c389-485e-b2f7-e2ea34763c65+10:6149:x1875336003323520:12345-192.168.206.5@tcp:503: 00000100:00100000:3.0:1788459942.366415:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bed032f6-c389-485e-b2f7-e2ea34763c65+10:6149:x1875336003323520:12345-192.168.206.5@tcp:503: Request processed in 148us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459942.366434:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 214 00000100:00100000:1.0:1788459942.369209:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788459942.369286:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003323648 00000100:00100000:2.0:1788459942.369295:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003323648 00000100:00100000:2.0:1788459942.369341:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 215 00000100:00100000:2.0:1788459942.369354:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bed032f6-c389-485e-b2f7-e2ea34763c65+10:6170:x1875336003323648:12345-192.168.206.5@tcp:502: 00000100:00100000:2.0:1788459942.369489:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bed032f6-c389-485e-b2f7-e2ea34763c65+10:6170:x1875336003323648:12345-192.168.206.5@tcp:502: Request processed in 136us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459942.369497:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 215 00000100:00100000:1.0:1788459942.374510:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788459942.374595:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003323776 00000100:00100000:0.0:1788459942.374604:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003323776 00000100:00100000:0.0:1788459942.374665:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 216 00000100:00100000:0.0:1788459942.374674:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bed032f6-c389-485e-b2f7-e2ea34763c65+10:6170:x1875336003323776:12345-192.168.206.5@tcp:502: 00000100:00100000:0.0:1788459942.374822:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bed032f6-c389-485e-b2f7-e2ea34763c65+10:6170:x1875336003323776:12345-192.168.206.5@tcp:502: Request processed in 149us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459942.374830:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 216 00000100:00100000:1.0:1788459942.384152:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788459942.384194:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788459942.384286:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003323904 00000100:00100000:2.0:1788459942.384296:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003323904 00000100:00100000:2.0:1788459942.384334:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003324160 00000100:00100000:2.0:1788459942.384337:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003324160 00000100:00100000:2.0:1788459942.384375:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 7 00000100:00100000:2.0:1788459942.384382:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac1e63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2392:x1875336003323904:12345-192.168.206.5@tcp:38: 00010000:00080000:2.0:1788459942.384409:0:6534:0:(ldlm_lib.c:1461:target_handle_connect()) lustre-MDT0000: connection from f8767d3e-bfef-4d3d-8163-ef8ae18a3514@192.168.206.5@tcp t0 exp 0000000000000000 cur 239 last 0 00000020:00000080:2.0:1788459942.384465:0:6534:0:(genops.c:1385:class_connect()) connect: client f8767d3e-bfef-4d3d-8163-ef8ae18a3514, cookie 0x5dfa74784542ae13 00000004:00100000:2.0:1788459942.384485:0:6534:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788459942.384691:0:6534:0:(import.c:65:import_set_state_nolock()) ffff8c4ac35ce800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788459942.384746:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac1e63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:2392:x1875336003323904:12345-192.168.206.5@tcp:38: Request processed in 363us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459942.384778:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 7 00000100:00100000:2.0:1788459942.384795:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 8 00000100:00100000:2.0:1788459942.384800:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac1e62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2392:x1875336003324160:12345-192.168.206.5@tcp:38: 00010000:00080000:2.0:1788459942.384815:0:6534:0:(ldlm_lib.c:1461:target_handle_connect()) lustre-MDT0001: connection from f8767d3e-bfef-4d3d-8163-ef8ae18a3514@192.168.206.5@tcp t0 exp 0000000000000000 cur 239 last 0 00000020:00000080:2.0:1788459942.385197:0:6534:0:(genops.c:1385:class_connect()) connect: client f8767d3e-bfef-4d3d-8163-ef8ae18a3514, cookie 0x5dfa74784542ae1a 00000004:00100000:2.0:1788459942.385214:0:6534:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788459942.385916:0:6534:0:(import.c:65:import_set_state_nolock()) ffff8c4ac35cb800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788459942.385992:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac1e62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:2392:x1875336003324160:12345-192.168.206.5@tcp:38: Request processed in 1189us (1796us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459942.386002:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 8 00010000:00010000:1.0:1788459942.673149:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788459943.400969:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788459943.401007:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788459943.401039:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788459943.401162:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003324416 00000100:00100000:1.0:1788459943.401171:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003324416 00000100:00100000:1.0:1788459943.401241:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003324288 00000100:00100000:1.0:1788459943.401245:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003324288 00000100:00100000:1.0:1788459943.401262:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003324032 00000100:00100000:1.0:1788459943.401265:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003324032 00000100:00100000:1.0:1788459943.401280:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 9 00000100:00100000:1.0:1788459943.401303:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3670e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+7:6149:x1875336003324416:12345-192.168.206.5@tcp:41: 00000004:00000024:1.0:1788459943.401338:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1788459943.401406:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3670e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+7:6149:x1875336003324416:12345-192.168.206.5@tcp:41: Request processed in 105us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459943.401423:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 9 00000100:00100000:1.0:1788459943.401442:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 10 00000100:00100000:1.0:1788459943.401449:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3670700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:0:x1875336003324288:12345-192.168.206.5@tcp:41: 00000004:00000024:1.0:1788459943.401466:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446469632 avail 1300230144 00000100:00100000:1.0:1788459943.401490:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3670700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:0:x1875336003324288:12345-192.168.206.5@tcp:41: Request processed in 41us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459943.401496:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 10 00000100:00100000:1.0:1788459943.401509:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 11 00000100:00100000:1.0:1788459943.401515:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3672680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:0:x1875336003324032:12345-192.168.206.5@tcp:41: 00000004:00000024:1.0:1788459943.401525:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1788459943.401545:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3672680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:0:x1875336003324032:12345-192.168.206.5@tcp:41: Request processed in 30us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459943.401550:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 11 00000100:00080000:2.0:1788459943.402607:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788459943.402614:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788459943.409078:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788459943.410638:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003324544 00000100:00100000:0.0:1788459943.410650:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003324544 00000100:00100000:0.0:1788459943.410719:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 12 00000100:00100000:0.0:1788459943.410729:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac1e60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:6149:x1875336003324544:12345-192.168.206.5@tcp:40: 00000100:00100000:0.0:1788459943.410821:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac1e60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:6149:x1875336003324544:12345-192.168.206.5@tcp:40: Request processed in 92us (1751us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459943.410828:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 12 00000100:00100000:1.0:1788459943.419573:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788459943.419835:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788459943.419935:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788459943.419965:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003324928 00000100:00100000:2.0:1788459943.419974:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003324928 00000100:00100000:1.0:1788459943.419983:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788459943.420017:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003324672 00000100:00100000:1.0:1788459943.420021:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003324672 00000100:00100000:2.0:1788459943.420032:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 4 00000100:00100000:1.0:1788459943.420038:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003324800 00000100:00100000:1.0:1788459943.420040:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003324800 00000100:00100000:2.0:1788459943.420041:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac1e62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:6149:x1875336003324928:12345-192.168.206.5@tcp:900: 00000100:00100000:1.0:1788459943.420069:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 16 00000100:00100000:1.0:1788459943.420074:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac1e61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2392:x1875336003324672:12345-192.168.206.5@tcp:8: 00010000:00080000:1.0:1788459943.420096:0:8448:0:(ldlm_lib.c:1461:target_handle_connect()) lustre-OST0000: connection from f8767d3e-bfef-4d3d-8163-ef8ae18a3514@192.168.206.5@tcp t0 exp 0000000000000000 cur 240 last 0 00000100:00100000:2.0:1788459943.420112:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac1e62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:6149:x1875336003324928:12345-192.168.206.5@tcp:900: Request processed in 73us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459943.420120:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 4 00000020:00000080:1.0:1788459943.420123:0:8448:0:(genops.c:1385:class_connect()) connect: client f8767d3e-bfef-4d3d-8163-ef8ae18a3514, cookie 0x5dfa74784542ae21 00002000:00100000:1.0:1788459943.420133:0:8448:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f8767d3e-bfef-4d3d-8163-ef8ae18a3514/ffff8c4ac3841800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a07 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00100000:2.0:1788459943.420142:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 17 00000100:00100000:2.0:1788459943.420146:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac1e61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2392:x1875336003324800:12345-192.168.206.5@tcp:8: 00002000:00100000:1.0:1788459943.420149:0:8448:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00010000:00080000:2.0:1788459943.420160:0:8449:0:(ldlm_lib.c:1461:target_handle_connect()) lustre-OST0001: connection from f8767d3e-bfef-4d3d-8163-ef8ae18a3514@192.168.206.5@tcp t0 exp 0000000000000000 cur 240 last 0 00000020:00000080:2.0:1788459943.420184:0:8449:0:(genops.c:1385:class_connect()) connect: client f8767d3e-bfef-4d3d-8163-ef8ae18a3514, cookie 0x5dfa74784542ae28 00002000:00100000:2.0:1788459943.420189:0:8449:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f8767d3e-bfef-4d3d-8163-ef8ae18a3514/ffff8c4ac35c8000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a07 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788459943.420200:0:8449:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788459943.420300:0:8448:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00002000:00080000:2.0:1788459943.420309:0:8449:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788459943.420325:0:8449:0:(import.c:65:import_set_state_nolock()) ffff8c4ac35cd800 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1788459943.420325:0:8448:0:(import.c:65:import_set_state_nolock()) ffff8c4ac3844800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788459943.420353:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac1e61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:2392:x1875336003324672:12345-192.168.206.5@tcp:8: Request processed in 278us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459943.420360:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 16 00000100:00100000:2.0:1788459943.420689:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac1e61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:2392:x1875336003324800:12345-192.168.206.5@tcp:8: Request processed in 538us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459943.420696:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 17 00000100:00100000:2.0:1788459943.424094:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788459943.424424:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003325056 00000100:00100000:0.0:1788459943.424435:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003325056 00000100:00100000:0.0:1788459943.424483:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 217 00000100:00100000:0.0:1788459943.424491:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bed032f6-c389-485e-b2f7-e2ea34763c65+10:2393:x1875336003325056:12345-192.168.206.5@tcp:400: 00000100:00100000:0.0:1788459943.424571:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bed032f6-c389-485e-b2f7-e2ea34763c65+10:2393:x1875336003325056:12345-192.168.206.5@tcp:400: Request processed in 80us (4951us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459943.424579:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 217 00000100:00100000:3.0:1788459943.426768:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003325184 00000100:00100000:3.0:1788459943.426779:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003325184 00000100:00100000:3.0:1788459943.426837:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 0 00000100:00100000:3.0:1788459943.426846:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3672300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:6149:x1875336003325184:12345-192.168.206.5@tcp:33: 00000004:00080000:3.0:1788459943.466639:0:6536:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 39717us 00000004:00200000:3.0:1788459943.482166:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788459943.482407:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3672300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:6149:x1875336003325184:12345-192.168.206.5@tcp:33: Request processed in 55556us (58315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459943.482439:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 0 00000100:00100000:0.0:1788459943.674109:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788459943.674180:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003325312 00000100:00100000:3.0:1788459943.674191:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003325312 00000100:00100000:3.0:1788459943.674255:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 13 00000100:00100000:3.0:1788459943.674266:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc4397480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:6188:x1875336003325312:12345-192.168.206.5@tcp:101: 00010000:00010000:3.0:1788459943.674288:0:7760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788459943.674376:0:7760:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841a00/0x5dfa74784542ae2f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a4fc expref: -99 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459943.674450:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840600/0x5dfa74784542ae36 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459943.674462:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840600/0x5dfa74784542ae36 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459943.674488:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840600/0x5dfa74784542ae36 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788459943.674533:0:7760:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788459943.674537:0:7760:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788459943.674552:0:7760:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840600/0x5dfa74784542ae36 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459943.674578:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841a00/0x5dfa74784542ae2f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a4fc expref: 8 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459943.674598:0:7760:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840600/0x5dfa74784542ae36 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a4fc expref: 7 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459943.674624:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4bef1ff600) 00010000:00010000:3.0:1788459943.674627:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788459943.674630:0:7760:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ac2840600, rc 0) 00000100:00100000:3.0:1788459943.674753:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc4397480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+7:6188:x1875336003325312:12345-192.168.206.5@tcp:101: Request processed in 480us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459943.674767:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 13 00010000:00010000:1.0:1788459943.697486:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788459944.529437:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3673480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022249984:0@lo:13: 00000100:00100000:0.0:1788459944.529504:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459944.530038:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022249984 00000100:00100000:2.0:1788459944.530047:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022249984 00000100:00100000:2.0:1788459944.530120:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788459944.530324:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc4395c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022249984:12345-0@lo:13: 00002000:00000024:2.0:1788459944.530350:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788459944.530422:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc4395c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022249984:12345-0@lo:13: Request processed in 293us (918us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459944.530429:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1788459944.530498:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788459944.530602:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3673480 x1875336022249984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788459960 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788459944.530622:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3673480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022249984:0@lo:13: 00010000:00010000:0.0:1788459944.721484:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788459945.041910:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788459945.041935:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf2fe9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022250112:0@lo:13: 00000100:00100000:3.0:1788459945.042013:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459945.042084:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788459945.042094:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3673480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022250240:0@lo:41: 00000100:00100000:2.0:1788459945.042204:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459945.042287:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022250112 00000100:00100000:0.0:1788459945.042295:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022250112 00000100:00100000:1.0:1788459945.042340:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022250240 00000100:00100000:1.0:1788459945.042345:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022250240 00000100:00100000:0.0:1788459945.042358:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788459945.042367:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfa1e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022250112:12345-0@lo:13: 00000100:00100000:1.0:1788459945.042371:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788459945.042376:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3670000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022250240:12345-0@lo:41: 00000004:00000024:1.0:1788459945.042401:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00002000:00000024:0.0:1788459945.042402:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788459945.042454:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3670000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022250240:12345-0@lo:41: Request processed in 78us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459945.042454:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfa1e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022250112:12345-0@lo:13: Request processed in 87us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459945.042461:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788459945.042462:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788459945.042505:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3673480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022250240:0@lo:41: 00010000:00080000:3.0:1788459945.042764:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bf2fe9880 x1875336022250112/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788459961 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788459945.042779:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf2fe9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022250112:0@lo:13: 00000100:00080000:2.0:1788459945.043272:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788459945.696904:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788459945.697041:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003325440 00000100:00100000:0.0:1788459945.697051:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003325440 00000100:00100000:0.0:1788459945.697128:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 14 00000100:00100000:0.0:1788459945.697139:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3673b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+7:6240:x1875336003325440:12345-192.168.206.5@tcp:41: 00000004:00000024:0.0:1788459945.697166:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1788459945.697232:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3673b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+7:6240:x1875336003325440:12345-192.168.206.5@tcp:41: Request processed in 95us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459945.697239:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 14 00000100:00080000:2.0:1788459945.697641:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788459945.702522:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788459945.702822:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003325568 00000100:00100000:0.0:1788459945.702831:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003325568 00000100:00100000:0.0:1788459945.702899:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 15 00000100:00100000:0.0:1788459945.702909:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3670380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:6240:x1875336003325568:12345-192.168.206.5@tcp:41: 00000004:00000024:0.0:1788459945.702974:0:6534:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446469632 avail 1300230144 00000100:00100000:0.0:1788459945.703049:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3670380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:6240:x1875336003325568:12345-192.168.206.5@tcp:41: Request processed in 141us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459945.703056:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 15 00000100:00080000:2.0:1788459945.703112:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788459945.709158:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788459945.709248:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003325696 00000100:00100000:0.0:1788459945.709258:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003325696 00000100:00100000:0.0:1788459945.709373:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 14 00000100:00100000:0.0:1788459945.709383:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfa1e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:6240:x1875336003325696:12345-192.168.206.5@tcp:13: 00002000:00000024:0.0:1788459945.709416:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788459945.709485:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfa1e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:6240:x1875336003325696:12345-192.168.206.5@tcp:13: Request processed in 103us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459945.709506:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 14 00000100:00080000:2.0:1788459945.713481:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788459945.716088:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788459945.716187:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003325824 00000100:00100000:3.0:1788459945.716197:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003325824 00000100:00100000:3.0:1788459945.716263:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 15 00000100:00100000:3.0:1788459945.716274:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf2fe8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:6240:x1875336003325824:12345-192.168.206.5@tcp:13: 00002000:00000024:3.0:1788459945.716304:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788459945.716380:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf2fe8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:6240:x1875336003325824:12345-192.168.206.5@tcp:13: Request processed in 108us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459945.716387:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 15 00000100:00080000:2.0:1788459945.717426:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788459945.745090:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788459946.066982:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4395180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022250368:0@lo:41: 00000100:00100000:1.0:1788459946.067127:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459946.075087:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022250368 00000100:00100000:0.0:1788459946.075102:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022250368 00000100:00100000:0.0:1788459946.075458:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788459946.075470:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf2fe8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1875336022250368:12345-0@lo:41: 00000004:00000024:0.0:1788459946.075512:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446469632 avail 1300230144 00000100:00100000:0.0:1788459946.075596:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf2fe8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1875336022250368:12345-0@lo:41: Request processed in 128us (8468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459946.075603:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788459946.075841:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4395180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022250368:0@lo:41: 00000100:00100000:2.0:1788459946.577188:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf2feb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022250624:0@lo:13: 00000100:00100000:2.0:1788459946.577278:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459946.577356:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788459946.577363:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3673100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022250496:0@lo:13: 00000100:00100000:2.0:1788459946.577386:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459946.577435:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022250624 00000100:00100000:2.0:1788459946.577445:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022250624 00000100:00100000:2.0:1788459946.577508:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022250496 00000100:00100000:2.0:1788459946.577511:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022250496 00000100:00100000:2.0:1788459946.577530:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788459946.577538:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3671180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3660:x1875336022250624:12345-0@lo:13: 00002000:00000024:2.0:1788459946.577784:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788459946.577839:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3671180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3660:x1875336022250624:12345-0@lo:13: Request processed in 301us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459946.577847:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788459946.577868:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788459946.577876:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3670a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3660:x1875336022250496:12345-0@lo:13: 00002000:00000024:2.0:1788459946.577886:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788459946.577911:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3670a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3660:x1875336022250496:12345-0@lo:13: Request processed in 36us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459946.577917:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1788459946.577934:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788459946.577991:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3673100 x1875336022250496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788459962 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788459946.578012:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3673100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022250496:0@lo:13: 00010000:00080000:2.0:1788459946.578033:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bf2feb100 x1875336022250624/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788459962 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788459946.578046:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf2feb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022250624:0@lo:13: 00000100:00100000:1.0:1788459946.580177:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf2feaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3662:1875336022250880:0@lo:400: 00000100:00100000:1.0:1788459946.580258:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459946.580309:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfaea8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3662:1875336022251392:0@lo:400: 00000100:00100000:1.0:1788459946.580333:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459946.580351:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3669500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1875336022251904:0@lo:400: 00000100:00100000:1.0:1788459946.580378:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459946.580417:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788459946.580424:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf2fe8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0cf73fe6-82e2-434e-b670-631647721b2c:3662:1875336022250752:0@lo:400: 00000100:00100000:1.0:1788459946.580455:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459946.580482:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf2fe9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3662:1875336022251264:0@lo:400: 00000100:00100000:1.0:1788459946.580505:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459946.580522:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac366ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3662:1875336022251776:0@lo:400: 00000100:00100000:1.0:1788459946.580545:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459946.580572:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022250880 00000100:00100000:1.0:1788459946.580580:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022250880 00000100:00100000:1.0:1788459946.580627:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022251392 00000100:00100000:1.0:1788459946.580630:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022251392 00000100:00100000:1.0:1788459946.580656:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022251904 00000100:00100000:1.0:1788459946.580659:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022251904 00000100:00100000:1.0:1788459946.580671:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022251264 00000100:00100000:1.0:1788459946.580673:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022251264 00000100:00100000:1.0:1788459946.580685:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022251776 00000100:00100000:1.0:1788459946.580688:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022251776 00000100:00100000:1.0:1788459946.580703:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788459946.580711:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3669880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1875336022250880:12345-0@lo:400: 00000100:00100000:1.0:1788459946.580772:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3669880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1875336022250880:12345-0@lo:400: Request processed in 62us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459946.580788:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788459946.580808:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788459946.580814:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3668a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875336022251392:12345-0@lo:400: 00000100:00100000:1.0:1788459946.580845:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3668a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875336022251392:12345-0@lo:400: Request processed in 32us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459946.580851:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788459946.580861:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788459946.580867:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3669180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875336022251904:12345-0@lo:400: 00000100:00100000:1.0:1788459946.580894:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3669180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875336022251904:12345-0@lo:400: Request processed in 28us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459946.580900:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788459946.580911:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788459946.580917:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac366b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1875336022251264:12345-0@lo:400: 00000100:00100000:1.0:1788459946.580988:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac366b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1875336022251264:12345-0@lo:400: Request processed in 71us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459946.580995:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788459946.581007:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788459946.581014:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3668380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1875336022251776:12345-0@lo:400: 00000100:00100000:1.0:1788459946.581040:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3668380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1875336022251776:12345-0@lo:400: Request processed in 27us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459946.581046:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788459946.581082:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf2fe8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022251008:0@lo:400: 00000100:00100000:1.0:1788459946.581112:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459946.581138:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac366a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022251520:0@lo:400: 00000100:00100000:1.0:1788459946.581174:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459946.581198:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788459946.581205:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf2feb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1875336022251136:0@lo:400: 00000100:00100000:1.0:1788459946.581228:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459946.581243:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac366b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022251648:0@lo:400: 00000100:00100000:1.0:1788459946.581261:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459946.581289:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022251008 00000100:00100000:1.0:1788459946.581294:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022251008 00000100:00100000:1.0:1788459946.581325:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788459946.581333:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac366bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022251008:12345-0@lo:400: 00000100:00100000:1.0:1788459946.581373:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac366bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022251008:12345-0@lo:400: Request processed in 41us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459946.581380:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788459946.581413:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022251520 00000100:00100000:1.0:1788459946.581417:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022251520 00000100:00100000:1.0:1788459946.581441:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022251648 00000100:00100000:1.0:1788459946.581444:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022251648 00000100:00100000:1.0:1788459946.581474:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788459946.581481:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3668000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022251520:12345-0@lo:400: 00000100:00100000:1.0:1788459946.581513:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3668000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022251520:12345-0@lo:400: Request processed in 33us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459946.581519:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788459946.581529:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788459946.581535:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac366b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022251648:12345-0@lo:400: 00000100:00100000:1.0:1788459946.581559:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac366b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022251648:12345-0@lo:400: Request processed in 24us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459946.581565:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1788459946.581598:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788459946.581604:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788459946.581606:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788459946.581639:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac366b480 x1875336022251648/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788459962 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788459946.581654:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac366b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022251648:0@lo:400: 00000100:00100000:1.0:1788459946.581665:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf2fe8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022251008:0@lo:400: 00010000:00080000:1.0:1788459946.581674:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac366a300 x1875336022251520/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788459962 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788459946.581682:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac366a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022251520:0@lo:400: 00000100:00100000:1.0:1788459946.581727:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf2fe9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3662:1875336022251264:0@lo:400: 00000100:00100000:1.0:1788459946.581741:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac366ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3662:1875336022251776:0@lo:400: 00000100:00100000:1.0:1788459946.581754:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf2feaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3662:1875336022250880:0@lo:400: 00010000:00080000:1.0:1788459946.581766:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bfaea8000 x1875336022251392/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788459962 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788459946.581775:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfaea8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3662:1875336022251392:0@lo:400: 00010000:00080000:1.0:1788459946.581786:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3669500 x1875336022251904/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788459962 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788459946.581794:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3669500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1875336022251904:0@lo:400: 00000100:00100000:1.0:1788459946.581817:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022251136 00000100:00100000:1.0:1788459946.581820:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022251136 00000100:00100000:1.0:1788459946.581845:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788459946.581851:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3669c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1875336022251136:12345-0@lo:400: 00000100:00100000:1.0:1788459946.581896:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3669c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1875336022251136:12345-0@lo:400: Request processed in 45us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459946.581903:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788459946.581931:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf2feb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1875336022251136:0@lo:400: 00000100:00100000:0.0:1788459946.582084:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022250752 00000100:00100000:0.0:1788459946.582090:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022250752 00000100:00100000:0.0:1788459946.582123:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1788459946.582131:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+29:3662:x1875336022250752:12345-0@lo:400: 00000100:00100000:0.0:1788459946.582173:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+29:3662:x1875336022250752:12345-0@lo:400: Request processed in 44us (1718us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459946.582178:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1788459946.582862:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf2fe8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0cf73fe6-82e2-434e-b670-631647721b2c:3662:1875336022250752:0@lo:400: 00010000:00010000:0.0:1788459946.769281:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788459947.095932:0:8443:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f8767d3e-bfef-4d3d-8163-ef8ae18a3514 00000001:00100000:0.0:1788459947.099742:0:9527:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f8767d3e-bfef-4d3d-8163-ef8ae18a3514 00000001:00080000:0.0:1788459947.099764:0:9527:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00080000:0.0:1788459947.099777:0:9527:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000001:00100000:0.0:1788459947.607983:0:7465:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of f8767d3e-bfef-4d3d-8163-ef8ae18a3514 00000001:00100000:2.0:1788459947.608001:0:6513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f8767d3e-bfef-4d3d-8163-ef8ae18a3514 00010000:00010000:1.0:1788459947.793518:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788459948.059612:0:10200:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1788459948.481053:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788459948.481111:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788459948.481151:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788459948.481179:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788459948.481222:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788459948.481263:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003326208 00000100:00100000:1.0:1788459948.481272:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003326208 00000100:00100000:1.0:1788459948.481331:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003326080 00000100:00100000:1.0:1788459948.481334:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003326080 00000100:00100000:3.0:1788459948.481381:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 51 00000100:00100000:3.0:1788459948.481422:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3669500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2393:x1875336003326208:12345-192.168.206.5@tcp:400: 00000100:00100000:2.0:1788459948.481432:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003325952 00000100:00100000:2.0:1788459948.481439:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003325952 00000100:00100000:2.0:1788459948.481491:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 219 00000100:00100000:2.0:1788459948.481501:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bed032f6-c389-485e-b2f7-e2ea34763c65+10:2393:x1875336003325952:12345-192.168.206.5@tcp:400: 00000100:00100000:3.0:1788459948.481606:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3669500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2393:x1875336003326208:12345-192.168.206.5@tcp:400: Request processed in 195us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459948.481721:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003326464 00000100:00100000:0.0:1788459948.481730:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003326464 00000100:00100000:0.0:1788459948.481779:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003326336 00000100:00100000:0.0:1788459948.481782:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003326336 00000100:00100000:0.0:1788459948.481806:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 12 00000100:00100000:0.0:1788459948.481815:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac366ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2393:x1875336003326464:12345-192.168.206.5@tcp:400: 00000100:00100000:1.0:1788459948.481876:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 52 00000100:00100000:1.0:1788459948.481889:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac366a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:2393:x1875336003326080:12345-192.168.206.5@tcp:400: 00000100:00100000:3.0:1788459948.481929:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 51 00000100:00100000:3.0:1788459948.481999:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 13 00000100:00100000:3.0:1788459948.482009:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac366b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2393:x1875336003326336:12345-192.168.206.5@tcp:400: 00000100:00100000:0.0:1788459948.485300:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac366ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2393:x1875336003326464:12345-192.168.206.5@tcp:400: Request processed in 3468us (4130us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459948.485320:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 12 00000100:00100000:2.0:1788459948.485406:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bed032f6-c389-485e-b2f7-e2ea34763c65+10:2393:x1875336003325952:12345-192.168.206.5@tcp:400: Request processed in 3882us (4337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459948.485423:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 219 00000100:00080000:0.0:1788459948.485527:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788459948.485536:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788459948.485545:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788459948.485548:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788459948.486892:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac366b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2393:x1875336003326336:12345-192.168.206.5@tcp:400: Request processed in 4872us (5657us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459948.486908:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 13 00000100:00100000:1.0:1788459948.491054:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac366a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:2393:x1875336003326080:12345-192.168.206.5@tcp:400: Request processed in 9158us (9862us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459948.491070:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 52 00010000:00010000:1.0:1788459948.818475:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788459949.662378:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3673100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022252032:0@lo:13: 00000100:00100000:0.0:1788459949.662490:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459949.663149:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022252032 00000100:00100000:3.0:1788459949.663162:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022252032 00000100:00100000:3.0:1788459949.663243:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788459949.663254:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc4396300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022252032:12345-0@lo:13: 00002000:00000024:3.0:1788459949.663294:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1788459949.665065:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788459949.668583:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc4396300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022252032:12345-0@lo:13: Request processed in 5314us (6076us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459949.668614:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1788459949.671793:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3673100 x1875336022252032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788459965 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788459949.671831:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3673100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022252032:0@lo:13: 00010000:00010000:2.0:1788459949.843428:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788459950.161416:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3669f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022252160:0@lo:13: 00000100:00100000:0.0:1788459950.161519:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459950.161701:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022252160 00000100:00100000:1.0:1788459950.161711:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022252160 00000100:00100000:1.0:1788459950.161795:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788459950.161806:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc4395180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022252160:12345-0@lo:13: 00002000:00000024:1.0:1788459950.161848:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788459950.162017:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc4395180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022252160:12345-0@lo:13: Request processed in 212us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459950.162026:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1788459950.162075:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3669f80 x1875336022252160/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788459966 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788459950.162095:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3669f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022252160:0@lo:13: 00000100:00080000:0.0:1788459950.162527:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788459950.162839:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfa1e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022252288:0@lo:41: 00000100:00100000:1.0:1788459950.162908:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459950.163089:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022252288 00000100:00100000:0.0:1788459950.163096:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022252288 00000100:00100000:0.0:1788459950.163149:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788459950.163158:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3669f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022252288:12345-0@lo:41: 00000004:00000024:0.0:1788459950.163194:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1788459950.163241:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3669f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022252288:12345-0@lo:41: Request processed in 85us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459950.163249:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788459950.163601:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfa1e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022252288:0@lo:41: 00010000:00010000:0.0:1788459950.866077:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788459951.185127:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3671880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022252416:0@lo:41: 00000100:00100000:1.0:1788459951.185209:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459951.185397:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022252416 00000100:00100000:2.0:1788459951.185406:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022252416 00000100:00100000:2.0:1788459951.185458:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788459951.185468:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3668e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1875336022252416:12345-0@lo:41: 00000004:00000024:2.0:1788459951.185501:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446469632 avail 1300230144 00000100:00100000:2.0:1788459951.185545:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3668e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1875336022252416:12345-0@lo:41: Request processed in 78us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459951.185552:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788459951.186068:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3671880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022252416:0@lo:41: 00000020:00000080:2.0:1788459951.221532:0:10347:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc9208da80 20000000:00000080:2.0:1788459951.221550:0:10347:0:(mgs_handler.c:1172:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8c4bf7795800 uarg=0000000000000000 20000000:01000000:2.0:1788459951.221590:0:10347:0:(mgs_llog.c:2012:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1788459951.221592:0:10347:0:(mgs_llog.c:6075:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1788459951.221595:0:10347:0:(mgs_llog.c:6106:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1788459951.221605:0:10347:0:(mgs_llog.c:4754:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1788459951.221610:0:10347:0:(mgs_llog.c:4187:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1788459951.222075:0:10347:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788459951.222079:0:10347:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788459951.222811:0:10348:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:2.0:1788459951.223260:0:10347:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:2.0:1788459951.223426:0:10347:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:2.0:1788459951.223449:0:10347:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:2.0:1788459951.223461:0:10347:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788459951.223463:0:10347:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788459951.223889:0:10349:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:2.0:1788459951.224455:0:10347:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:2.0:1788459951.224481:0:10347:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:2.0:1788459951.224495:0:10347:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:2.0:1788459951.224583:0:10347:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788459951.224587:0:10347:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788459951.225097:0:10350:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:2.0:1788459951.225267:0:10347:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:2.0:1788459951.225437:0:10347:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:2.0:1788459951.225461:0:10347:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:2.0:1788459951.225473:0:10347:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1788459951.225475:0:10347:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788459951.226204:0:10351:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:2.0:1788459951.226588:0:10347:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:2.0:1788459951.226618:0:10347:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:2.0:1788459951.226636:0:10347:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:2.0:1788459951.226649:0:10347:0:(mgs_llog.c:2556:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1788459951.226651:0:10347:0:(mgs_llog.c:1115:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788459951.227434:0:10352:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:2.0:1788459951.227755:0:10347:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:2.0:1788459951.227781:0:10347:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:2.0:1788459951.227798:0:10347:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 10000000:01000000:2.0:1788459951.227813:0:10347:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788459951.227833:0:10347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c4bfadc7600/0x5dfa74784542ae3d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459951.227851:0:10347:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4bc0030a00/0x5dfa74784542ac84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542ac7d expref: 28 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459951.227874:0:10347:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4bfadc7800/0x5dfa74784542ac92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542ac8b expref: 28 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459951.227881:0:10347:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4bc0031c00/0x5dfa74784542acca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542acc3 expref: 28 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459951.227887:0:10347:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4ac2841400/0x5dfa74784542ad17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542ad10 expref: 28 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459951.227895:0:10347:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4ac2841800/0x5dfa74784542ad33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542ad2c expref: 28 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459951.227901:0:10347:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4ac2840a00/0x5dfa74784542ad41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542ad3a expref: 28 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459951.227908:0:10347:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4bef208000/0x5dfa74784542ad4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542ad48 expref: 28 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459951.227914:0:10347:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4ac2840000/0x5dfa74784542ad6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542ad64 expref: 28 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459951.228052:0:10347:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4bef209a00/0x5dfa74784542ad95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542ad8e expref: 28 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459951.228059:0:10347:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4ac395fe00/0x5dfa74784542ada3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542ad9c expref: 28 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459951.228066:0:10347:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4bef209600/0x5dfa74784542adbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542adb8 expref: 28 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459951.228082:0:10347:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4ac2841e00/0x5dfa74784542ade9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542ade2 expref: 28 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459951.228092:0:10347:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4bef209c00/0x5dfa74784542adf7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a48c expref: 9 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459951.228099:0:10347:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4ac395fc00/0x5dfa74784542adfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a493 expref: 9 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459951.228106:0:10347:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c4bfadc7600/0x5dfa74784542ae3d lrc: 17/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459951.228141:0:10347:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4ac395fc00/0x5dfa74784542adfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000000000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a493 expref: 9 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459951.228155:0:10347:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c4ac395fc00/0x5dfa74784542adfe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x70000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a493 expref: 9 pid: 6526 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788459951.228169:0:10347:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3671880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10347:1875336022252544:192.168.206.5@tcp:104: 00010000:00010000:2.0:1788459951.228308:0:10347:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4bef209c00/0x5dfa74784542adf7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000000000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a48c expref: 9 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459951.228317:0:10347:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c4bef209c00/0x5dfa74784542adf7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x70000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a48c expref: 9 pid: 6528 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788459951.228325:0:10347:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3673100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10347:1875336022252672:192.168.206.5@tcp:104: 00010000:00010000:2.0:1788459951.228350:0:10347:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4ac2841e00/0x5dfa74784542ade9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5dfa74784542ade2 expref: 28 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459951.228367:0:10347:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c4ac2841e00/0x5dfa74784542ade9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5dfa74784542ade2 expref: 28 pid: 6526 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788459951.228387:0:10347:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3673480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10347:1875336022252800:0@lo:104: 00000100:00100000:2.0:1788459951.228425:0:10347:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788459951.228454:0:10347:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4bef209600/0x5dfa74784542adbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5dfa74784542adb8 expref: 28 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459951.228461:0:10347:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c4bef209600/0x5dfa74784542adbf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5dfa74784542adb8 expref: 28 pid: 6528 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788459951.228469:0:10347:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3839880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10347:1875336022252928:0@lo:104: 00000100:00100000:2.0:1788459951.228485:0:10347:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788459951.228560:0:10347:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4ac395fe00/0x5dfa74784542ada3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5dfa74784542ad9c expref: 28 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459951.228568:0:10347:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c4ac395fe00/0x5dfa74784542ada3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5dfa74784542ad9c expref: 28 pid: 6526 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788459951.228576:0:10347:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac383b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10347:1875336022253056:0@lo:104: 00000100:00100000:2.0:1788459951.228594:0:10347:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788459951.229086:0:10347:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4bef209a00/0x5dfa74784542ad95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5dfa74784542ad8e expref: 28 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459951.229095:0:10347:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c4bef209a00/0x5dfa74784542ad95 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5dfa74784542ad8e expref: 28 pid: 6526 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788459951.229104:0:10347:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf7711880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10347:1875336022253184:0@lo:104: 00000100:00100000:2.0:1788459951.229131:0:10347:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459951.229196:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022252800 00000100:00100000:0.0:1788459951.229202:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022252800 00000100:00100000:0.0:1788459951.229236:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022252928 00000100:00100000:0.0:1788459951.229243:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022252928 00000100:00100000:0.0:1788459951.229252:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022253056 00000100:00100000:0.0:1788459951.229254:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022253056 00000100:00100000:0.0:1788459951.229264:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788459951.229271:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3839f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0cf73fe6-82e2-434e-b670-631647721b2c+5:10347:x1875336022252800:12345-0@lo:104: 00010000:00010000:0.0:1788459951.229282:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.206.105@tcp lock: ffff8c4ac395e600/0x5dfa74784542ade2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542ade9 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459951.229431:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788459951.229437:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3839f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0cf73fe6-82e2-434e-b670-631647721b2c+5:10347:x1875336022252800:12345-0@lo:104: Request processed in 166us (1011us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459951.229443:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788459951.229458:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788459951.229464:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3838380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0cf73fe6-82e2-434e-b670-631647721b2c+4:10347:x1875336022252928:12345-0@lo:104: 00010000:00010000:0.0:1788459951.229471:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.206.105@tcp lock: ffff8c4ac395fa00/0x5dfa74784542adb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542adbf expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459951.229501:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:1.0:1788459951.229585:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788459951.229593:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: ffff8c4ac395e600/0x5dfa74784542ade2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542ade9 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459951.229601:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac395e600 already unused, calling callback (ffffffffc125ae00) 10000000:00010000:1.0:1788459951.229605:0:6522:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: ffff8c4ac395e600/0x5dfa74784542ade2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x1400400000000 nid: local remote: 0x5dfa74784542ade9 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459951.229626:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: ffff8c4ac395e600/0x5dfa74784542ade2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x1408400000000 nid: local remote: 0x5dfa74784542ade9 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788459951.229633:0:6522:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: ffff8c4ac395e600/0x5dfa74784542ade2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x1409400000000 nid: local remote: 0x5dfa74784542ade9 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788459951.229639:0:6522:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788459951.229746:0:6522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.206.105@tcp lock: ffff8c4ac395e600/0x5dfa74784542ade2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542ade9 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459951.229754:0:6522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788459951.229772:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: ffff8c4ac395e600/0x5dfa74784542ade2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542ade9 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459951.229778:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: ffff8c4ac395e600/0x5dfa74784542ade2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542ade9 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459951.229790:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788459951.229793:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: ffff8c4ac395fa00/0x5dfa74784542adb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542adbf expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459951.229799:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac395fa00 already unused, calling callback (ffffffffc125ae00) 10000000:00010000:1.0:1788459951.229802:0:6522:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: ffff8c4ac395fa00/0x5dfa74784542adb8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1400400000000 nid: local remote: 0x5dfa74784542adbf expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459951.229809:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: ffff8c4ac395fa00/0x5dfa74784542adb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1408400000000 nid: local remote: 0x5dfa74784542adbf expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788459951.229816:0:6522:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: ffff8c4ac395fa00/0x5dfa74784542adb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1409400000000 nid: local remote: 0x5dfa74784542adbf expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788459951.229826:0:6522:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788459951.229841:0:6522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.206.105@tcp lock: ffff8c4ac395fa00/0x5dfa74784542adb8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542adbf expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459951.229847:0:6522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788459951.229852:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: ffff8c4ac395fa00/0x5dfa74784542adb8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542adbf expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459951.229858:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: ffff8c4ac395fa00/0x5dfa74784542adb8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542adbf expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459951.229867:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788459951.229869:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788459951.229871:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788459951.229890:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3668700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0cf73fe6-82e2-434e-b670-631647721b2c:3660:1875336022253440:0@lo:103: 00000100:00100000:0.0:1788459951.230003:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3838380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0cf73fe6-82e2-434e-b670-631647721b2c+4:10347:x1875336022252928:12345-0@lo:104: Request processed in 539us (1517us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459951.230012:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788459951.230028:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788459951.230035:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf7711f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0cf73fe6-82e2-434e-b670-631647721b2c+3:10347:x1875336022253056:12345-0@lo:104: 00010000:00010000:0.0:1788459951.230043:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.206.105@tcp lock: ffff8c4ac395ec00/0x5dfa74784542ad9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542ada3 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459951.230078:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788459951.230083:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf7711f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0cf73fe6-82e2-434e-b670-631647721b2c+3:10347:x1875336022253056:12345-0@lo:104: Request processed in 50us (1489us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459951.230094:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:0.0:1788459951.230109:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788459951.230114:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: ffff8c4ac395ec00/0x5dfa74784542ad9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542ada3 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459951.230120:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac395ec00 already unused, calling callback (ffffffffc125ae00) 10000000:00010000:0.0:1788459951.230123:0:6521:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: ffff8c4ac395ec00/0x5dfa74784542ad9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400400000000 nid: local remote: 0x5dfa74784542ada3 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459951.230129:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: ffff8c4ac395ec00/0x5dfa74784542ad9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1408400000000 nid: local remote: 0x5dfa74784542ada3 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788459951.230135:0:6521:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: ffff8c4ac395ec00/0x5dfa74784542ad9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1409400000000 nid: local remote: 0x5dfa74784542ada3 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788459951.230139:0:6521:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788459951.230159:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.206.105@tcp lock: ffff8c4ac395ec00/0x5dfa74784542ad9c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542ada3 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459951.230164:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788459951.230177:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: ffff8c4ac395ec00/0x5dfa74784542ad9c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542ada3 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459951.230183:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: ffff8c4ac395ec00/0x5dfa74784542ad9c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542ada3 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459951.230191:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788459951.230192:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788459951.230194:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788459951.230203:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac366aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0cf73fe6-82e2-434e-b670-631647721b2c:3659:1875336022253312:0@lo:103: 00010000:00010000:0.0:1788459951.230233:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788459951.230241:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac2976d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0cf73fe6-82e2-434e-b670-631647721b2c:3661:1875336022253568:0@lo:103: 00010000:00010000:2.0:1788459951.230484:0:10347:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4ac2840000/0x5dfa74784542ad6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5dfa74784542ad64 expref: 28 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459951.230494:0:10347:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c4ac2840000/0x5dfa74784542ad6b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5dfa74784542ad64 expref: 28 pid: 6525 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788459951.230581:0:10347:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc471a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10347:1875336022253696:0@lo:104: 00000100:00100000:2.0:1788459951.230611:0:10347:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788459951.230633:0:10347:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4bef208000/0x5dfa74784542ad4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5dfa74784542ad48 expref: 28 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459951.230641:0:10347:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c4bef208000/0x5dfa74784542ad4f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5dfa74784542ad48 expref: 28 pid: 6528 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788459951.230649:0:10347:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc43f8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10347:1875336022253824:0@lo:104: 00000100:00100000:1.0:1788459951.230756:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459951.230827:0:10347:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788459951.230848:0:10347:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4ac2840a00/0x5dfa74784542ad41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5dfa74784542ad3a expref: 28 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459951.230858:0:10347:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c4ac2840a00/0x5dfa74784542ad41 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5dfa74784542ad3a expref: 28 pid: 6526 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788459951.230866:0:10347:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc43f9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10347:1875336022253952:0@lo:104: 00010000:00010000:2.0:1788459951.230906:0:10347:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4ac2841800/0x5dfa74784542ad33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5dfa74784542ad2c expref: 28 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459951.230914:0:10347:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c4ac2841800/0x5dfa74784542ad33 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5dfa74784542ad2c expref: 28 pid: 6525 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788459951.231119:0:6516:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788459951.231139:0:6516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459951.231150:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022253184 00000100:00100000:3.0:1788459951.231157:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022253184 00000100:00100000:3.0:1788459951.231185:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022253696 00000100:00100000:3.0:1788459951.231188:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022253696 00000100:00100000:3.0:1788459951.231196:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022253824 00000100:00100000:3.0:1788459951.231199:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022253824 00000100:00100000:3.0:1788459951.231205:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022253952 00000100:00100000:3.0:1788459951.231208:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022253952 00000100:00100000:3.0:1788459951.231217:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788459951.231222:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc471a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0cf73fe6-82e2-434e-b670-631647721b2c+6:10347:x1875336022253184:12345-0@lo:104: 00010000:00010000:3.0:1788459951.231231:0:6516:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.206.105@tcp lock: ffff8c4ac395e000/0x5dfa74784542ad8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542ad95 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459951.231449:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788459951.231455:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc471a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0cf73fe6-82e2-434e-b670-631647721b2c+6:10347:x1875336022253184:12345-0@lo:104: Request processed in 232us (2322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459951.231462:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788459951.231478:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788459951.231485:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc43fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0cf73fe6-82e2-434e-b670-631647721b2c+5:10347:x1875336022253696:12345-0@lo:104: 00010000:00010000:3.0:1788459951.231493:0:6516:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7200/0x5dfa74784542ad64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542ad6b expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788459951.231582:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459951.231618:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022253440 00000100:00100000:0.0:1788459951.231622:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022253440 00010000:00010000:0.0:1788459951.231639:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4bef209600/0x5dfa74784542adbf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542adb8 expref: 29 pid: 6528 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788459951.231658:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022253312 00000100:00100000:0.0:1788459951.231684:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022253312 00010000:00010000:0.0:1788459951.231697:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4ac2841e00/0x5dfa74784542ade9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542ade2 expref: 30 pid: 6526 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788459951.231719:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788459951.231726:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac366a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0cf73fe6-82e2-434e-b670-631647721b2c+30:3660:x1875336022253440:12345-0@lo:103: 00010000:00010000:0.0:1788459951.231736:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788459951.231740:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4bef209600/0x5dfa74784542adbf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 18 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542adb8 expref: 30 pid: 6528 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788459951.231801:0:10347:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10347:1875336022254080:0@lo:104: 00000100:00100000:2.0:1788459951.231820:0:9549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788459951.231829:0:9549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac2976680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0cf73fe6-82e2-434e-b670-631647721b2c+30:3659:x1875336022253312:12345-0@lo:103: 00010000:00010000:2.0:1788459951.231837:0:9549:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788459951.231841:0:9549:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4ac2841e00/0x5dfa74784542ade9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 18 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542ade2 expref: 30 pid: 6526 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459951.232045:0:9537:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788459951.232052:0:9537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: ffff8c4ac395e000/0x5dfa74784542ad8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542ad95 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459951.232059:0:9537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac395e000 already unused, calling callback (ffffffffc125ae00) 10000000:00010000:1.0:1788459951.232062:0:9537:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: ffff8c4ac395e000/0x5dfa74784542ad8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0x5dfa74784542ad95 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459951.232069:0:9537:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: ffff8c4ac395e000/0x5dfa74784542ad8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x5dfa74784542ad95 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788459951.232076:0:9537:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: ffff8c4ac395e000/0x5dfa74784542ad8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x5dfa74784542ad95 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788459951.232091:0:9537:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788459951.232120:0:9537:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.206.105@tcp lock: ffff8c4ac395e000/0x5dfa74784542ad8e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542ad95 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459951.232127:0:9537:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788459951.232139:0:9537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: ffff8c4ac395e000/0x5dfa74784542ad8e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542ad95 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459951.232145:0:9537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: ffff8c4ac395e000/0x5dfa74784542ad8e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542ad95 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459951.232156:0:9537:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788459951.232159:0:9537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7200/0x5dfa74784542ad64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542ad6b expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459951.232164:0:9537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bfadc7200 already unused, calling callback (ffffffffc125ae00) 10000000:00010000:1.0:1788459951.232166:0:9537:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7200/0x5dfa74784542ad64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x5dfa74784542ad6b expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459951.232172:0:9537:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7200/0x5dfa74784542ad64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x5dfa74784542ad6b expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788459951.232177:0:9537:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7200/0x5dfa74784542ad64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x5dfa74784542ad6b expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788459951.232182:0:9537:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788459951.232194:0:9537:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7200/0x5dfa74784542ad64 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542ad6b expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459951.232200:0:9537:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788459951.232218:0:9537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7200/0x5dfa74784542ad64 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542ad6b expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459951.232225:0:9537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7200/0x5dfa74784542ad64 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542ad6b expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459951.232233:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788459951.232235:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788459951.232237:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788459951.232250:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788459951.232259:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf2fe8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0cf73fe6-82e2-434e-b670-631647721b2c:3660:1875336022254336:0@lo:103: 00010000:00010000:0.0:1788459951.232449:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4bef209600/0x5dfa74784542adbf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 18 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5dfa74784542adb8 expref: 30 pid: 6528 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459951.232466:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788459951.232494:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac366a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0cf73fe6-82e2-434e-b670-631647721b2c+30:3660:x1875336022253440:12345-0@lo:103: Request processed in 769us (1739us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459951.232502:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788459951.232600:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfaea8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0cf73fe6-82e2-434e-b670-631647721b2c:3662:1875336022254208:0@lo:103: 00010000:00010000:2.0:1788459951.232753:0:9549:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4ac2841e00/0x5dfa74784542ade9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5dfa74784542ade2 expref: 29 pid: 6526 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459951.232766:0:9549:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788459951.232803:0:9549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac2976680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0cf73fe6-82e2-434e-b670-631647721b2c+29:3659:x1875336022253312:12345-0@lo:103: Request processed in 976us (1220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459951.232809:0:9549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788459951.232847:0:10347:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788459951.232886:0:10347:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4ac2841400/0x5dfa74784542ad17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5dfa74784542ad10 expref: 28 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459951.232896:0:10347:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c4ac2841400/0x5dfa74784542ad17 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5dfa74784542ad10 expref: 28 pid: 6526 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788459951.232905:0:10347:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10347:1875336022254464:0@lo:104: 00010000:00010000:3.0:1788459951.233136:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:3.0:1788459951.233143:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc43fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0cf73fe6-82e2-434e-b670-631647721b2c+5:10347:x1875336022253696:12345-0@lo:104: Request processed in 1659us (2532us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459951.233150:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788459951.233167:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022254080 00000100:00100000:3.0:1788459951.233172:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022254080 00000100:00100000:3.0:1788459951.233190:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788459951.233196:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac37f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0cf73fe6-82e2-434e-b670-631647721b2c+5:10347:x1875336022253824:12345-0@lo:104: 00010000:00010000:3.0:1788459951.233205:0:6516:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.206.105@tcp lock: ffff8c4bef208800/0x5dfa74784542ad48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542ad4f expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459951.233244:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788459951.233249:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac37f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0cf73fe6-82e2-434e-b670-631647721b2c+5:10347:x1875336022253824:12345-0@lo:104: Request processed in 53us (2422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459951.233255:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788459951.233286:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788459951.233445:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459951.233492:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3668700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0cf73fe6-82e2-434e-b670-631647721b2c:3660:1875336022253440:0@lo:103: 00000100:00100000:1.0:1788459951.233517:0:9538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022254336 00000100:00100000:1.0:1788459951.233521:0:9538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022254336 00010000:00010000:1.0:1788459951.233538:0:9538:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4ac2840000/0x5dfa74784542ad6b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542ad64 expref: 29 pid: 6525 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788459951.233556:0:9538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788459951.233563:0:9538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf2feb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0cf73fe6-82e2-434e-b670-631647721b2c+29:3660:x1875336022254336:12345-0@lo:103: 00010000:00010000:1.0:1788459951.233572:0:9538:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788459951.233576:0:9538:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4ac2840000/0x5dfa74784542ad6b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542ad64 expref: 29 pid: 6525 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459951.233584:0:9538:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4ac2840000/0x5dfa74784542ad6b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5dfa74784542ad64 expref: 29 pid: 6525 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459951.233596:0:9538:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788459951.233623:0:9538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf2feb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0cf73fe6-82e2-434e-b670-631647721b2c+29:3660:x1875336022254336:12345-0@lo:103: Request processed in 61us (1333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459951.233641:0:9538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788459951.233775:0:10347:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788459951.233806:0:10347:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4bc0031c00/0x5dfa74784542acca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5dfa74784542acc3 expref: 28 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459951.233814:0:10347:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c4bc0031c00/0x5dfa74784542acca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5dfa74784542acc3 expref: 28 pid: 6525 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788459951.233835:0:10347:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10347:1875336022254592:0@lo:104: 00000100:00100000:2.0:1788459951.233860:0:10347:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788459951.233878:0:10347:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4bfadc7800/0x5dfa74784542ac92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5dfa74784542ac8b expref: 28 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459951.233886:0:10347:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c4bfadc7800/0x5dfa74784542ac92 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5dfa74784542ac8b expref: 28 pid: 6525 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788459951.233894:0:10347:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10347:1875336022254720:0@lo:104: 00000100:00100000:2.0:1788459951.233913:0:10347:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459951.234067:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf2fe8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0cf73fe6-82e2-434e-b670-631647721b2c:3660:1875336022254336:0@lo:103: 00000100:00100000:3.0:1788459951.234158:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfa1e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0cf73fe6-82e2-434e-b670-631647721b2c+4:10347:x1875336022253952:12345-0@lo:104: 00010000:00010000:3.0:1788459951.234173:0:6516:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.206.105@tcp lock: ffff8c4ac395ea00/0x5dfa74784542ad3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542ad41 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459951.234266:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788459951.234273:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: ffff8c4bef208800/0x5dfa74784542ad48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542ad4f expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459951.234286:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bef208800 already unused, calling callback (ffffffffc125ae00) 10000000:00010000:0.0:1788459951.234303:0:6521:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: ffff8c4bef208800/0x5dfa74784542ad48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x5dfa74784542ad4f expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459951.234312:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: ffff8c4bef208800/0x5dfa74784542ad48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x5dfa74784542ad4f expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788459951.234318:0:6521:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: ffff8c4bef208800/0x5dfa74784542ad48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x5dfa74784542ad4f expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788459951.234324:0:6521:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788459951.234367:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.206.105@tcp lock: ffff8c4bef208800/0x5dfa74784542ad48 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542ad4f expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459951.234385:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788459951.234401:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: ffff8c4bef208800/0x5dfa74784542ad48 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542ad4f expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459951.234408:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: ffff8c4bef208800/0x5dfa74784542ad48 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542ad4f expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459951.234420:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788459951.234421:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788459951.234423:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788459951.234434:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459951.234475:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022254208 00000100:00100000:0.0:1788459951.234479:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022254208 00010000:00010000:0.0:1788459951.234497:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4bef209a00/0x5dfa74784542ad95 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542ad8e expref: 29 pid: 6526 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788459951.234533:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788459951.234539:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3afa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0cf73fe6-82e2-434e-b670-631647721b2c+29:3662:x1875336022254208:12345-0@lo:103: 00010000:00010000:0.0:1788459951.234548:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788459951.234553:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4bef209a00/0x5dfa74784542ad95 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542ad8e expref: 29 pid: 6526 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459951.234561:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4bef209a00/0x5dfa74784542ad95 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5dfa74784542ad8e expref: 29 pid: 6526 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459951.234573:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788459951.234602:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3afa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0cf73fe6-82e2-434e-b670-631647721b2c+29:3662:x1875336022254208:12345-0@lo:103: Request processed in 64us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459951.234608:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788459951.234632:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459951.234907:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac366aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0cf73fe6-82e2-434e-b670-631647721b2c:3659:1875336022253312:0@lo:103: 00000100:00100000:0.0:1788459951.234929:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788459951.234937:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3afa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0cf73fe6-82e2-434e-b670-631647721b2c:3659:1875336022254848:0@lo:103: 00000100:00100000:0.0:1788459951.234992:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459951.235024:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfaea8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0cf73fe6-82e2-434e-b670-631647721b2c:3662:1875336022254208:0@lo:103: 00000100:00100000:0.0:1788459951.235040:0:9538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022253568 00000100:00100000:0.0:1788459951.235044:0:9538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022253568 00010000:00010000:0.0:1788459951.235057:0:9538:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4ac395fe00/0x5dfa74784542ada3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542ad9c expref: 29 pid: 6526 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788459951.235075:0:9538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022254848 00000100:00100000:0.0:1788459951.235078:0:9538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022254848 00010000:00010000:0.0:1788459951.235088:0:9538:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4bef208000/0x5dfa74784542ad4f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542ad48 expref: 30 pid: 6528 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788459951.235111:0:9538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788459951.235118:0:9538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bedf6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0cf73fe6-82e2-434e-b670-631647721b2c+30:3661:x1875336022253568:12345-0@lo:103: 00010000:00010000:0.0:1788459951.235125:0:9538:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788459951.235129:0:9538:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4ac395fe00/0x5dfa74784542ada3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542ad9c expref: 30 pid: 6526 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459951.235137:0:9538:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4ac395fe00/0x5dfa74784542ada3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5dfa74784542ad9c expref: 30 pid: 6526 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459951.235148:0:9538:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788459951.235174:0:9538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bedf6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0cf73fe6-82e2-434e-b670-631647721b2c+30:3661:x1875336022253568:12345-0@lo:103: Request processed in 57us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459951.235180:0:9538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788459951.235211:0:9538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788459951.235217:0:9538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3afb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0cf73fe6-82e2-434e-b670-631647721b2c+29:3659:x1875336022254848:12345-0@lo:103: 00010000:00010000:0.0:1788459951.235222:0:9538:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788459951.235227:0:9538:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4bef208000/0x5dfa74784542ad4f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542ad48 expref: 29 pid: 6528 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459951.235234:0:9538:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4bef208000/0x5dfa74784542ad4f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5dfa74784542ad48 expref: 29 pid: 6528 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459951.235242:0:9538:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788459951.235267:0:9538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3afb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0cf73fe6-82e2-434e-b670-631647721b2c+29:3659:x1875336022254848:12345-0@lo:103: Request processed in 50us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459951.235273:0:9538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788459951.235315:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac2976d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0cf73fe6-82e2-434e-b670-631647721b2c:3661:1875336022253568:0@lo:103: 00000100:00100000:0.0:1788459951.235343:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3afa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0cf73fe6-82e2-434e-b670-631647721b2c:3659:1875336022254848:0@lo:103: 00000100:00100000:0.0:1788459951.235360:0:6517:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:0.0:1788459951.235366:0:6517:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:2.0:1788459951.235883:0:10347:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4bc0030a00/0x5dfa74784542ac84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5dfa74784542ac7d expref: 28 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459951.235894:0:10347:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c4bc0030a00/0x5dfa74784542ac84 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5dfa74784542ac7d expref: 28 pid: 6526 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788459951.235904:0:10347:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10347:1875336022254976:0@lo:104: 00000100:00100000:2.0:1788459951.236243:0:10347:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459951.236263:0:10347:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc65d73c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788459951.236279:0:10347:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3671880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10347:1875336022252544:192.168.206.5@tcp:104: 00010000:00010000:3.0:1788459951.236462:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788459951.236469:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfa1e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0cf73fe6-82e2-434e-b670-631647721b2c+4:10347:x1875336022253952:12345-0@lo:104: Request processed in 3177us (5329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459951.236478:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788459951.236497:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022254464 00000100:00100000:3.0:1788459951.236502:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022254464 00000100:00100000:3.0:1788459951.236520:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022254592 00000100:00100000:3.0:1788459951.236523:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022254592 00000100:00100000:3.0:1788459951.236532:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022254720 00000100:00100000:3.0:1788459951.236534:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022254720 00000100:00100000:3.0:1788459951.236543:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022254976 00000100:00100000:3.0:1788459951.236545:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022254976 00000100:00100000:3.0:1788459951.236555:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788459951.236562:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3af7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0cf73fe6-82e2-434e-b670-631647721b2c+7:10347:x1875336022254080:12345-0@lo:104: 00010000:00010000:3.0:1788459951.236572:0:6516:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6800/0x5dfa74784542ad2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542ad33 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459951.236612:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788459951.236617:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3af7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0cf73fe6-82e2-434e-b670-631647721b2c+7:10347:x1875336022254080:12345-0@lo:104: Request processed in 56us (3770us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459951.236622:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788459951.236633:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788459951.236639:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3af5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0cf73fe6-82e2-434e-b670-631647721b2c+6:10347:x1875336022254464:12345-0@lo:104: 00010000:00010000:3.0:1788459951.236646:0:6516:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.206.105@tcp lock: ffff8c4bc0031800/0x5dfa74784542ad10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542ad17 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459951.236743:0:9536:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788459951.236749:0:9536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: ffff8c4ac395ea00/0x5dfa74784542ad3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542ad41 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459951.236756:0:9536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac395ea00 already unused, calling callback (ffffffffc125ae00) 10000000:00010000:0.0:1788459951.236761:0:9536:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: ffff8c4ac395ea00/0x5dfa74784542ad3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x5dfa74784542ad41 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459951.236770:0:9536:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: ffff8c4ac395ea00/0x5dfa74784542ad3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x5dfa74784542ad41 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788459951.236777:0:9536:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: ffff8c4ac395ea00/0x5dfa74784542ad3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x5dfa74784542ad41 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788459951.236782:0:9536:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788459951.236810:0:9536:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.206.105@tcp lock: ffff8c4ac395ea00/0x5dfa74784542ad3a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542ad41 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459951.236816:0:9536:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788459951.236830:0:9536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: ffff8c4ac395ea00/0x5dfa74784542ad3a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542ad41 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459951.236836:0:9536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: ffff8c4ac395ea00/0x5dfa74784542ad3a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542ad41 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459951.236848:0:9536:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788459951.236851:0:9536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6800/0x5dfa74784542ad2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542ad33 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459951.236864:0:9536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bfadc6800 already unused, calling callback (ffffffffc125ae00) 10000000:00010000:0.0:1788459951.236867:0:9536:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6800/0x5dfa74784542ad2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x5dfa74784542ad33 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459951.236874:0:9536:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6800/0x5dfa74784542ad2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x5dfa74784542ad33 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788459951.236880:0:9536:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6800/0x5dfa74784542ad2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x5dfa74784542ad33 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788459951.236884:0:9536:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788459951.236899:0:9536:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6800/0x5dfa74784542ad2c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542ad33 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459951.236904:0:9536:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788459951.236910:0:9536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6800/0x5dfa74784542ad2c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542ad33 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459951.236916:0:9536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6800/0x5dfa74784542ad2c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542ad33 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459951.236936:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788459951.236938:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788459951.236939:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788459951.236966:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3afa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0cf73fe6-82e2-434e-b670-631647721b2c:3662:1875336022255232:0@lo:103: 00000100:00100000:0.0:1788459951.236995:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459951.237017:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788459951.237022:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3afa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0cf73fe6-82e2-434e-b670-631647721b2c:3662:1875336022255104:0@lo:103: 00000100:00100000:0.0:1788459951.237052:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459951.237077:0:9549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022255232 00000100:00100000:0.0:1788459951.237080:0:9549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022255232 00010000:00010000:0.0:1788459951.237096:0:9549:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4ac2841800/0x5dfa74784542ad33 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542ad2c expref: 29 pid: 6525 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788459951.237114:0:9549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022255104 00000100:00100000:0.0:1788459951.237117:0:9549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022255104 00010000:00010000:0.0:1788459951.237129:0:9549:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4ac2840a00/0x5dfa74784542ad41 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542ad3a expref: 30 pid: 6526 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788459951.237145:0:9549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788459951.237151:0:9549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3afad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0cf73fe6-82e2-434e-b670-631647721b2c+30:3662:x1875336022255232:12345-0@lo:103: 00010000:00010000:0.0:1788459951.237159:0:9549:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788459951.237163:0:9549:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4ac2841800/0x5dfa74784542ad33 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542ad2c expref: 30 pid: 6525 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459951.237171:0:9549:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4ac2841800/0x5dfa74784542ad33 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5dfa74784542ad2c expref: 30 pid: 6525 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459951.237184:0:9549:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788459951.237209:0:9549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3afad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0cf73fe6-82e2-434e-b670-631647721b2c+30:3662:x1875336022255232:12345-0@lo:103: Request processed in 59us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459951.237215:0:9549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788459951.237228:0:9549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788459951.237234:0:9549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3af9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0cf73fe6-82e2-434e-b670-631647721b2c+29:3662:x1875336022255104:12345-0@lo:103: 00010000:00010000:0.0:1788459951.237241:0:9549:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788459951.237245:0:9549:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4ac2840a00/0x5dfa74784542ad41 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542ad3a expref: 29 pid: 6526 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459951.237264:0:9549:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4ac2840a00/0x5dfa74784542ad41 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5dfa74784542ad3a expref: 29 pid: 6526 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459951.237273:0:9549:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788459951.237487:0:9549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3af9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0cf73fe6-82e2-434e-b670-631647721b2c+29:3662:x1875336022255104:12345-0@lo:103: Request processed in 252us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459951.237493:0:9549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788459951.237528:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3afa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0cf73fe6-82e2-434e-b670-631647721b2c:3662:1875336022255104:0@lo:103: 00000100:00100000:0.0:1788459951.237535:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3afa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0cf73fe6-82e2-434e-b670-631647721b2c:3662:1875336022255232:0@lo:103: 00000100:00100000:2.0:1788459951.237597:0:10347:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3673100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10347:1875336022252672:192.168.206.5@tcp:104: 00010000:00010000:2.0:1788459951.237616:0:10347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4ac2841e00/0x5dfa74784542ade9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5dfa74784542ade2 expref: 28 pid: 6526 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788459951.237627:0:10347:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3673480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10347:1875336022252800:0@lo:104: 00010000:00010000:2.0:1788459951.237636:0:10347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4bef209600/0x5dfa74784542adbf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5dfa74784542adb8 expref: 27 pid: 6528 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788459951.237656:0:10347:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3839880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10347:1875336022252928:0@lo:104: 00010000:00010000:2.0:1788459951.237679:0:10347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4ac395fe00/0x5dfa74784542ada3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5dfa74784542ad9c expref: 26 pid: 6526 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788459951.237687:0:10347:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac383b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10347:1875336022253056:0@lo:104: 00010000:00010000:2.0:1788459951.237696:0:10347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4bef209a00/0x5dfa74784542ad95 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5dfa74784542ad8e expref: 25 pid: 6526 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788459951.237702:0:10347:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf7711880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10347:1875336022253184:0@lo:104: 00010000:00010000:2.0:1788459951.237711:0:10347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4ac2840000/0x5dfa74784542ad6b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5dfa74784542ad64 expref: 24 pid: 6525 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788459951.237718:0:10347:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc471a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10347:1875336022253696:0@lo:104: 00010000:00010000:2.0:1788459951.237727:0:10347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4bef208000/0x5dfa74784542ad4f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5dfa74784542ad48 expref: 23 pid: 6528 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788459951.237733:0:10347:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc43f8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10347:1875336022253824:0@lo:104: 00010000:00010000:2.0:1788459951.237742:0:10347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4ac2840a00/0x5dfa74784542ad41 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5dfa74784542ad3a expref: 22 pid: 6526 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788459951.237749:0:10347:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc43f9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10347:1875336022253952:0@lo:104: 00010000:00010000:2.0:1788459951.237756:0:10347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4ac2841800/0x5dfa74784542ad33 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5dfa74784542ad2c expref: 21 pid: 6525 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788459951.237763:0:10347:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10347:1875336022254080:0@lo:104: 00010000:00010000:3.0:1788459951.237925:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788459951.237931:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3af5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0cf73fe6-82e2-434e-b670-631647721b2c+6:10347:x1875336022254464:12345-0@lo:104: Request processed in 1292us (4157us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459951.237938:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788459951.237970:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788459951.237978:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3af4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0cf73fe6-82e2-434e-b670-631647721b2c+5:10347:x1875336022254592:12345-0@lo:104: 00010000:00010000:3.0:1788459951.237987:0:6516:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7400/0x5dfa74784542acc3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542acca expref: -99 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459951.238021:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788459951.238026:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3af4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0cf73fe6-82e2-434e-b670-631647721b2c+5:10347:x1875336022254592:12345-0@lo:104: Request processed in 50us (4165us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459951.238032:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788459951.238044:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788459951.238050:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3af7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0cf73fe6-82e2-434e-b670-631647721b2c+4:10347:x1875336022254720:12345-0@lo:104: 00010000:00010000:3.0:1788459951.238058:0:6516:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.206.105@tcp lock: ffff8c4ac2841000/0x5dfa74784542ac8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542ac92 expref: -99 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459951.238082:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788459951.238087:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3af7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0cf73fe6-82e2-434e-b670-631647721b2c+4:10347:x1875336022254720:12345-0@lo:104: Request processed in 38us (4174us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459951.238092:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788459951.238103:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788459951.238108:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3af7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0cf73fe6-82e2-434e-b670-631647721b2c+3:10347:x1875336022254976:12345-0@lo:104: 00010000:00010000:3.0:1788459951.238115:0:6516:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6a00/0x5dfa74784542ac7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542ac84 expref: -99 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459951.238150:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1788459951.238155:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3af7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0cf73fe6-82e2-434e-b670-631647721b2c+3:10347:x1875336022254976:12345-0@lo:104: Request processed in 47us (1913us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459951.238161:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:3.0:1788459951.238179:0:9536:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788459951.238183:0:9536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: ffff8c4bc0031800/0x5dfa74784542ad10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542ad17 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459951.238189:0:9536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc0031800 already unused, calling callback (ffffffffc125ae00) 10000000:00010000:3.0:1788459951.238192:0:9536:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: ffff8c4bc0031800/0x5dfa74784542ad10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5dfa74784542ad17 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459951.238200:0:9536:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: ffff8c4bc0031800/0x5dfa74784542ad10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5dfa74784542ad17 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788459951.238208:0:9536:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: ffff8c4bc0031800/0x5dfa74784542ad10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5dfa74784542ad17 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788459951.238213:0:9536:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788459951.238232:0:9536:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.206.105@tcp lock: ffff8c4bc0031800/0x5dfa74784542ad10 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542ad17 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459951.238238:0:9536:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788459951.238254:0:9536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: ffff8c4bc0031800/0x5dfa74784542ad10 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542ad17 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459951.238260:0:9536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: ffff8c4bc0031800/0x5dfa74784542ad10 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542ad17 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459951.238281:0:9536:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788459951.238284:0:9536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7400/0x5dfa74784542acc3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542acca expref: -99 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459951.238416:0:9536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bfadc7400 already unused, calling callback (ffffffffc125ae00) 10000000:00010000:3.0:1788459951.238420:0:9536:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7400/0x5dfa74784542acc3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5dfa74784542acca expref: -99 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459951.238427:0:9536:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7400/0x5dfa74784542acc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5dfa74784542acca expref: -99 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788459951.238433:0:9536:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7400/0x5dfa74784542acc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5dfa74784542acca expref: -99 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788459951.238438:0:9536:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788459951.238453:0:9536:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7400/0x5dfa74784542acc3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542acca expref: -99 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459951.238459:0:9536:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788459951.238464:0:9536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7400/0x5dfa74784542acc3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542acca expref: -99 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459951.238470:0:9536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7400/0x5dfa74784542acc3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542acca expref: -99 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459951.238479:0:9536:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788459951.238483:0:9536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: ffff8c4ac2841000/0x5dfa74784542ac8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542ac92 expref: -99 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459951.238500:0:9536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac2841000 already unused, calling callback (ffffffffc125ae00) 10000000:00010000:3.0:1788459951.238503:0:9536:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: ffff8c4ac2841000/0x5dfa74784542ac8b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5dfa74784542ac92 expref: -99 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459951.238509:0:9536:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: ffff8c4ac2841000/0x5dfa74784542ac8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5dfa74784542ac92 expref: -99 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788459951.238514:0:9536:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: ffff8c4ac2841000/0x5dfa74784542ac8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5dfa74784542ac92 expref: -99 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788459951.238519:0:9536:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788459951.238531:0:9536:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.206.105@tcp lock: ffff8c4ac2841000/0x5dfa74784542ac8b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542ac92 expref: -99 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459951.238537:0:9536:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788459951.238549:0:9536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: ffff8c4ac2841000/0x5dfa74784542ac8b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542ac92 expref: -99 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459951.238555:0:9536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: ffff8c4ac2841000/0x5dfa74784542ac8b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542ac92 expref: -99 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459951.238563:0:9536:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788459951.238565:0:9536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6a00/0x5dfa74784542ac7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542ac84 expref: -99 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459951.238570:0:9536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bfadc6a00 already unused, calling callback (ffffffffc125ae00) 10000000:00010000:3.0:1788459951.238572:0:9536:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6a00/0x5dfa74784542ac7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5dfa74784542ac84 expref: -99 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459951.238588:0:9536:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6a00/0x5dfa74784542ac7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5dfa74784542ac84 expref: -99 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788459951.238593:0:9536:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6a00/0x5dfa74784542ac7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5dfa74784542ac84 expref: -99 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788459951.238597:0:9536:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788459951.238609:0:9536:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6a00/0x5dfa74784542ac7d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542ac84 expref: -99 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459951.238615:0:9536:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788459951.238620:0:9536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6a00/0x5dfa74784542ac7d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542ac84 expref: -99 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459951.238626:0:9536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6a00/0x5dfa74784542ac7d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542ac84 expref: -99 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459951.238638:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788459951.238639:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788459951.238641:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788459951.238652:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfa1e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0cf73fe6-82e2-434e-b670-631647721b2c:3661:1875336022255616:0@lo:103: 00000100:00100000:3.0:1788459951.238742:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459951.238774:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788459951.238779:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfa1e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0cf73fe6-82e2-434e-b670-631647721b2c:3661:1875336022255744:0@lo:103: 00000100:00100000:3.0:1788459951.238800:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459951.238829:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022255616 00000100:00100000:3.0:1788459951.238834:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022255616 00010000:00010000:3.0:1788459951.238853:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4bfadc7800/0x5dfa74784542ac92 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542ac8b expref: 21 pid: 6525 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788459951.238884:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022255744 00000100:00100000:3.0:1788459951.238889:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022255744 00010000:00010000:3.0:1788459951.238900:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4bc0030a00/0x5dfa74784542ac84 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542ac7d expref: 22 pid: 6526 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788459951.238916:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788459951.238921:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfa1e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0cf73fe6-82e2-434e-b670-631647721b2c+22:3661:x1875336022255616:12345-0@lo:103: 00010000:00010000:3.0:1788459951.238972:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788459951.238978:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4bfadc7800/0x5dfa74784542ac92 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542ac8b expref: 22 pid: 6525 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459951.238987:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4bfadc7800/0x5dfa74784542ac92 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5dfa74784542ac8b expref: 22 pid: 6525 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459951.239000:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788459951.239027:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfa1e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0cf73fe6-82e2-434e-b670-631647721b2c+22:3661:x1875336022255616:12345-0@lo:103: Request processed in 106us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459951.239032:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788459951.239046:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788459951.239051:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfa1e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0cf73fe6-82e2-434e-b670-631647721b2c+21:3661:x1875336022255744:12345-0@lo:103: 00010000:00010000:3.0:1788459951.239057:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788459951.239061:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4bc0030a00/0x5dfa74784542ac84 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542ac7d expref: 21 pid: 6526 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459951.239068:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4bc0030a00/0x5dfa74784542ac84 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5dfa74784542ac7d expref: 21 pid: 6526 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459951.239076:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788459951.239106:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfa1e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0cf73fe6-82e2-434e-b670-631647721b2c+21:3661:x1875336022255744:12345-0@lo:103: Request processed in 55us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459951.239111:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788459951.239137:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfa1e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0cf73fe6-82e2-434e-b670-631647721b2c:3661:1875336022255744:0@lo:103: 00000100:00100000:3.0:1788459951.239144:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfa1e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0cf73fe6-82e2-434e-b670-631647721b2c:3661:1875336022255616:0@lo:103: 00000100:00100000:3.0:1788459951.239162:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfa1e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0cf73fe6-82e2-434e-b670-631647721b2c:3659:1875336022255360:0@lo:103: 00000100:00100000:3.0:1788459951.239182:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459951.239200:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788459951.239205:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfa1e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0cf73fe6-82e2-434e-b670-631647721b2c:3659:1875336022255488:0@lo:103: 00000100:00100000:3.0:1788459951.239225:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459951.239246:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022255360 00000100:00100000:3.0:1788459951.239249:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022255360 00010000:00010000:3.0:1788459951.239261:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4ac2841400/0x5dfa74784542ad17 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542ad10 expref: 21 pid: 6526 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788459951.239273:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022255488 00000100:00100000:3.0:1788459951.239275:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022255488 00010000:00010000:3.0:1788459951.239284:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4bc0031c00/0x5dfa74784542acca lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542acc3 expref: 22 pid: 6525 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788459951.239491:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788459951.239498:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfa1e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0cf73fe6-82e2-434e-b670-631647721b2c+22:3659:x1875336022255360:12345-0@lo:103: 00010000:00010000:3.0:1788459951.239505:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788459951.239509:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4ac2841400/0x5dfa74784542ad17 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542ad10 expref: 22 pid: 6526 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459951.239517:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4ac2841400/0x5dfa74784542ad17 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5dfa74784542ad10 expref: 22 pid: 6526 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459951.239537:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788459951.239565:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfa1e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0cf73fe6-82e2-434e-b670-631647721b2c+22:3659:x1875336022255360:12345-0@lo:103: Request processed in 69us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459951.239571:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788459951.239583:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788459951.239588:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bedf6c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0cf73fe6-82e2-434e-b670-631647721b2c+21:3659:x1875336022255488:12345-0@lo:103: 00010000:00010000:3.0:1788459951.239594:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788459951.239598:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4bc0031c00/0x5dfa74784542acca lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542acc3 expref: 21 pid: 6525 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459951.239605:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4bc0031c00/0x5dfa74784542acca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5dfa74784542acc3 expref: 21 pid: 6525 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459951.239614:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788459951.239634:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bedf6c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0cf73fe6-82e2-434e-b670-631647721b2c+21:3659:x1875336022255488:12345-0@lo:103: Request processed in 46us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459951.239639:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:0.0:1788459951.239769:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788459951.239823:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788459951.239829:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788459951.239847:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfa1e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0cf73fe6-82e2-434e-b670-631647721b2c:3659:1875336022255488:0@lo:103: 00000100:00100000:3.0:1788459951.239856:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfa1e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0cf73fe6-82e2-434e-b670-631647721b2c:3659:1875336022255360:0@lo:103: 00010000:00010000:2.0:1788459951.240229:0:10347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4ac2841400/0x5dfa74784542ad17 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5dfa74784542ad10 expref: 20 pid: 6526 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788459951.240249:0:10347:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10347:1875336022254464:0@lo:104: 00010000:00010000:2.0:1788459951.240262:0:10347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4bc0031c00/0x5dfa74784542acca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5dfa74784542acc3 expref: 19 pid: 6525 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788459951.240270:0:10347:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10347:1875336022254592:0@lo:104: 00010000:00010000:2.0:1788459951.240279:0:10347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4bfadc7800/0x5dfa74784542ac92 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5dfa74784542ac8b expref: 18 pid: 6525 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788459951.240286:0:10347:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10347:1875336022254720:0@lo:104: 00010000:00010000:2.0:1788459951.240311:0:10347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4bc0030a00/0x5dfa74784542ac84 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5dfa74784542ac7d expref: 17 pid: 6526 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788459951.240318:0:10347:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10347:1875336022254976:0@lo:104: 00010000:00010000:2.0:1788459951.240362:0:10347:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c4bfadc7600/0x5dfa74784542ae3d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788459951.240592:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788459951.240746:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003326592 00000100:00100000:3.0:1788459951.240752:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003326592 00010000:00010000:3.0:1788459951.240773:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4ac395fc00/0x5dfa74784542adfe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a493 expref: 10 pid: 6526 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788459951.240807:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 41 00000100:00100000:3.0:1788459951.240823:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf2fe8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bed032f6-c389-485e-b2f7-e2ea34763c65+10:2394:x1875336003326592:12345-192.168.206.5@tcp:103: 00010000:00010000:3.0:1788459951.240832:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788459951.240837:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4ac395fc00/0x5dfa74784542adfe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a493 expref: 10 pid: 6526 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459951.240847:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4ac395fc00/0x5dfa74784542adfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a493 expref: 10 pid: 6526 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459951.240860:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4ac395fc00/0x5dfa74784542adfe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a493 expref: 10 pid: 6526 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459951.240871:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788459951.240913:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf2fe8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bed032f6-c389-485e-b2f7-e2ea34763c65+9:2394:x1875336003326592:12345-192.168.206.5@tcp:103: Request processed in 91us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459951.240933:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 41 00000100:00100000:1.0:1788459951.241109:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788459951.241210:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003326720 00000100:00100000:2.0:1788459951.241215:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003326720 00010000:00010000:2.0:1788459951.241233:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4bef209c00/0x5dfa74784542adf7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a48c expref: 9 pid: 6528 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788459951.241263:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 42 00000100:00100000:2.0:1788459951.241270:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf2feaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bed032f6-c389-485e-b2f7-e2ea34763c65+9:2394:x1875336003326720:12345-192.168.206.5@tcp:103: 00010000:00010000:2.0:1788459951.241278:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788459951.241282:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4bef209c00/0x5dfa74784542adf7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a48c expref: 9 pid: 6528 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459951.241438:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4bef209c00/0x5dfa74784542adf7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a48c expref: 9 pid: 6528 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459951.241449:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4bef209c00/0x5dfa74784542adf7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a48c expref: 9 pid: 6528 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459951.241459:0:6520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c4bfadc7600/0x5dfa74784542ae3d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459951.241466:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bfadc7600/0x5dfa74784542ae3d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459951.241480:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c4bfadc7600/0x5dfa74784542ae3d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459951.241486:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c4bfadc7600/0x5dfa74784542ae3d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459951.241492:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c4bfadc7600/0x5dfa74784542ae3d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459951.241499:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c4bfadc7600/0x5dfa74784542ae3d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459951.241504:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bfadc7600 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:2.0:1788459951.241508:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c4bfadc7600/0x5dfa74784542ae3d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459951.241515:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c4bfadc7600/0x5dfa74784542ae3d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459951.241540:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c4bfadc7600/0x5dfa74784542ae3d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459951.241548:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788459951.241580:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf2feaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bed032f6-c389-485e-b2f7-e2ea34763c65+8:2394:x1875336003326720:12345-192.168.206.5@tcp:103: Request processed in 310us (913us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459951.241587:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 42 00010000:00010000:2.0:1788459951.241631:0:10347:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c4bfadc7600/0x5dfa74784542ae3d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459951.241638:0:10347:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c4bfadc7600/0x5dfa74784542ae3d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459951.241643:0:10347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4bfadc7600/0x5dfa74784542ae3d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10347 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788459951.584069:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788459951.584325:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003326848 00000100:00100000:1.0:1788459951.584335:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003326848 00000100:00100000:1.0:1788459951.584404:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 220 00000100:00100000:1.0:1788459951.584415:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bed032f6-c389-485e-b2f7-e2ea34763c65+8:6163:x1875336003326848:12345-192.168.206.5@tcp:101: 00010000:00010000:1.0:1788459951.584619:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788459951.584639:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4ac395e000/0x5dfa74784542ae44 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a503 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459951.584676:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4ac395e000/0x5dfa74784542ae44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a503 expref: 9 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459951.584688:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4ac395e000/0x5dfa74784542ae44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a503 expref: 9 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459951.584696:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ac395e000, rc 0) 00000100:00100000:1.0:1788459951.584805:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bed032f6-c389-485e-b2f7-e2ea34763c65+9:6163:x1875336003326848:12345-192.168.206.5@tcp:101: Request processed in 390us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459951.584811:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 220 00000100:00100000:2.0:1788459951.598192:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788459951.598354:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003326976 00000100:00100000:1.0:1788459951.598364:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003326976 00000100:00100000:1.0:1788459951.598507:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 221 00000100:00100000:1.0:1788459951.598519:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4c02042850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bed032f6-c389-485e-b2f7-e2ea34763c65+9:6163:x1875336003326976:12345-192.168.206.5@tcp:501: 00000100:00100000:1.0:1788459951.600073:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4c02042850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bed032f6-c389-485e-b2f7-e2ea34763c65+9:6163:x1875336003326976:12345-192.168.206.5@tcp:501: Request processed in 1549us (1882us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459951.600104:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 221 00000100:00100000:0.0:1788459951.602336:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788459951.603472:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003327104 00000100:00100000:1.0:1788459951.603483:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003327104 00000100:00100000:1.0:1788459951.603542:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 222 00000100:00100000:1.0:1788459951.603552:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc844a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bed032f6-c389-485e-b2f7-e2ea34763c65+9:6163:x1875336003327104:12345-192.168.206.5@tcp:503: 00000100:00100000:1.0:1788459951.603839:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc844a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bed032f6-c389-485e-b2f7-e2ea34763c65+9:6163:x1875336003327104:12345-192.168.206.5@tcp:503: Request processed in 288us (1509us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459951.603848:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 222 00000100:00100000:3.0:1788459951.614331:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788459951.614499:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003327232 00000100:00100000:0.0:1788459951.614508:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003327232 00000100:00100000:0.0:1788459951.614565:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 223 00000100:00100000:0.0:1788459951.614575:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bca61bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bed032f6-c389-485e-b2f7-e2ea34763c65+9:6634:x1875336003327232:12345-192.168.206.5@tcp:502: 00000100:00100000:0.0:1788459951.614733:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bca61bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bed032f6-c389-485e-b2f7-e2ea34763c65+9:6634:x1875336003327232:12345-192.168.206.5@tcp:502: Request processed in 151us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459951.614741:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 223 00000100:00100000:2.0:1788459951.619392:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788459951.620518:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003327360 00000100:00100000:1.0:1788459951.620530:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003327360 00000100:00100000:1.0:1788459951.620610:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 224 00000100:00100000:1.0:1788459951.620621:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bca61a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bed032f6-c389-485e-b2f7-e2ea34763c65+9:6634:x1875336003327360:12345-192.168.206.5@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788459951.621020:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bca61a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bed032f6-c389-485e-b2f7-e2ea34763c65+9:6634:x1875336003327360:12345-192.168.206.5@tcp:502:llog_process_th.0 Request processed in 399us (1646us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459951.621029:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 224 00000100:00100000:1.0:1788459951.631739:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788459951.631852:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003327488 00000100:00100000:2.0:1788459951.631863:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003327488 00000100:00100000:2.0:1788459951.631923:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 225 00000100:00100000:2.0:1788459951.631933:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bed032f6-c389-485e-b2f7-e2ea34763c65+9:6163:x1875336003327488:12345-192.168.206.5@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788459951.631981:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788459951.631999:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4bfadc7a00/0x5dfa74784542ae4b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a50a expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459951.632026:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bfadc7a00/0x5dfa74784542ae4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a50a expref: 10 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459951.632056:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4bfadc7a00/0x5dfa74784542ae4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a50a expref: 10 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459951.632066:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bfadc7a00, rc 0) 00000100:00100000:2.0:1788459951.632142:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bed032f6-c389-485e-b2f7-e2ea34763c65+10:6163:x1875336003327488:12345-192.168.206.5@tcp:101:ll_cfg_requeue.0 Request processed in 211us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459951.632150:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 225 00000100:00100000:3.0:1788459951.634076:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788459951.634264:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003327616 00000100:00100000:1.0:1788459951.634282:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003327616 00000100:00100000:1.0:1788459951.634540:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 226 00000100:00100000:1.0:1788459951.634551:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bed032f6-c389-485e-b2f7-e2ea34763c65+10:6163:x1875336003327616:12345-192.168.206.5@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788459951.634658:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bed032f6-c389-485e-b2f7-e2ea34763c65+10:6163:x1875336003327616:12345-192.168.206.5@tcp:501:ll_cfg_requeue.0 Request processed in 107us (588us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788459951.634666:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 226 00000100:00100000:3.0:1788459951.697418:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022255872:0@lo:13: 00000100:00100000:3.0:1788459951.697485:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459951.697666:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf2fe9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022256000:0@lo:13: 00000100:00100000:2.0:1788459951.697731:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875336022256128:0@lo:400: 00000100:00100000:2.0:1788459951.697764:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459951.698609:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022256256:0@lo:400: 00000100:00100000:1.0:1788459951.698637:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459951.698797:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022256256 00000100:00100000:3.0:1788459951.698805:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022256256 00000100:00100000:3.0:1788459951.698856:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788459951.698864:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf2fe8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022256256:12345-0@lo:400: 00000100:00100000:3.0:1788459951.698915:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf2fe8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022256256:12345-0@lo:400: Request processed in 52us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459951.698923:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788459951.699212:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022256128 00000100:00100000:1.0:1788459951.699216:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022256256:0@lo:400: 00000100:00100000:3.0:1788459951.699226:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022256128 00000100:00100000:1.0:1788459951.699227:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022256768:0@lo:400: 00000100:00100000:1.0:1788459951.699263:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459951.699298:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788459951.699306:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3af6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1875336022256128:12345-0@lo:400: 00000100:00100000:3.0:1788459951.699341:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3af6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1875336022256128:12345-0@lo:400: Request processed in 37us (1576us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459951.699347:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788459951.699385:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1875336022256384:0@lo:400: 00000100:00100000:3.0:1788459951.699410:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459951.699429:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022257280:0@lo:400: 00000100:00100000:3.0:1788459951.699433:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022256896:0@lo:400: 00000100:00100000:1.0:1788459951.699466:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459951.699473:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022256384 00000100:00100000:3.0:1788459951.699478:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022256384 00000100:00100000:3.0:1788459951.699509:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788459951.699519:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfa1e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1875336022256384:12345-0@lo:400: 00000100:00100000:1.0:1788459951.699530:0:8832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022256768 00000100:00100000:1.0:1788459951.699536:0:8832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022256768 00000100:00100000:3.0:1788459951.699558:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfa1e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1875336022256384:12345-0@lo:400: Request processed in 41us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459951.699565:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788459951.699570:0:8832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022257280 00000100:00100000:1.0:1788459951.699574:0:8832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022257280 00000100:00100000:3.0:1788459951.699597:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459951.699603:0:8832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022256896 00000100:00100000:1.0:1788459951.699608:0:8832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022256896 00000100:00100000:3.0:1788459951.699617:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022257408:0@lo:400: 00000100:00100000:1.0:1788459951.699627:0:8832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788459951.699636:0:8832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf2feb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022256768:12345-0@lo:400: 00000100:00100000:3.0:1788459951.699645:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459951.699676:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1875336022256384:0@lo:400: 00000100:00100000:3.0:1788459951.699686:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788459951.699692:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1875336022256512:0@lo:400: 00000100:00100000:3.0:1788459951.699715:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459951.699733:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1875336022257024:0@lo:400: 00000100:00100000:3.0:1788459951.699752:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459951.699886:0:8832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf2feb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022256768:12345-0@lo:400: Request processed in 251us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459951.699893:0:8832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788459951.699906:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022257408 00000100:00100000:1.0:1788459951.699911:0:8832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788459951.699919:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022257408 00000100:00100000:1.0:1788459951.699920:0:8832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac366a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022257280:12345-0@lo:400: 00000100:00100000:1.0:1788459951.699973:0:8832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac366a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022257280:12345-0@lo:400: Request processed in 56us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459951.699979:0:8832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788459951.699989:0:8832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788459951.699994:0:8832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfa1e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022256896:12345-0@lo:400: 00000100:00100000:1.0:1788459951.700025:0:8832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfa1e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022256896:12345-0@lo:400: Request processed in 31us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459951.700039:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788459951.700050:0:8832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788459951.700051:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfa1e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022257408:12345-0@lo:400: 00000100:00100000:1.0:1788459951.700077:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022256512 00000100:00100000:1.0:1788459951.700082:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022256512 00000100:00100000:3.0:1788459951.700091:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfa1e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022257408:12345-0@lo:400: Request processed in 45us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459951.700099:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788459951.700103:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022257024 00000100:00100000:1.0:1788459951.700108:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022257024 00000100:00100000:1.0:1788459951.700124:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788459951.700130:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfa1e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1875336022256512:12345-0@lo:400: 00000100:00100000:1.0:1788459951.700164:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfa1e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1875336022256512:12345-0@lo:400: Request processed in 34us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459951.700171:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788459951.700185:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788459951.700195:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfa1e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1875336022257024:12345-0@lo:400: 00000100:00080000:1.0:1788459951.700204:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788459951.700211:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788459951.700214:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788459951.700231:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459951.700239:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfa1e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1875336022257024:12345-0@lo:400: Request processed in 45us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459951.700247:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788459951.700252:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022255872 00000100:00100000:0.0:1788459951.700257:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022255872 00000100:00100000:1.0:1788459951.700279:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022256000 00000100:00100000:1.0:1788459951.700285:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022256000 00000100:00100000:3.0:1788459951.700286:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1875336022256512:0@lo:400: 00000100:00100000:0.0:1788459951.700286:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788459951.700295:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfa1e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022255872:12345-0@lo:13: 00000100:00100000:3.0:1788459951.700297:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1875336022257024:0@lo:400: 00010000:00080000:3.0:1788459951.700308:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3af7800 x1875336022256896/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788459967 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00002000:00000024:0.0:1788459951.700314:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788459951.700317:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022256896:0@lo:400: 00010000:00080000:3.0:1788459951.700325:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3af4700 x1875336022257408/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788459967 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788459951.700332:0:3659:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:3.0:1788459951.700342:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022257408:0@lo:400: 00000100:00100000:0.0:1788459951.700346:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfa1e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022255872:12345-0@lo:13: Request processed in 52us (2862us total) trans 0 rc 0/0 00010000:00080000:3.0:1788459951.700352:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3af4380 x1875336022255872/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788459967 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788459951.700361:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788459951.700365:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022255872:0@lo:13: 00000100:00100000:1.0:1788459951.701071:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788459951.701078:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac366aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022256000:12345-0@lo:13: 00002000:00000024:1.0:1788459951.701091:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788459951.701147:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac366aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022256000:12345-0@lo:13: Request processed in 68us (917us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459951.701154:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1788459951.701188:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3af5c00 x1875336022256768/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788459967 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788459951.701199:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022256768:0@lo:400: 00010000:00080000:1.0:1788459951.701210:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3af6a00 x1875336022257280/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788459967 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788459951.701231:0:3662:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788459951.701246:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022257280:0@lo:400: 00010000:00080000:3.0:1788459951.701312:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bf2fe9880 x1875336022256000/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788459967 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788459951.701332:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf2fe9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022256000:0@lo:13: 00000100:00100000:2.0:1788459951.702810:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875336022256128:0@lo:400: 00000100:00100000:2.0:1788459951.702823:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1875336022256640:0@lo:400: 00000100:00100000:2.0:1788459951.702871:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459951.702892:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1875336022257152:0@lo:400: 00000100:00100000:2.0:1788459951.702910:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459951.703158:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022256640 00000100:00100000:3.0:1788459951.703165:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022256640 00000100:00100000:3.0:1788459951.703217:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022257152 00000100:00100000:3.0:1788459951.703221:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022257152 00000100:00100000:3.0:1788459951.703243:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788459951.703251:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3af6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1875336022256640:12345-0@lo:400: 00000100:00100000:3.0:1788459951.703298:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3af6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1875336022256640:12345-0@lo:400: Request processed in 47us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459951.703305:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788459951.703320:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788459951.703326:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3af5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1875336022257152:12345-0@lo:400: 00000100:00100000:3.0:1788459951.703349:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3af5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1875336022257152:12345-0@lo:400: Request processed in 24us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459951.703355:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:2.0:1788459951.703484:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1788459951.703509:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3af4000 x1875336022256640/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788459967 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788459951.703520:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1875336022256640:0@lo:400: 00010000:00080000:2.0:1788459951.703530:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3af4e00 x1875336022257152/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788459967 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788459951.703539:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1875336022257152:0@lo:400: 00010000:00010000:3.0:1788459951.890405:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788459952.593123:0:6530:0:(mgc_request.c:715:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788459952.593130:0:6530:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-client-ffff8c4bfc4e5800 from 48 10000000:01000000:1.0:1788459952.593135:0:6530:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788459952.593179:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac395e600/0x5dfa74784542ae52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459952.593191:0:6530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4ac395e600/0x5dfa74784542ae52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459952.593202:0:6530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4ac395e600/0x5dfa74784542ae52 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788459952.593222:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3668700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022257536:0@lo:101: 00000100:00100000:1.0:1788459952.593280:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459952.593426:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac36aac00 going to sleep for 11 seconds 00000100:00100000:0.0:1788459952.593644:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022257536 00000100:00100000:0.0:1788459952.593652:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022257536 00000100:00100000:0.0:1788459952.593698:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1788459952.593707:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+17:6530:x1875336022257536:12345-0@lo:101: 00010000:00010000:0.0:1788459952.593720:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788459952.593732:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4bef209000/0x5dfa74784542ae59 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542ae52 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459952.593756:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bef209000/0x5dfa74784542ae59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542ae52 expref: 18 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459952.593767:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4bef209000/0x5dfa74784542ae59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542ae52 expref: 18 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459952.593775:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bef209000, rc 0) 00000100:00100000:0.0:1788459952.593811:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+18:6530:x1875336022257536:12345-0@lo:101: Request processed in 104us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459952.593817:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1788459952.593941:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3668700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022257536:0@lo:101: 00010000:00010000:1.0:1788459952.593984:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4ac395e600/0x5dfa74784542ae52 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ae59 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459952.593993:0:6530:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4ac395e600/0x5dfa74784542ae52 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542ae59 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788459952.594116:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:1.0:1788459952.594690:0:6530:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788459952.594837:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1788459952.594862:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 120 off8536 00000040:00080000:1.0:1788459952.594886:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 168 off8704 00000040:00080000:1.0:1788459952.594897:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8928 00000040:00080000:1.0:1788459952.594908:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9152 00000040:00080000:1.0:1788459952.594918:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 120 off9272 00000040:00080000:1.0:1788459952.594930:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 168 off9440 00000040:00080000:1.0:1788459952.595407:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].8, 224 off9664 00000040:00080000:1.0:1788459952.595754:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].9, 224 off9888 00000040:00080000:1.0:1788459952.595772:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].10, 120 off10008 00000040:00080000:1.0:1788459952.595784:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].11, 224 off10232 00000040:00080000:1.0:1788459952.595797:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].12, 224 off10456 00000040:00080000:1.0:1788459952.595812:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].13, 88 off10544 00000040:00080000:1.0:1788459952.595822:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].14, 128 off10672 00000040:00080000:1.0:1788459952.595833:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].15, 144 off10816 00000040:00080000:1.0:1788459952.595845:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].16, 160 off10976 00000040:00080000:1.0:1788459952.595865:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].17, 224 off11200 00000040:00080000:1.0:1788459952.595883:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].18, 224 off11424 00000040:00080000:1.0:1788459952.595895:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].19, 80 off11504 00000040:00080000:1.0:1788459952.595907:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].20, 224 off11728 00000040:00080000:1.0:1788459952.595920:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].21, 224 off11952 00000040:00080000:1.0:1788459952.595932:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].22, 88 off12040 00000040:00080000:1.0:1788459952.597270:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].23, 128 off12168 00000040:00080000:1.0:1788459952.597690:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].24, 144 off12312 00000040:00080000:1.0:1788459952.597706:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].25, 160 off12472 00000040:00080000:1.0:1788459952.597718:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].26, 224 off12696 00000040:00080000:1.0:1788459952.597729:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].27, 224 off12920 00000040:00080000:1.0:1788459952.597741:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].28, 80 off13000 00000040:00080000:1.0:1788459952.597753:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].29, 224 off13224 00000040:00080000:1.0:1788459952.597764:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].30, 224 off13448 00000040:00080000:1.0:1788459952.597775:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].31, 88 off13536 00000040:00080000:1.0:1788459952.597790:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].32, 128 off13664 00000040:00080000:1.0:1788459952.597804:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].33, 144 off13808 00000040:00080000:1.0:1788459952.597818:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].34, 128 off13936 00000040:00080000:1.0:1788459952.597830:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].35, 224 off14160 00000040:00080000:1.0:1788459952.597880:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].36, 224 off14384 00000040:00080000:1.0:1788459952.597896:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].37, 80 off14464 00000040:00080000:1.0:1788459952.597922:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].38, 224 off14688 00000040:00080000:1.0:1788459952.597936:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].39, 224 off14912 00000040:00080000:1.0:1788459952.599759:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].40, 88 off15000 00000040:00080000:1.0:1788459952.599788:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].41, 128 off15128 00000040:00080000:1.0:1788459952.599803:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].42, 144 off15272 00000040:00080000:1.0:1788459952.599814:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].43, 128 off15400 00000040:00080000:1.0:1788459952.599827:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].44, 224 off15624 00000040:00080000:1.0:1788459952.599839:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].45, 224 off15848 00000040:00080000:1.0:1788459952.599851:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].46, 80 off15928 00000040:00080000:1.0:1788459952.599876:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].47, 224 off16152 00000040:00080000:1.0:1788459952.599882:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:1.0:1788459952.605357:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3668700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022257664:0@lo:501: 00000100:00100000:1.0:1788459952.605436:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459952.605492:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac36aac00 going to sleep for 11 seconds 00000100:00100000:0.0:1788459952.605864:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022257664 00000100:00100000:0.0:1788459952.606113:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022257664 00000100:00100000:0.0:1788459952.606184:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1788459952.606194:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+18:6530:x1875336022257664:12345-0@lo:501: 00000100:00100000:0.0:1788459952.606356:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+18:6530:x1875336022257664:12345-0@lo:501: Request processed in 163us (919us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459952.606364:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1788459952.607105:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3668700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022257664:0@lo:501: 00000100:00100000:1.0:1788459952.607150:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3668700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022257792:0@lo:503: 00000100:00100000:1.0:1788459952.607204:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459952.607280:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac36aac00 going to sleep for 11 seconds 00000100:00100000:2.0:1788459952.612286:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022257792 00000100:00100000:2.0:1788459952.612302:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022257792 00000100:00100000:2.0:1788459952.612464:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1788459952.612477:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+18:6530:x1875336022257792:12345-0@lo:503: 00000100:00100000:2.0:1788459952.612635:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+18:6530:x1875336022257792:12345-0@lo:503: Request processed in 160us (5429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459952.612643:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1788459952.612744:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3668700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022257792:0@lo:503: 00000040:00080000:1.0:1788459952.613215:0:6530:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788459952.613287:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3668700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022257920:0@lo:502: 00000100:00100000:1.0:1788459952.613333:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459952.617916:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac36aac00 going to sleep for 11 seconds 00000100:00100000:0.0:1788459952.618229:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022257920 00000100:00100000:0.0:1788459952.618238:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022257920 00000100:00100000:0.0:1788459952.618296:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1788459952.618306:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+18:6530:x1875336022257920:12345-0@lo:502: 00000100:00100000:0.0:1788459952.618497:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+18:6530:x1875336022257920:12345-0@lo:502: Request processed in 192us (5162us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459952.618505:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1788459952.618781:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3668700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022257920:0@lo:502: 00000040:00080000:0.0:1788459952.619488:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1788459952.619520:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 120 off8536 00000040:00080000:0.0:1788459952.619536:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 168 off8704 00000040:00080000:0.0:1788459952.619549:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8928 00000040:00080000:0.0:1788459952.619563:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9152 00000040:00080000:0.0:1788459952.619576:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 120 off9272 00000040:00080000:0.0:1788459952.619589:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 168 off9440 00000040:00080000:0.0:1788459952.619603:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9664 00000040:00080000:0.0:1788459952.619617:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 224 off9888 00000040:00080000:0.0:1788459952.619631:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 120 off10008 00000040:00080000:0.0:1788459952.619643:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10232 00000040:00080000:0.0:1788459952.619655:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 224 off10456 00000040:00080000:0.0:1788459952.619666:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 88 off10544 00000040:00080000:0.0:1788459952.619679:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].14, 128 off10672 00000040:00080000:0.0:1788459952.619696:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].15, 144 off10816 00000040:00080000:0.0:1788459952.619710:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].16, 160 off10976 00000040:00080000:0.0:1788459952.619723:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].17, 224 off11200 00000040:00080000:0.0:1788459952.619736:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].18, 224 off11424 00000040:00080000:0.0:1788459952.619749:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].19, 80 off11504 00000040:00080000:0.0:1788459952.619761:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].20, 224 off11728 00000040:00080000:0.0:1788459952.619775:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].21, 224 off11952 00000040:00080000:0.0:1788459952.619884:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].22, 88 off12040 00000040:00080000:0.0:1788459952.619902:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].23, 128 off12168 00000040:00080000:0.0:1788459952.619917:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].24, 144 off12312 00000040:00080000:0.0:1788459952.619929:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].25, 160 off12472 00000040:00080000:0.0:1788459952.623128:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].26, 224 off12696 00000040:00080000:0.0:1788459952.623216:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].27, 224 off12920 00000040:00080000:0.0:1788459952.623235:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].28, 80 off13000 00000040:00080000:0.0:1788459952.623251:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].29, 224 off13224 00000040:00080000:0.0:1788459952.623266:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].30, 224 off13448 00000040:00080000:0.0:1788459952.623280:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].31, 88 off13536 00000040:00080000:0.0:1788459952.623302:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].32, 128 off13664 00000040:00080000:0.0:1788459952.623320:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].33, 144 off13808 00000040:00080000:0.0:1788459952.623332:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].34, 128 off13936 00000040:00080000:0.0:1788459952.623344:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].35, 224 off14160 00000040:00080000:0.0:1788459952.623358:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].36, 224 off14384 00000040:00080000:0.0:1788459952.623386:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].37, 80 off14464 00000040:00080000:0.0:1788459952.623421:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].38, 224 off14688 00000040:00080000:0.0:1788459952.623438:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].39, 224 off14912 00000040:00080000:0.0:1788459952.623450:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].40, 88 off15000 00000040:00080000:0.0:1788459952.623462:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].41, 128 off15128 00000040:00080000:0.0:1788459952.623490:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].42, 144 off15272 00000040:00080000:0.0:1788459952.623504:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].43, 128 off15400 00000040:00080000:0.0:1788459952.623523:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].44, 224 off15624 00000040:00080000:0.0:1788459952.623538:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].45, 224 off15848 00000040:00080000:0.0:1788459952.624819:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].46, 80 off15928 00000040:00080000:0.0:1788459952.625092:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].47, 224 off16152 00000040:00080000:0.0:1788459952.625117:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].48, 232 off16384 00000100:00100000:0.0:1788459952.628789:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3afa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022258048:0@lo:502: 00000100:00100000:0.0:1788459952.628889:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459952.628931:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bf2f9b000 going to sleep for 11 seconds 00000100:00100000:1.0:1788459952.629234:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022258048 00000100:00100000:1.0:1788459952.629243:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022258048 00000100:00100000:1.0:1788459952.629733:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1788459952.629743:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+18:6530:x1875336022258048:12345-0@lo:502: 00000100:00100000:1.0:1788459952.630023:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+18:6530:x1875336022258048:12345-0@lo:502: Request processed in 282us (1137us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459952.630031:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1788459952.630142:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3afa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022258048:0@lo:502: 00000040:00080000:0.0:1788459952.630817:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].49, 224 off16608 00000040:00080000:0.0:1788459952.630845:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].50, 120 off16728 00000100:00100000:0.0:1788459952.630877:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3afa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022258176:0@lo:502: 00000100:00100000:0.0:1788459952.630922:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459952.634612:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bf2f9b000 going to sleep for 11 seconds 00000100:00100000:1.0:1788459952.634999:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022258176 00000100:00100000:1.0:1788459952.635008:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022258176 00000100:00100000:0.0:1788459952.635214:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1788459952.635225:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+18:6530:x1875336022258176:12345-0@lo:502: 00000100:00100000:0.0:1788459952.635732:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+18:6530:x1875336022258176:12345-0@lo:502: Request processed in 509us (4808us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459952.635742:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1788459952.635845:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3afa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022258176:0@lo:502: 00000040:00080000:0.0:1788459952.636847:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].51, 224 off16952 00000040:00080000:0.0:1788459952.637038:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000040:00080000:1.0:1788459952.638138:0:10366:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 52 count 51 00000020:01000000:0.0:1788459952.638466:0:6530:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1788459952.638477:0:6530:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788459952.638486:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac395e600/0x5dfa74784542ae52 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ae59 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459952.638497:0:6530:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4ac395e600/0x5dfa74784542ae52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ae59 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788459952.638510:0:6530:0:(mgc_request.c:715:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1788459952.638512:0:6530:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1788459952.638514:0:6530:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788459952.638542:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bef208800/0x5dfa74784542ae60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459952.638550:0:6530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4bef208800/0x5dfa74784542ae60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459952.638560:0:6530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4bef208800/0x5dfa74784542ae60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788459952.641310:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3afa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022258304:0@lo:101: 00000100:00100000:0.0:1788459952.641396:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459952.641454:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bf2f9b000 going to sleep for 11 seconds 00000100:00100000:1.0:1788459952.641516:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022258304 00000100:00100000:1.0:1788459952.641525:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022258304 00000100:00100000:1.0:1788459952.641587:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1788459952.641596:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+18:6530:x1875336022258304:12345-0@lo:101: 00010000:00010000:1.0:1788459952.641611:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788459952.641627:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4ac395e800/0x5dfa74784542ae67 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542ae60 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459952.641649:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4ac395e800/0x5dfa74784542ae67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542ae60 expref: 19 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459952.641659:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4ac395e800/0x5dfa74784542ae67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542ae60 expref: 19 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459952.641667:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ac395e800, rc 0) 00000100:00100000:1.0:1788459952.641701:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+19:6530:x1875336022258304:12345-0@lo:101: Request processed in 107us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459952.641707:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1788459952.642023:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3afa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022258304:0@lo:101: 00010000:00010000:0.0:1788459952.642038:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4bef208800/0x5dfa74784542ae60 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ae67 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459952.642047:0:6530:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4bef208800/0x5dfa74784542ae60 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542ae67 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788459952.642171:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1788459952.642379:0:6530:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788459952.642534:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1788459952.642580:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 128 off8544 00000040:00080000:0.0:1788459952.642596:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 112 off8656 00000040:00080000:0.0:1788459952.642608:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].4, 224 off8880 00000040:00080000:0.0:1788459952.642618:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].5, 224 off9104 00000040:00080000:0.0:1788459952.642628:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].6, 80 off9184 00000040:00080000:0.0:1788459952.642641:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].7, 224 off9408 00000040:00080000:0.0:1788459952.642646:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1788459952.642694:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3afa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022258432:0@lo:501: 00000100:00100000:0.0:1788459952.642727:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459952.642756:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bf2f9b000 going to sleep for 11 seconds 00000100:00100000:0.0:1788459952.642774:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022258432 00000100:00100000:0.0:1788459952.642778:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022258432 00000100:00100000:0.0:1788459952.642805:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1788459952.642812:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+19:6530:x1875336022258432:12345-0@lo:501: 00000100:00100000:0.0:1788459952.643492:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+19:6530:x1875336022258432:12345-0@lo:501: Request processed in 678us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459952.643501:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1788459952.644819:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3afa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022258432:0@lo:501: 00000100:00100000:1.0:1788459952.644877:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3668700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022258560:0@lo:503: 00000100:00100000:1.0:1788459952.644935:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459952.645061:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac36aa780 going to sleep for 11 seconds 00000100:00100000:2.0:1788459952.645101:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022258560 00000100:00100000:2.0:1788459952.645108:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022258560 00000100:00100000:2.0:1788459952.645186:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1788459952.645196:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+19:6530:x1875336022258560:12345-0@lo:503: 00000100:00100000:2.0:1788459952.645304:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+19:6530:x1875336022258560:12345-0@lo:503: Request processed in 109us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459952.645312:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1788459952.645399:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3668700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022258560:0@lo:503: 00000040:00080000:0.0:1788459952.645830:0:6530:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788459952.645891:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022258688:0@lo:502: 00000100:00100000:0.0:1788459952.645929:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459952.646305:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bf2f9b000 going to sleep for 11 seconds 00000100:00100000:1.0:1788459952.646340:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022258688 00000100:00100000:1.0:1788459952.646346:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022258688 00000100:00100000:1.0:1788459952.646388:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1788459952.646397:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+19:6530:x1875336022258688:12345-0@lo:502: 00000100:00100000:1.0:1788459952.646498:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+19:6530:x1875336022258688:12345-0@lo:502: Request processed in 102us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459952.646506:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1788459952.646710:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022258688:0@lo:502: 00000040:00080000:0.0:1788459952.646887:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1788459952.646915:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 00000040:00080000:0.0:1788459952.646932:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:0.0:1788459952.651688:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:0.0:1788459952.651734:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:0.0:1788459952.651771:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:0.0:1788459952.651789:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 00000040:00080000:0.0:1788459952.651802:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:0.0:1788459952.651814:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 120 off9752 00000100:00100000:0.0:1788459952.651855:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022258816:0@lo:502: 00000100:00100000:0.0:1788459952.651929:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459952.651990:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bf767e540 going to sleep for 11 seconds 00000100:00100000:1.0:1788459952.652208:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022258816 00000100:00100000:1.0:1788459952.652216:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022258816 00000100:00100000:1.0:1788459952.652271:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1788459952.652281:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+19:6530:x1875336022258816:12345-0@lo:502: 00000100:00100000:1.0:1788459952.652404:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+19:6530:x1875336022258816:12345-0@lo:502: Request processed in 124us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459952.652412:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1788459952.652732:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022258816:0@lo:502: 00000040:00080000:0.0:1788459952.652790:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9976 00000040:00080000:0.0:1788459952.652800:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:0.0:1788459952.654788:0:10367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788459952.654799:0:10367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788459952.654802:0:10367:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788459952.654807:0:10367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788459952.654815:0:10367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788459952.654818:0:10367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788459952.654819:0:10367:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788459952.654822:0:10367:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:1.0:1788459952.654893:0:6530:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1788459952.654908:0:6530:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788459952.654919:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bef208800/0x5dfa74784542ae60 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ae67 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459952.654931:0:6530:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4bef208800/0x5dfa74784542ae60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ae67 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788459952.654988:0:6530:0:(mgc_request.c:715:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788459952.654991:0:6530:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-sptlrpc-ffff8c4bfc4e5800 from 1 10000000:01000000:1.0:1788459952.654993:0:6530:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788459952.655039:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac395fa00/0x5dfa74784542ae6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459952.655047:0:6530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4ac395fa00/0x5dfa74784542ae6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459952.655057:0:6530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4ac395fa00/0x5dfa74784542ae6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788459952.655083:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3668700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022258944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788459952.655142:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459952.655186:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac36aa840 going to sleep for 11 seconds 00000100:00100000:0.0:1788459952.655402:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022258944 00000100:00100000:0.0:1788459952.655416:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022258944 00000100:00100000:0.0:1788459952.655471:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1788459952.655480:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+19:6530:x1875336022258944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788459952.655492:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788459952.655504:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4bef209c00/0x5dfa74784542ae75 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542ae6e expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459952.655526:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bef209c00/0x5dfa74784542ae75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542ae6e expref: 20 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459952.655538:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4bef209c00/0x5dfa74784542ae75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542ae6e expref: 20 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459952.655546:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bef209c00, rc 0) 00000100:00100000:0.0:1788459952.655591:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+20:6530:x1875336022258944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459952.655598:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1788459952.655932:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3668700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022258944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788459952.656076:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4ac395fa00/0x5dfa74784542ae6e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ae75 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459952.656087:0:6530:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4ac395fa00/0x5dfa74784542ae6e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542ae75 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788459952.656157:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3668700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022259072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788459952.656186:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459952.656218:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac36aa840 going to sleep for 11 seconds 00000100:00100000:0.0:1788459952.656399:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022259072 00000100:00100000:0.0:1788459952.656404:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022259072 00000100:00100000:0.0:1788459952.656442:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1788459952.656458:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+20:6530:x1875336022259072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788459952.656532:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+20:6530:x1875336022259072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 82us (345us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788459952.656539:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1788459952.656715:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3668700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022259072:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1788459952.656731:0:6530:0:(mgc_request_server.c:748:mgc_llog_local_copy()) mgc192.168.206.105@tcp: no remote llog for lustre-sptlrpc, check MGS config 00000100:00100000:2.0:1788459952.656770:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022259200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788459952.656807:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459952.656834:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc65d7f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788459952.656986:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022259200 00000100:00100000:0.0:1788459952.656990:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022259200 00000100:00100000:0.0:1788459952.657024:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1788459952.657032:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+20:6530:x1875336022259200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788459952.657103:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+20:6530:x1875336022259200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 72us (305us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788459952.657110:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1788459952.657164:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022259200:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1788459952.657185:0:6530:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788459952.657193:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac395fa00/0x5dfa74784542ae6e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ae75 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459952.657202:0:6530:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4ac395fa00/0x5dfa74784542ae6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ae75 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788459952.657213:0:6530:0:(mgc_request.c:715:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788459952.657221:0:6530:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-client-ffff8c4bef21b800 from 48 10000000:01000000:2.0:1788459952.657224:0:6530:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788459952.657245:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7000/0x5dfa74784542ae7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459952.657253:0:6530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7000/0x5dfa74784542ae7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459952.657261:0:6530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7000/0x5dfa74784542ae7c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788459952.657274:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022259328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788459952.657301:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459952.657330:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc65d7f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788459952.657460:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022259328 00000100:00100000:1.0:1788459952.657465:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022259328 00000100:00100000:1.0:1788459952.657575:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1788459952.657584:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf363f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+20:6530:x1875336022259328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788459952.657594:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788459952.657605:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4ac395fe00/0x5dfa74784542ae83 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542ae7c expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459952.657632:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4ac395fe00/0x5dfa74784542ae83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542ae7c expref: 21 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459952.657641:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4ac395fe00/0x5dfa74784542ae83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542ae7c expref: 21 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459952.657650:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ac395fe00, rc 0) 00000100:00100000:1.0:1788459952.657685:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf363f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+21:6530:x1875336022259328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459952.657692:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1788459952.660420:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022259328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788459952.660450:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7000/0x5dfa74784542ae7c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ae83 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459952.660462:0:6530:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7000/0x5dfa74784542ae7c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542ae83 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788459952.660625:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 48 count 48 00000040:00080000:2.0:1788459952.662216:0:6530:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788459952.662418:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1788459952.662444:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1788459952.662461:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1788459952.662475:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1788459952.662486:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1788459952.662499:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1788459952.662512:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1788459952.662526:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1788459952.662550:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1788459952.662565:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1788459952.662578:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1788459952.662592:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1788459952.662604:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1788459952.662618:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1788459952.662630:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1788459952.662641:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1788459952.662652:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1788459952.662663:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1788459952.662675:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1788459952.662686:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1788459952.662696:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1788459952.662707:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1788459952.662718:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1788459952.662729:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1788459952.662742:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:2.0:1788459952.662754:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:2.0:1788459952.662765:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:2.0:1788459952.662779:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:2.0:1788459952.662791:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:2.0:1788459952.666430:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:2.0:1788459952.666462:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:2.0:1788459952.666478:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:2.0:1788459952.666494:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:2.0:1788459952.666509:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:2.0:1788459952.666524:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:2.0:1788459952.666538:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:2.0:1788459952.666569:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:2.0:1788459952.666586:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:2.0:1788459952.666600:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:2.0:1788459952.666614:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:2.0:1788459952.666628:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:2.0:1788459952.666654:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:2.0:1788459952.666669:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:2.0:1788459952.666683:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:2.0:1788459952.666696:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:2.0:1788459952.666709:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:2.0:1788459952.666736:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:2.0:1788459952.666742:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 47 count 48 00000100:00100000:2.0:1788459952.666839:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022259456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788459952.666915:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459952.666993:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc65d7f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788459952.667145:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022259456 00000100:00100000:1.0:1788459952.667153:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022259456 00000100:00100000:1.0:1788459952.667195:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1788459952.667204:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf363d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+21:6530:x1875336022259456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788459952.667409:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf363d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+21:6530:x1875336022259456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 205us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459952.667417:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1788459952.669419:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022259456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788459952.669475:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022259584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788459952.669538:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459952.669580:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc65d7f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788459952.669773:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022259584 00000100:00100000:1.0:1788459952.669780:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022259584 00000100:00100000:1.0:1788459952.669840:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1788459952.669849:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf363cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+21:6530:x1875336022259584:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788459952.670279:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf363cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+21:6530:x1875336022259584:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 430us (740us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459952.670287:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1788459952.670362:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022259584:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788459952.670713:0:6530:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788459952.670772:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022259712:0@lo:502:ll_cfg_requeue.0 00000100:00100000:0.0:1788459952.670821:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459952.670847:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4c01849b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788459952.671272:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022259712 00000100:00100000:1.0:1788459952.671279:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022259712 00000100:00100000:1.0:1788459952.671327:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1788459952.671335:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf363dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+21:6530:x1875336022259712:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788459952.671440:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf363dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+21:6530:x1875336022259712:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 105us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459952.671448:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1788459952.671527:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022259712:0@lo:502:ll_cfg_requeue.0 00000040:00080000:0.0:1788459952.671687:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1788459952.671713:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1788459952.671726:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1788459952.671739:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1788459952.671752:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1788459952.671766:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1788459952.671781:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1788459952.671807:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1788459952.671827:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1788459952.671841:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1788459952.671882:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1788459952.671900:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1788459952.671912:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1788459952.671925:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1788459952.672133:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1788459952.672156:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1788459952.672170:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1788459952.672183:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1788459952.672196:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1788459952.672223:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1788459952.672236:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1788459952.672249:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1788459952.672261:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1788459952.672274:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1788459952.672288:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:0.0:1788459952.672301:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:0.0:1788459952.672330:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:0.0:1788459952.672346:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:0.0:1788459952.672359:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:0.0:1788459952.672386:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:0.0:1788459952.672400:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:0.0:1788459952.672412:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:0.0:1788459952.672426:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:0.0:1788459952.672440:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:0.0:1788459952.672453:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:0.0:1788459952.672465:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:0.0:1788459952.672478:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:0.0:1788459952.672492:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:0.0:1788459952.672506:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:0.0:1788459952.672519:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:0.0:1788459952.672532:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:0.0:1788459952.672546:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:0.0:1788459952.672574:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:0.0:1788459952.672590:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:0.0:1788459952.672605:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:0.0:1788459952.672618:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:0.0:1788459952.672631:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:0.0:1788459952.672645:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:0.0:1788459952.672690:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022259840:0@lo:502:ll_cfg_requeue.0 00000100:00100000:0.0:1788459952.672740:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459952.672764:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac2869480 going to sleep for 11 seconds 00000100:00100000:1.0:1788459952.673233:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022259840 00000100:00100000:1.0:1788459952.673241:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022259840 00000100:00100000:1.0:1788459952.673283:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1788459952.673292:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf363f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+21:6530:x1875336022259840:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788459952.673412:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf363f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+21:6530:x1875336022259840:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 120us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459952.673420:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1788459952.675110:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022259840:0@lo:502:ll_cfg_requeue.0 00000040:00080000:0.0:1788459952.675315:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:0.0:1788459952.675345:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:0.0:1788459952.675389:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022259968:0@lo:502:ll_cfg_requeue.0 00000100:00100000:0.0:1788459952.675449:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459952.675489:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac2869480 going to sleep for 11 seconds 00000100:00100000:1.0:1788459952.676054:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022259968 00000100:00100000:1.0:1788459952.676062:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022259968 00000100:00100000:1.0:1788459952.676110:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1788459952.676119:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf363d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+21:6530:x1875336022259968:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788459952.676232:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf363d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+21:6530:x1875336022259968:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 114us (782us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459952.676240:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1788459952.678139:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022259968:0@lo:502:ll_cfg_requeue.0 00000040:00080000:0.0:1788459952.678227:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:0.0:1788459952.678240:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000040:00080000:0.0:1788459952.682126:0:10368:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:1.0:1788459952.686148:0:6530:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1788459952.686171:0:6530:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788459952.686181:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7000/0x5dfa74784542ae7c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ae83 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459952.686193:0:6530:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7000/0x5dfa74784542ae7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ae83 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788459952.686222:0:6530:0:(mgc_request.c:715:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788459952.686224:0:6530:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:1.0:1788459952.686227:0:6530:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788459952.686262:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac395fc00/0x5dfa74784542ae8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459952.686270:0:6530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4ac395fc00/0x5dfa74784542ae8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459952.686281:0:6530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4ac395fc00/0x5dfa74784542ae8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788459952.686304:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3668700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022260096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788459952.686361:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459952.686451:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac25b3480 going to sleep for 11 seconds 00000100:00100000:2.0:1788459952.689196:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022260096 00000100:00100000:2.0:1788459952.689211:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022260096 00000100:00100000:2.0:1788459952.689278:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1788459952.690245:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf363f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+21:6530:x1875336022260096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788459952.690267:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788459952.690287:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4bfadc6000/0x5dfa74784542ae91 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542ae8a expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459952.690326:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bfadc6000/0x5dfa74784542ae91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542ae8a expref: 22 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459952.690337:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4bfadc6000/0x5dfa74784542ae91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542ae8a expref: 22 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459952.690346:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bfadc6000, rc 0) 00000100:00100000:2.0:1788459952.690453:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf363f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+22:6530:x1875336022260096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1157us (4081us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459952.690462:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1788459952.690493:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3668700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022260096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788459952.690515:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4ac395fc00/0x5dfa74784542ae8a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ae91 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459952.690527:0:6530:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4ac395fc00/0x5dfa74784542ae8a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542ae91 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788459952.690677:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:1.0:1788459952.690913:0:6530:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788459952.691232:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1788459952.691259:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:1.0:1788459952.691273:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:1.0:1788459952.691286:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:1.0:1788459952.693499:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:1.0:1788459952.693515:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:1.0:1788459952.693528:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:1.0:1788459952.693541:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:1.0:1788459952.693556:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:1.0:1788459952.693579:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:1.0:1788459952.693586:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 11 00000100:00100000:1.0:1788459952.694585:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3668700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022260224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788459952.694656:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459952.695825:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac25b3480 going to sleep for 11 seconds 00000100:00100000:0.0:1788459952.698709:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022260224 00000100:00100000:0.0:1788459952.698723:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022260224 00000100:00100000:0.0:1788459952.698835:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1788459952.698847:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf363fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+22:6530:x1875336022260224:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788459952.699053:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf363fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+22:6530:x1875336022260224:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 209us (4396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459952.699062:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1788459952.699278:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3668700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022260224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788459952.699335:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3668700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022260352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788459952.699390:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459952.699929:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac25b3480 going to sleep for 11 seconds 00000100:00100000:3.0:1788459952.700103:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022260352 00000100:00100000:3.0:1788459952.700109:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022260352 00000100:00100000:3.0:1788459952.700135:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1788459952.700143:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf363e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+22:6530:x1875336022260352:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788459952.700236:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf363e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+22:6530:x1875336022260352:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 94us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459952.700244:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1788459952.700552:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3668700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022260352:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788459952.701276:0:6530:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788459952.701424:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3668700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022260480:0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788459952.701478:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459952.701556:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac25b3480 going to sleep for 11 seconds 00000100:00100000:3.0:1788459952.701778:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022260480 00000100:00100000:3.0:1788459952.701785:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022260480 00000100:00100000:3.0:1788459952.701824:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1788459952.701840:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf363e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+22:6530:x1875336022260480:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788459952.702399:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf363e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+22:6530:x1875336022260480:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 559us (919us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459952.702407:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1788459952.702482:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3668700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022260480:0@lo:502:ll_cfg_requeue.0 00000040:00080000:1.0:1788459952.702765:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1788459952.703343:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:1.0:1788459952.703377:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:1.0:1788459952.703410:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:1.0:1788459952.703428:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:1.0:1788459952.703445:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:1.0:1788459952.703460:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:1.0:1788459952.703486:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:1.0:1788459952.703500:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:1.0:1788459952.703511:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:1.0:1788459952.703521:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:1.0:1788459952.703532:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:1.0:1788459952.703569:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3668700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022260608:0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788459952.704166:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459952.704254:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac25b3480 going to sleep for 11 seconds 00000100:00100000:3.0:1788459952.704507:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022260608 00000100:00100000:3.0:1788459952.704515:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022260608 00000100:00100000:3.0:1788459952.704792:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1788459952.704803:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf363c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+22:6530:x1875336022260608:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788459952.705209:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf363c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+22:6530:x1875336022260608:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 407us (1042us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459952.705217:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1788459952.705384:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3668700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022260608:0@lo:502:ll_cfg_requeue.0 00000040:00080000:1.0:1788459952.705452:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:1.0:1788459952.705464:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:1.0:1788459952.707211:0:10370:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788459952.707221:0:10370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788459952.707224:0:10370:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788459952.707230:0:10370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788459952.707239:0:10370:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788459952.707242:0:10370:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788459952.707243:0:10370:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788459952.707245:0:10370:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:2.0:1788459952.708378:0:6530:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1788459952.708396:0:6530:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788459952.708406:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac395fc00/0x5dfa74784542ae8a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ae91 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459952.708419:0:6530:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4ac395fc00/0x5dfa74784542ae8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ae91 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788459952.708431:0:6530:0:(mgc_request.c:715:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788459952.708434:0:6530:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-sptlrpc-ffff8c4bef21b800 from 1 10000000:01000000:2.0:1788459952.708437:0:6530:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788459952.708472:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6c00/0x5dfa74784542ae98 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459952.708480:0:6530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6c00/0x5dfa74784542ae98 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459952.708492:0:6530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6c00/0x5dfa74784542ae98 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788459952.708517:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022260736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788459952.708579:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459952.708614:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc65d70c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788459952.711014:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022260736 00000100:00100000:3.0:1788459952.711028:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022260736 00000100:00100000:3.0:1788459952.711086:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1788459952.711096:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf363d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+22:6530:x1875336022260736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788459952.711112:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788459952.711129:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4ac2840800/0x5dfa74784542ae9f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542ae98 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459952.711155:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4ac2840800/0x5dfa74784542ae9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542ae98 expref: 23 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459952.711167:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4ac2840800/0x5dfa74784542ae9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542ae98 expref: 23 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459952.711176:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ac2840800, rc 0) 00000100:00100000:3.0:1788459952.711246:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf363d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+23:6530:x1875336022260736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (2666us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459952.711259:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1788459952.711550:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022260736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788459952.711579:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6c00/0x5dfa74784542ae98 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ae9f expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459952.711601:0:6530:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6c00/0x5dfa74784542ae98 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542ae9f expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788459952.711684:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022260864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788459952.711719:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459952.711744:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc65d70c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788459952.711970:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022260864 00000100:00100000:0.0:1788459952.711986:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022260864 00000100:00100000:0.0:1788459952.712022:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1788459952.712030:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf363e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+23:6530:x1875336022260864:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788459952.712096:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf363e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+23:6530:x1875336022260864:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 66us (376us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788459952.712103:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1788459952.712137:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022260864:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1788459952.712148:0:6530:0:(mgc_request_server.c:748:mgc_llog_local_copy()) mgc192.168.206.105@tcp: no remote llog for lustre-sptlrpc, check MGS config 00000100:00100000:0.0:1788459952.712187:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022260992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788459952.712212:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459952.712231:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022260992 00000100:00100000:0.0:1788459952.712234:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022260992 00000100:00100000:0.0:1788459952.712250:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1788459952.712256:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf363c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+23:6530:x1875336022260992:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788459952.712296:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf363c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+23:6530:x1875336022260992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 40us (84us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788459952.712303:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1788459952.712321:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac2869900 going to sleep for 11 seconds 00000100:00100000:0.0:1788459952.712333:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022260992:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1788459952.712350:0:6530:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788459952.712356:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6c00/0x5dfa74784542ae98 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ae9f expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459952.712376:0:6530:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6c00/0x5dfa74784542ae98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ae9f expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788459952.712386:0:6530:0:(mgc_request.c:715:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788459952.712388:0:6530:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-client-ffff8c4bc438f000 from 48 10000000:01000000:0.0:1788459952.712391:0:6530:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788459952.712409:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bef208000/0x5dfa74784542aea6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459952.712417:0:6530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4bef208000/0x5dfa74784542aea6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459952.712425:0:6530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4bef208000/0x5dfa74784542aea6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788459952.712446:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022261120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788459952.712470:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459952.712489:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022261120 00000100:00100000:0.0:1788459952.712606:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022261120 00000100:00100000:0.0:1788459952.712625:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1788459952.712630:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf363c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+23:6530:x1875336022261120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788459952.712638:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788459952.712648:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4bef209a00/0x5dfa74784542aead lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542aea6 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459952.712664:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bef209a00/0x5dfa74784542aead lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542aea6 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459952.712673:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4bef209a00/0x5dfa74784542aead lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542aea6 expref: 24 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459952.712680:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bef209a00, rc 0) 00000100:00100000:0.0:1788459952.712703:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf363c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+24:6530:x1875336022261120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 73us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459952.712708:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1788459952.712727:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac2869900 going to sleep for 11 seconds 00000100:00100000:0.0:1788459952.712738:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022261120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788459952.712749:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4bef208000/0x5dfa74784542aea6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542aead expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459952.712757:0:6530:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4bef208000/0x5dfa74784542aea6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542aead expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788459952.712890:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 48 count 48 00000040:00080000:0.0:1788459952.713725:0:6530:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788459952.713907:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:0.0:1788459952.713968:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:0.0:1788459952.714003:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:0.0:1788459952.714020:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:0.0:1788459952.714034:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:0.0:1788459952.714048:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:0.0:1788459952.714062:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:0.0:1788459952.714075:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:0.0:1788459952.714086:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:0.0:1788459952.714097:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:0.0:1788459952.714110:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:0.0:1788459952.714124:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:0.0:1788459952.714138:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:0.0:1788459952.714150:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:0.0:1788459952.714163:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:0.0:1788459952.714175:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:0.0:1788459952.714188:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:0.0:1788459952.714216:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:0.0:1788459952.714233:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:0.0:1788459952.714244:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:0.0:1788459952.714255:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:0.0:1788459952.714267:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:0.0:1788459952.714280:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:0.0:1788459952.714294:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:0.0:1788459952.714307:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:0.0:1788459952.714319:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:0.0:1788459952.714332:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:0.0:1788459952.714346:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:0.0:1788459952.714360:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:0.0:1788459952.714400:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:0.0:1788459952.714415:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:0.0:1788459952.714429:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:0.0:1788459952.714443:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:0.0:1788459952.714472:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:0.0:1788459952.714488:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:0.0:1788459952.714502:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:0.0:1788459952.714516:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:0.0:1788459952.714530:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:0.0:1788459952.714544:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:0.0:1788459952.714557:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:0.0:1788459952.714571:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:0.0:1788459952.714585:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:0.0:1788459952.714598:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:0.0:1788459952.714612:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:0.0:1788459952.714625:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:0.0:1788459952.714639:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:0.0:1788459952.714663:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:0.0:1788459952.714669:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 47 count 48 00000100:00100000:0.0:1788459952.714749:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022261248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788459952.714803:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459952.714845:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022261248 00000100:00100000:0.0:1788459952.714851:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022261248 00000100:00100000:0.0:1788459952.714898:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1788459952.714908:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd0a6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+24:6530:x1875336022261248:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788459952.715030:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd0a6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+24:6530:x1875336022261248:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 124us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459952.715038:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1788459952.715074:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac2869900 going to sleep for 11 seconds 00000100:00100000:0.0:1788459952.715090:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022261248:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788459952.715126:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022261376:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788459952.715162:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459952.715190:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac2869900 going to sleep for 11 seconds 00000100:00100000:2.0:1788459952.715281:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022261376 00000100:00100000:2.0:1788459952.715286:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022261376 00000100:00100000:2.0:1788459952.715317:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1788459952.715324:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd0a6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+24:6530:x1875336022261376:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788459952.715409:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd0a6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+24:6530:x1875336022261376:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459952.715416:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1788459952.721346:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022261376:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788459952.722280:0:6530:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788459952.722383:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022261504:0@lo:502:ll_cfg_requeue.0 00000100:00100000:0.0:1788459952.722452:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459952.724603:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac2869900 going to sleep for 11 seconds 00000100:00100000:0.0:1788459952.725210:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022261504 00000100:00100000:0.0:1788459952.725221:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022261504 00000100:00100000:0.0:1788459952.725285:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1788459952.725295:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd0a6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+24:6530:x1875336022261504:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:0.0:1788459952.725469:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd0a6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+24:6530:x1875336022261504:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 176us (3017us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459952.725478:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1788459952.725688:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022261504:0@lo:502:ll_cfg_requeue.0 00000040:00080000:2.0:1788459952.725921:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:2.0:1788459952.725981:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:2.0:1788459952.725999:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:2.0:1788459952.726014:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:2.0:1788459952.726027:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:2.0:1788459952.726058:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:2.0:1788459952.726075:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:2.0:1788459952.726087:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:2.0:1788459952.726100:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:2.0:1788459952.726114:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:2.0:1788459952.726127:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:2.0:1788459952.726141:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:2.0:1788459952.726155:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:2.0:1788459952.726180:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:2.0:1788459952.726193:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:2.0:1788459952.726206:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:2.0:1788459952.726218:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:2.0:1788459952.726227:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:2.0:1788459952.726240:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:2.0:1788459952.726253:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:2.0:1788459952.726266:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:2.0:1788459952.726292:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:2.0:1788459952.726306:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:2.0:1788459952.726319:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:2.0:1788459952.726332:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:2.0:1788459952.726345:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:2.0:1788459952.726357:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:2.0:1788459952.726381:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:2.0:1788459952.726398:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:2.0:1788459952.726411:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:2.0:1788459952.726424:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:2.0:1788459952.726438:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:2.0:1788459952.726450:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:2.0:1788459952.726464:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:2.0:1788459952.726476:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:2.0:1788459952.726488:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:2.0:1788459952.726500:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:2.0:1788459952.726529:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:2.0:1788459952.726545:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:2.0:1788459952.726557:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:2.0:1788459952.726570:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:2.0:1788459952.726582:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:2.0:1788459952.726594:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:2.0:1788459952.726627:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:2.0:1788459952.726642:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:2.0:1788459952.726657:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:2.0:1788459952.726684:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:2.0:1788459952.726700:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:2.0:1788459952.726749:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022261632:0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788459952.726806:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459952.726848:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc65d70c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788459952.726856:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022261632 00000100:00100000:0.0:1788459952.726863:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022261632 00000100:00100000:0.0:1788459952.726901:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1788459952.726910:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd0a6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+24:6530:x1875336022261632:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:0.0:1788459952.727137:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd0a6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+24:6530:x1875336022261632:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 227us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459952.727144:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1788459952.727219:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022261632:0@lo:502:ll_cfg_requeue.0 00000040:00080000:2.0:1788459952.727355:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:2.0:1788459952.727389:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:2.0:1788459952.727413:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022261760:0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788459952.727449:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459952.727563:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bf7753900 going to sleep for 11 seconds 00000100:00100000:0.0:1788459952.727581:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022261760 00000100:00100000:0.0:1788459952.727586:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022261760 00000100:00100000:0.0:1788459952.727616:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1788459952.727623:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd0a6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+24:6530:x1875336022261760:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:0.0:1788459952.727703:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd0a6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+24:6530:x1875336022261760:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 79us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459952.727710:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1788459952.727748:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022261760:0@lo:502:ll_cfg_requeue.0 00000040:00080000:0.0:1788459952.727854:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:0.0:1788459952.727862:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000040:00080000:0.0:1788459952.731259:0:10374:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000020:01000000:1.0:1788459952.733157:0:6530:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1788459952.733179:0:6530:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788459952.733191:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bef208000/0x5dfa74784542aea6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542aead expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459952.733204:0:6530:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4bef208000/0x5dfa74784542aea6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542aead expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788459952.733631:0:6530:0:(mgc_request.c:715:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1788459952.733633:0:6530:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:1.0:1788459952.733636:0:6530:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1788459952.733669:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac395ea00/0x5dfa74784542aeb4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459952.733685:0:6530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4ac395ea00/0x5dfa74784542aeb4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459952.733697:0:6530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4ac395ea00/0x5dfa74784542aeb4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788459952.733788:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3668700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022261888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788459952.733848:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459952.733937:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac25b36c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788459952.734055:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022261888 00000100:00100000:0.0:1788459952.734062:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022261888 00000100:00100000:0.0:1788459952.734196:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1788459952.734206:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd0a6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+24:6530:x1875336022261888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788459952.734220:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788459952.734233:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4bef209600/0x5dfa74784542aebb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542aeb4 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459952.734264:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bef209600/0x5dfa74784542aebb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542aeb4 expref: 25 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459952.734276:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4bef209600/0x5dfa74784542aebb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542aeb4 expref: 25 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459952.734290:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bef209600, rc 0) 00000100:00100000:0.0:1788459952.734350:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd0a6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+25:6530:x1875336022261888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459952.734356:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1788459952.734417:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3668700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022261888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788459952.734434:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4ac395ea00/0x5dfa74784542aeb4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542aebb expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459952.734445:0:6530:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4ac395ea00/0x5dfa74784542aeb4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542aebb expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788459952.734617:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 43 count 43 00000040:00080000:2.0:1788459952.734821:0:6530:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788459952.735284:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].1, 224 off8416 00000040:00080000:2.0:1788459952.735309:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].2, 136 off8552 00000040:00080000:2.0:1788459952.735324:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].3, 176 off8728 00000040:00080000:2.0:1788459952.735338:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].4, 224 off8952 00000040:00080000:2.0:1788459952.735351:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].5, 224 off9176 00000040:00080000:2.0:1788459952.735363:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].6, 120 off9296 00000040:00080000:2.0:1788459952.735390:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].7, 112 off9408 00000040:00080000:2.0:1788459952.735404:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].8, 160 off9568 00000040:00080000:2.0:1788459952.735434:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].9, 224 off9792 00000040:00080000:2.0:1788459952.735460:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].10, 224 off10016 00000040:00080000:2.0:1788459952.735476:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].11, 88 off10104 00000040:00080000:2.0:1788459952.735490:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].12, 144 off10248 00000040:00080000:2.0:1788459952.735502:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].13, 152 off10400 00000040:00080000:2.0:1788459952.735514:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].14, 168 off10568 00000040:00080000:2.0:1788459952.735526:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].15, 224 off10792 00000040:00080000:2.0:1788459952.735539:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].16, 224 off11016 00000040:00080000:2.0:1788459952.735554:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].17, 80 off11096 00000040:00080000:2.0:1788459952.735567:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].18, 224 off11320 00000040:00080000:2.0:1788459952.735580:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].19, 224 off11544 00000040:00080000:2.0:1788459952.735591:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].20, 160 off11704 00000040:00080000:2.0:1788459952.736484:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].21, 224 off11928 00000040:00080000:2.0:1788459952.736501:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].22, 224 off12152 00000040:00080000:2.0:1788459952.736514:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].23, 80 off12232 00000040:00080000:2.0:1788459952.736527:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].24, 224 off12456 00000040:00080000:2.0:1788459952.736553:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].25, 224 off12680 00000040:00080000:2.0:1788459952.736569:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].26, 88 off12768 00000040:00080000:2.0:1788459952.736581:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].27, 144 off12912 00000040:00080000:2.0:1788459952.736594:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].28, 152 off13064 00000040:00080000:2.0:1788459952.736624:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].29, 136 off13200 00000040:00080000:2.0:1788459952.736638:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].30, 224 off13424 00000040:00080000:2.0:1788459952.736652:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].31, 224 off13648 00000040:00080000:2.0:1788459952.736665:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].32, 80 off13728 00000040:00080000:2.0:1788459952.736676:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].33, 224 off13952 00000040:00080000:2.0:1788459952.736688:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].34, 224 off14176 00000040:00080000:2.0:1788459952.736702:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].35, 88 off14264 00000040:00080000:2.0:1788459952.736716:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].36, 144 off14408 00000040:00080000:2.0:1788459952.736727:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].37, 152 off14560 00000040:00080000:2.0:1788459952.736738:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].38, 136 off14696 00000040:00080000:2.0:1788459952.736751:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].39, 224 off14920 00000040:00080000:2.0:1788459952.736764:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].40, 224 off15144 00000040:00080000:2.0:1788459952.736791:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].41, 80 off15224 00000040:00080000:2.0:1788459952.736831:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].42, 224 off15448 00000040:00080000:2.0:1788459952.736845:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 42 count 43 00000100:00100000:2.0:1788459952.738106:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022262016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788459952.738171:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459952.738224:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bf77539c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788459952.738242:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022262016 00000100:00100000:0.0:1788459952.738415:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022262016 00000100:00100000:0.0:1788459952.738691:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1788459952.738700:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd0a6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+25:6530:x1875336022262016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788459952.738856:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd0a6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+25:6530:x1875336022262016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 157us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459952.738865:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1788459952.738909:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022262016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788459952.739123:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022262144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788459952.739168:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459952.739213:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bf77539c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788459952.739266:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022262144 00000100:00100000:1.0:1788459952.739272:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022262144 00000100:00100000:1.0:1788459952.739307:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1788459952.739315:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd0a6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+25:6530:x1875336022262144:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788459952.739414:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd0a6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+25:6530:x1875336022262144:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 99us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459952.739421:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788459952.739491:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022262144:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788459952.740286:0:6530:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788459952.740353:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022262272:0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788459952.740410:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459952.740476:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bf77539c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788459952.743130:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022262272 00000100:00100000:1.0:1788459952.743141:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022262272 00000100:00100000:2.0:1788459952.743303:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788459952.743315:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd0a6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+25:6530:x1875336022262272:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788459952.743509:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd0a6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+25:6530:x1875336022262272:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 196us (3097us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459952.743517:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788459952.743612:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022262272:0@lo:502:ll_cfg_requeue.0 00000040:00080000:0.0:1788459952.743849:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].1, 224 off8416 00000040:00080000:0.0:1788459952.743880:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].2, 136 off8552 00000040:00080000:0.0:1788459952.743896:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].3, 176 off8728 00000040:00080000:0.0:1788459952.743909:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].4, 224 off8952 00000040:00080000:0.0:1788459952.743923:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].5, 224 off9176 00000040:00080000:0.0:1788459952.743936:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].6, 120 off9296 00000040:00080000:0.0:1788459952.743980:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].7, 112 off9408 00000040:00080000:0.0:1788459952.743996:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].8, 160 off9568 00000040:00080000:0.0:1788459952.744010:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].9, 224 off9792 00000040:00080000:0.0:1788459952.744023:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].10, 224 off10016 00000040:00080000:0.0:1788459952.744037:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].11, 88 off10104 00000040:00080000:0.0:1788459952.744051:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].12, 144 off10248 00000040:00080000:0.0:1788459952.744068:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].13, 152 off10400 00000040:00080000:0.0:1788459952.744083:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].14, 168 off10568 00000040:00080000:0.0:1788459952.744095:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].15, 224 off10792 00000040:00080000:0.0:1788459952.744106:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].16, 224 off11016 00000040:00080000:0.0:1788459952.744119:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].17, 80 off11096 00000040:00080000:0.0:1788459952.744132:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].18, 224 off11320 00000040:00080000:0.0:1788459952.744144:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].19, 224 off11544 00000040:00080000:0.0:1788459952.744156:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].20, 160 off11704 00000040:00080000:0.0:1788459952.744169:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].21, 224 off11928 00000040:00080000:0.0:1788459952.744180:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].22, 224 off12152 00000040:00080000:0.0:1788459952.744210:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].23, 80 off12232 00000040:00080000:0.0:1788459952.744225:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].24, 224 off12456 00000040:00080000:0.0:1788459952.744248:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].25, 224 off12680 00000040:00080000:0.0:1788459952.744264:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].26, 88 off12768 00000040:00080000:0.0:1788459952.744281:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].27, 144 off12912 00000040:00080000:0.0:1788459952.744295:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].28, 152 off13064 00000040:00080000:0.0:1788459952.744305:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].29, 136 off13200 00000040:00080000:0.0:1788459952.744316:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].30, 224 off13424 00000040:00080000:0.0:1788459952.744327:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].31, 224 off13648 00000040:00080000:0.0:1788459952.744340:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].32, 80 off13728 00000040:00080000:0.0:1788459952.744353:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].33, 224 off13952 00000040:00080000:0.0:1788459952.744380:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].34, 224 off14176 00000040:00080000:0.0:1788459952.744402:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].35, 88 off14264 00000040:00080000:0.0:1788459952.744420:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].36, 144 off14408 00000040:00080000:0.0:1788459952.744437:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].37, 152 off14560 00000040:00080000:0.0:1788459952.744452:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].38, 136 off14696 00000040:00080000:0.0:1788459952.744478:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].39, 224 off14920 00000040:00080000:0.0:1788459952.744494:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].40, 224 off15144 00000040:00080000:0.0:1788459952.744509:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].41, 80 off15224 00000040:00080000:0.0:1788459952.744526:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].42, 224 off15448 00000040:00080000:0.0:1788459952.744545:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].43, 224 off15672 00000040:00080000:0.0:1788459952.744561:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].44, 120 off15792 00000100:00100000:0.0:1788459952.744601:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022262400:0@lo:502:ll_cfg_requeue.0 00000100:00100000:0.0:1788459952.744656:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459952.744934:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022262400 00000100:00100000:1.0:1788459952.744941:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022262400 00000100:00100000:1.0:1788459952.744987:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788459952.744994:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd0a6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+25:6530:x1875336022262400:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788459952.745090:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd0a6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+25:6530:x1875336022262400:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 95us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459952.745097:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1788459952.745276:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac2869000 going to sleep for 11 seconds 00000100:00100000:0.0:1788459952.745459:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022262400:0@lo:502:ll_cfg_requeue.0 00000040:00080000:0.0:1788459952.745508:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].45, 224 off16016 00000040:00080000:0.0:1788459952.745518:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:1.0:1788459952.746600:0:10376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788459952.746613:0:10376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788459952.746615:0:10376:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788459952.746621:0:10376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788459952.746779:0:10376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788459952.746784:0:10376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788459952.746785:0:10376:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788459952.746789:0:10376:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x14:0x0] index 46 count 46 00000020:01000000:2.0:1788459952.747068:0:6530:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:2.0:1788459952.747080:0:6530:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1788459952.747090:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac395ea00/0x5dfa74784542aeb4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542aebb expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459952.747101:0:6530:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4ac395ea00/0x5dfa74784542aeb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542aebb expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788459952.747124:0:6530:0:(mgc_request.c:715:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788459952.747128:0:6530:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-sptlrpc-ffff8c4bc438f000 from 1 10000000:01000000:2.0:1788459952.747131:0:6530:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788459952.747164:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6200/0x5dfa74784542aec2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459952.747172:0:6530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6200/0x5dfa74784542aec2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459952.747182:0:6530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6200/0x5dfa74784542aec2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788459952.747202:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022262528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788459952.747258:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459952.747445:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bf7753b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788459952.750834:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022262528 00000100:00100000:1.0:1788459952.750850:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022262528 00000100:00100000:1.0:1788459952.750968:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1788459952.750979:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd0a6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+25:6530:x1875336022262528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788459952.750995:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788459952.751011:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4ac395ec00/0x5dfa74784542aec9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542aec2 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459952.751038:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4ac395ec00/0x5dfa74784542aec9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542aec2 expref: 26 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459952.751049:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4ac395ec00/0x5dfa74784542aec9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542aec2 expref: 26 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459952.751057:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ac395ec00, rc 0) 00000100:00100000:1.0:1788459952.751134:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd0a6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+26:6530:x1875336022262528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (3875us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459952.751141:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788459952.751257:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022262528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788459952.751275:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6200/0x5dfa74784542aec2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542aec9 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459952.751298:0:6530:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6200/0x5dfa74784542aec2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542aec9 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788459952.751395:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022262656:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788459952.751428:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459952.755645:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022262656 00000100:00100000:2.0:1788459952.755661:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022262656 00000100:00100000:2.0:1788459952.755908:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788459952.755918:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd0a6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+26:6530:x1875336022262656:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788459952.756039:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd0a6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+26:6530:x1875336022262656:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 121us (4608us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788459952.756048:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788459952.759092:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac2869000 going to sleep for 11 seconds 00000100:00100000:1.0:1788459952.759128:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022262656:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1788459952.759154:0:6530:0:(mgc_request_server.c:748:mgc_llog_local_copy()) mgc192.168.206.105@tcp: no remote llog for lustre-sptlrpc, check MGS config 00000100:00100000:1.0:1788459952.759238:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3668700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022262784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788459952.759308:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459952.759348:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022262784 00000100:00100000:1.0:1788459952.759353:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022262784 00000100:00100000:1.0:1788459952.759408:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788459952.759417:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+26:6530:x1875336022262784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788459952.759481:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+26:6530:x1875336022262784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 65us (173us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788459952.759489:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788459952.759520:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac25b3240 going to sleep for 11 seconds 00000100:00100000:1.0:1788459952.759532:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3668700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022262784:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1788459952.759549:0:6530:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788459952.759558:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6200/0x5dfa74784542aec2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542aec9 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459952.759568:0:6530:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6200/0x5dfa74784542aec2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542aec9 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788459952.759578:0:6530:0:(mgc_request.c:715:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788459952.759580:0:6530:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-client-ffff8c4be2d81000 from 48 10000000:01000000:1.0:1788459952.759583:0:6530:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788459952.759604:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac395f200/0x5dfa74784542aed0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459952.759613:0:6530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4ac395f200/0x5dfa74784542aed0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459952.759621:0:6530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4ac395f200/0x5dfa74784542aed0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788459952.759644:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3668700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022262912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788459952.759680:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459952.759701:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac25b3240 going to sleep for 11 seconds 00000100:00100000:3.0:1788459952.759865:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022262912 00000100:00100000:3.0:1788459952.759873:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022262912 00000100:00100000:3.0:1788459952.759907:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1788459952.759915:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+26:6530:x1875336022262912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788459952.759924:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788459952.759937:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4ac2841000/0x5dfa74784542aed7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542aed0 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459952.760013:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4ac2841000/0x5dfa74784542aed7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542aed0 expref: 27 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459952.760025:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4ac2841000/0x5dfa74784542aed7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542aed0 expref: 27 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459952.760033:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ac2841000, rc 0) 00000100:00100000:3.0:1788459952.760064:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+27:6530:x1875336022262912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459952.760069:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788459952.760642:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3668700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022262912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788459952.760658:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4ac395f200/0x5dfa74784542aed0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542aed7 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459952.760678:0:6530:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4ac395f200/0x5dfa74784542aed0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542aed7 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788459952.760716:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3668700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022263040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788459952.760745:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459952.760777:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac25b3240 going to sleep for 11 seconds 00000100:00100000:3.0:1788459952.760862:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022263040 00000100:00100000:3.0:1788459952.760868:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022263040 00000100:00100000:0.0:1788459952.760909:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1788459952.760998:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd0a6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+27:6530:x1875336022263040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788459952.761150:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd0a6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+27:6530:x1875336022263040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 162us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459952.761194:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3668700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022263040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788459952.761222:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3668700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022263168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788459952.761261:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459952.761282:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022263168 00000100:00100000:1.0:1788459952.761285:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022263168 00000100:00100000:0.0:1788459952.765924:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1788459952.766065:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1788459952.766081:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+27:6530:x1875336022263168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788459952.766223:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+27:6530:x1875336022263168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 148us (4961us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459952.766231:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1788459952.766271:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac25b3240 going to sleep for 11 seconds 00000100:00100000:1.0:1788459952.766299:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3668700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022263168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788459952.768217:0:10377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3668700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0cf73fe6-82e2-434e-b670-631647721b2c:10377:1875336022263296:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788459952.768286:0:10377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459952.768324:0:10377:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac25b3900 going to sleep for 11 seconds 00000100:00100000:0.0:1788459952.768379:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022263296 00000100:00100000:0.0:1788459952.768386:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022263296 00000100:00100000:0.0:1788459952.768421:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1788459952.768430:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+27:10377:x1875336022263296:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788459952.768545:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+27:10377:x1875336022263296:12345-0@lo:502:llog_process_th.0 Request processed in 116us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459952.768553:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1788459952.768769:0:10377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3668700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0cf73fe6-82e2-434e-b670-631647721b2c:10377:1875336022263296:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788459952.768811:0:10377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3668700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0cf73fe6-82e2-434e-b670-631647721b2c:10377:1875336022263424:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788459952.768842:0:10377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459952.768898:0:10377:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac25b3900 going to sleep for 11 seconds 00000100:00100000:0.0:1788459952.772009:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022263424 00000100:00100000:0.0:1788459952.772023:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022263424 00000100:00100000:0.0:1788459952.773884:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1788459952.773905:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+27:10377:x1875336022263424:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788459952.774085:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+27:10377:x1875336022263424:12345-0@lo:502:llog_process_th.0 Request processed in 189us (5241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459952.774094:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1788459952.778422:0:10377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3668700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0cf73fe6-82e2-434e-b670-631647721b2c:10377:1875336022263424:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788459952.778468:0:10377:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1788459952.778811:0:6530:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1788459952.778822:0:6530:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788459952.778832:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac395f200/0x5dfa74784542aed0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542aed7 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459952.778843:0:6530:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4ac395f200/0x5dfa74784542aed0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542aed7 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788459952.778871:0:6530:0:(mgc_request.c:715:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788459952.778874:0:6530:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:3.0:1788459952.778877:0:6530:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788459952.778912:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac2841a00/0x5dfa74784542aede lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459952.778921:0:6530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4ac2841a00/0x5dfa74784542aede lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459952.778930:0:6530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4ac2841a00/0x5dfa74784542aede lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788459952.778972:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfa1e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022263552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788459952.779067:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459952.779112:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac25b6a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788459952.779188:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022263552 00000100:00100000:1.0:1788459952.779198:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022263552 00000100:00100000:1.0:1788459952.779240:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1788459952.779250:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+27:6530:x1875336022263552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788459952.779263:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788459952.779275:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4ac395e400/0x5dfa74784542aee5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542aede expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459952.779297:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4ac395e400/0x5dfa74784542aee5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542aede expref: 28 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459952.779307:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4ac395e400/0x5dfa74784542aee5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542aede expref: 28 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459952.779316:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ac395e400, rc 0) 00000100:00100000:1.0:1788459952.779363:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+28:6530:x1875336022263552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459952.779388:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1788459952.779403:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfa1e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022263552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788459952.779429:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4ac2841a00/0x5dfa74784542aede lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542aee5 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459952.779439:0:6530:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4ac2841a00/0x5dfa74784542aede lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542aee5 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788459952.779470:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfa1e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022263680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788459952.779494:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459952.779515:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac25b6a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788459952.780066:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022263680 00000100:00100000:1.0:1788459952.780072:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022263680 00000100:00100000:1.0:1788459952.780102:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1788459952.780114:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+28:6530:x1875336022263680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788459952.780337:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+28:6530:x1875336022263680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 228us (841us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459952.780344:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1788459952.780397:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfa1e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022263680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788459952.780637:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3668700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022263808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788459952.780776:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459952.780805:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022263808 00000100:00100000:1.0:1788459952.780809:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022263808 00000100:00100000:1.0:1788459952.780830:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1788459952.780852:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+28:6530:x1875336022263808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788459952.781379:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+28:6530:x1875336022263808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 515us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459952.781386:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1788459952.781434:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac25b3cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788459952.781451:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3668700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022263808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788459952.791982:0:10378:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0cf73fe6-82e2-434e-b670-631647721b2c:10378:1875336022263936:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788459952.792066:0:10378:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459952.792111:0:10378:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bf7753c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788459952.792250:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022263936 00000100:00100000:1.0:1788459952.792262:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022263936 00000100:00100000:1.0:1788459952.792304:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1788459952.792313:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+28:10378:x1875336022263936:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788459952.792452:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+28:10378:x1875336022263936:12345-0@lo:502:llog_process_th.0 Request processed in 140us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459952.792460:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1788459952.792557:0:10378:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0cf73fe6-82e2-434e-b670-631647721b2c:10378:1875336022263936:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788459952.792587:0:10378:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788459952.792595:0:10378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788459952.792597:0:10378:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788459952.792603:0:10378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788459952.792624:0:10378:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0cf73fe6-82e2-434e-b670-631647721b2c:10378:1875336022264064:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788459952.792787:0:10378:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459952.792809:0:10378:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac2869480 going to sleep for 11 seconds 00000100:00100000:1.0:1788459952.792849:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022264064 00000100:00100000:1.0:1788459952.792854:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022264064 00000100:00100000:1.0:1788459952.792885:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1788459952.792892:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+28:10378:x1875336022264064:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788459952.792984:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+28:10378:x1875336022264064:12345-0@lo:502:llog_process_th.0 Request processed in 92us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459952.792991:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1788459952.793069:0:10378:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0cf73fe6-82e2-434e-b670-631647721b2c:10378:1875336022264064:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788459952.793090:0:10378:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788459952.793094:0:10378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788459952.793095:0:10378:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788459952.793098:0:10378:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1788459952.796033:0:6530:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:1.0:1788459952.796049:0:6530:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788459952.796060:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac2841a00/0x5dfa74784542aede lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542aee5 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459952.796073:0:6530:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4ac2841a00/0x5dfa74784542aede lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542aee5 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788459952.796084:0:6530:0:(mgc_request.c:715:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788459952.796086:0:6530:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-sptlrpc-ffff8c4be2d81000 from 1 10000000:01000000:1.0:1788459952.796090:0:6530:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788459952.796124:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac395f000/0x5dfa74784542aeec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459952.796131:0:6530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4ac395f000/0x5dfa74784542aeec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459952.796141:0:6530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4ac395f000/0x5dfa74784542aeec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788459952.796172:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3668700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022264192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788459952.796231:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459952.796265:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bfa392480 going to sleep for 11 seconds 00000100:00100000:0.0:1788459952.796326:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022264192 00000100:00100000:0.0:1788459952.796333:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022264192 00000100:00100000:0.0:1788459952.796390:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1788459952.796400:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+28:6530:x1875336022264192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788459952.796413:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788459952.796425:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4bef208e00/0x5dfa74784542aef3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542aeec expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459952.796447:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bef208e00/0x5dfa74784542aef3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542aeec expref: 29 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459952.796457:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4bef208e00/0x5dfa74784542aef3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542aeec expref: 29 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459952.796465:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bef208e00, rc 0) 00000100:00100000:0.0:1788459952.796501:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+29:6530:x1875336022264192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459952.796518:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1788459952.797644:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3668700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022264192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788459952.797664:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4ac395f000/0x5dfa74784542aeec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542aef3 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459952.797684:0:6530:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4ac395f000/0x5dfa74784542aeec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542aef3 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788459952.797725:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3668700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022264320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788459952.797763:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459952.797797:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bfa392480 going to sleep for 11 seconds 00000100:00100000:0.0:1788459952.798024:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022264320 00000100:00100000:0.0:1788459952.798030:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022264320 00000100:00100000:0.0:1788459952.798066:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1788459952.798075:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+29:6530:x1875336022264320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788459952.798167:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+29:6530:x1875336022264320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 93us (402us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788459952.798175:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1788459952.800744:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3668700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022264320:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1788459952.800776:0:6530:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788459952.800792:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac395f000/0x5dfa74784542aeec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542aef3 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459952.800804:0:6530:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4ac395f000/0x5dfa74784542aeec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542aef3 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459952.915479:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788459953.358397:0:10410:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff2b3cadf0 20000000:00000080:1.0:1788459953.358417:0:10410:0:(mgs_handler.c:1172:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8c4ac3ab4000 uarg=0000000000000000 20000000:01000000:1.0:1788459953.358459:0:10410:0:(mgs_llog.c:6198:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788459953.358464:0:10410:0:(mgs_llog.c:4653:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788459953.358469:0:10410:0:(mgs_llog.c:1385:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788459953.361390:0:10411:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1788459953.361507:0:10410:0:(mgs_llog.c:4126:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1788459953.367307:0:10410:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1788459953.367343:0:10410:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1788459953.367360:0:10410:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1788459953.367387:0:10410:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788459953.367406:0:10410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c4bef209e00/0x5dfa74784542aefa lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459953.367423:0:10410:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4bef208a00/0x5dfa74784542aafc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542aaf5 expref: 28 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459953.367431:0:10410:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4bc29d3c00/0x5dfa74784542ab0a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542ab03 expref: 28 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459953.367438:0:10410:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4bef208600/0x5dfa74784542ab6c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542ab65 expref: 28 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459953.367445:0:10410:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4bef209800/0x5dfa74784542acbc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542acb5 expref: 28 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459953.367454:0:10410:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4bfadc7e00/0x5dfa74784542ae0c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a4cb expref: 9 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459953.367477:0:10410:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c4bef209e00/0x5dfa74784542aefa lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459953.367515:0:10410:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4bfadc7e00/0x5dfa74784542ae0c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a4cb expref: 9 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459953.367529:0:10410:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c4bfadc7e00/0x5dfa74784542ae0c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a4cb expref: 9 pid: 6525 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788459953.367543:0:10410:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10410:1875336022264448:192.168.206.5@tcp:104: 00010000:00010000:0.0:1788459953.367713:0:10410:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4bef209800/0x5dfa74784542acbc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5dfa74784542acb5 expref: 28 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459953.367723:0:10410:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c4bef209800/0x5dfa74784542acbc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5dfa74784542acb5 expref: 28 pid: 6526 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788459953.367732:0:10410:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3afb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10410:1875336022264576:0@lo:104: 00000100:00100000:0.0:1788459953.367784:0:10410:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788459953.367826:0:10410:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4bef208600/0x5dfa74784542ab6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5dfa74784542ab65 expref: 28 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459953.367834:0:10410:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c4bef208600/0x5dfa74784542ab6c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5dfa74784542ab65 expref: 28 pid: 6525 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788459953.367844:0:10410:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10410:1875336022264704:0@lo:104: 00000100:00100000:2.0:1788459953.367860:0:6516:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:0.0:1788459953.367874:0:10410:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4bc29d3c00/0x5dfa74784542ab0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5dfa74784542ab03 expref: 28 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788459953.367892:0:6516:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788459953.367903:0:10410:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c4bc29d3c00/0x5dfa74784542ab0a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5dfa74784542ab03 expref: 28 pid: 6525 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788459953.367914:0:10410:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3afbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10410:1875336022264832:0@lo:104: 00000100:00100000:2.0:1788459953.367918:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022264576 00000100:00100000:2.0:1788459953.367925:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022264576 00000100:00100000:2.0:1788459953.368004:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022264704 00000100:00100000:2.0:1788459953.368008:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022264704 00000100:00100000:2.0:1788459953.368023:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788459953.368030:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac2b38850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0cf73fe6-82e2-434e-b670-631647721b2c+4:10410:x1875336022264576:12345-0@lo:104: 00010000:00010000:2.0:1788459953.368042:0:6516:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.206.105@tcp lock: ffff8c4ac2841600/0x5dfa74784542acb5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542acbc expref: -99 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459953.368088:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788459953.368093:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac2b38850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0cf73fe6-82e2-434e-b670-631647721b2c+4:10410:x1875336022264576:12345-0@lo:104: Request processed in 64us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459953.368101:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788459953.368134:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788459953.368141:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3af5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0cf73fe6-82e2-434e-b670-631647721b2c+3:10410:x1875336022264704:12345-0@lo:104: 00010000:00010000:2.0:1788459953.368149:0:6516:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d3e00/0x5dfa74784542ab65 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542ab6c expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459953.368180:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788459953.368185:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3af5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0cf73fe6-82e2-434e-b670-631647721b2c+3:10410:x1875336022264704:12345-0@lo:104: Request processed in 45us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459953.368191:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:2.0:1788459953.368669:0:9537:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788459953.368676:0:9537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: ffff8c4ac2841600/0x5dfa74784542acb5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542acbc expref: -99 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459953.368685:0:9537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac2841600 already unused, calling callback (ffffffffc125ae00) 10000000:00010000:2.0:1788459953.368689:0:9537:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: ffff8c4ac2841600/0x5dfa74784542acb5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5dfa74784542acbc expref: -99 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459953.368706:0:9537:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: ffff8c4ac2841600/0x5dfa74784542acb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5dfa74784542acbc expref: -99 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788459953.368714:0:9537:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: ffff8c4ac2841600/0x5dfa74784542acb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5dfa74784542acbc expref: -99 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788459953.368720:0:9537:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788459953.368751:0:9537:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.206.105@tcp lock: ffff8c4ac2841600/0x5dfa74784542acb5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542acbc expref: -99 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459953.368759:0:9537:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788459953.369055:0:9537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: ffff8c4ac2841600/0x5dfa74784542acb5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542acbc expref: -99 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459953.369064:0:9537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: ffff8c4ac2841600/0x5dfa74784542acb5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542acbc expref: -99 pid: 9525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459953.369079:0:9537:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788459953.369083:0:9537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d3e00/0x5dfa74784542ab65 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542ab6c expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459953.369090:0:9537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc29d3e00 already unused, calling callback (ffffffffc125ae00) 10000000:00010000:2.0:1788459953.369093:0:9537:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d3e00/0x5dfa74784542ab65 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5dfa74784542ab6c expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459953.369100:0:9537:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d3e00/0x5dfa74784542ab65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5dfa74784542ab6c expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788459953.369107:0:9537:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d3e00/0x5dfa74784542ab65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5dfa74784542ab6c expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788459953.369119:0:9537:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788459953.369137:0:9537:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d3e00/0x5dfa74784542ab65 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542ab6c expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459953.369143:0:9537:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788459953.369159:0:9537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d3e00/0x5dfa74784542ab65 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542ab6c expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459953.369166:0:9537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d3e00/0x5dfa74784542ab65 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542ab6c expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459953.369175:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788459953.369177:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788459953.369178:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788459953.369185:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788459953.370016:0:10410:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788459953.370143:0:10410:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4bef208a00/0x5dfa74784542aafc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5dfa74784542aaf5 expref: 28 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459953.370155:0:10410:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c4bef208a00/0x5dfa74784542aafc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5dfa74784542aaf5 expref: 28 pid: 6526 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788459953.370166:0:10410:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10410:1875336022265216:0@lo:104: 00000100:00100000:0.0:1788459953.370210:0:10410:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459953.370221:0:10410:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc2ab3900 going to sleep for 11 seconds 00000100:00100000:0.0:1788459953.370242:0:10410:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3afb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10410:1875336022264576:0@lo:104: 00000100:00100000:0.0:1788459953.370251:0:10410:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10410:1875336022264704:0@lo:104: 00000100:00100000:1.0:1788459953.370476:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022264832 00000100:00100000:1.0:1788459953.370483:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022264832 00000100:00100000:1.0:1788459953.370535:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022265216 00000100:00100000:1.0:1788459953.370538:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022265216 00000100:00100000:1.0:1788459953.370552:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788459953.370560:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3af8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0cf73fe6-82e2-434e-b670-631647721b2c+4:10410:x1875336022264832:12345-0@lo:104: 00010000:00010000:1.0:1788459953.370571:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2800/0x5dfa74784542ab03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542ab0a expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459953.370629:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788459953.370635:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3af8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0cf73fe6-82e2-434e-b670-631647721b2c+4:10410:x1875336022264832:12345-0@lo:104: Request processed in 76us (2694us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459953.370642:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788459953.370659:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788459953.370665:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3afb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0cf73fe6-82e2-434e-b670-631647721b2c+3:10410:x1875336022265216:12345-0@lo:104: 00010000:00010000:1.0:1788459953.370689:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2e00/0x5dfa74784542aaf5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542aafc expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459953.370723:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788459953.370728:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3afb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0cf73fe6-82e2-434e-b670-631647721b2c+3:10410:x1875336022265216:12345-0@lo:104: Request processed in 64us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459953.370734:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788459953.371189:0:10410:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3afbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10410:1875336022264832:0@lo:104: 00000100:00100000:0.0:1788459953.371199:0:10410:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10410:1875336022265216:0@lo:104: 00010000:00010000:3.0:1788459953.371542:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788459953.371550:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2800/0x5dfa74784542ab03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542ab0a expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459953.371559:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc29d2800 already unused, calling callback (ffffffffc125ae00) 10000000:00010000:3.0:1788459953.371563:0:6521:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2800/0x5dfa74784542ab03 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5dfa74784542ab0a expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459953.371571:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2800/0x5dfa74784542ab03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5dfa74784542ab0a expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788459953.371578:0:6521:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2800/0x5dfa74784542ab03 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5dfa74784542ab0a expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788459953.371584:0:6521:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788459953.371613:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2800/0x5dfa74784542ab03 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542ab0a expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459953.371619:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788459953.371630:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2800/0x5dfa74784542ab03 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542ab0a expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459953.371636:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2800/0x5dfa74784542ab03 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542ab0a expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459953.371659:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788459953.371662:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2e00/0x5dfa74784542aaf5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542aafc expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459953.371679:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc29d2e00 already unused, calling callback (ffffffffc125ae00) 10000000:00010000:3.0:1788459953.371683:0:6521:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2e00/0x5dfa74784542aaf5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5dfa74784542aafc expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459953.371689:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2e00/0x5dfa74784542aaf5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5dfa74784542aafc expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788459953.371695:0:6521:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2e00/0x5dfa74784542aaf5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5dfa74784542aafc expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788459953.371700:0:6521:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788459953.371714:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2e00/0x5dfa74784542aaf5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542aafc expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459953.371719:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788459953.371727:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2e00/0x5dfa74784542aaf5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542aafc expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459953.371732:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2e00/0x5dfa74784542aaf5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542aafc expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459953.371756:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788459953.371757:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788459953.371759:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788459953.371778:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788459953.371898:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0cf73fe6-82e2-434e-b670-631647721b2c:3661:1875336022265088:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788459953.371938:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459953.372067:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfa1e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0cf73fe6-82e2-434e-b670-631647721b2c:3662:1875336022265344:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788459953.373291:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfa1e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0cf73fe6-82e2-434e-b670-631647721b2c:3659:1875336022265472:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788459953.373334:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459953.373354:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788459953.373372:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0cf73fe6-82e2-434e-b670-631647721b2c:3659:1875336022264960:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788459953.373393:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459953.373424:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022265088 00000100:00100000:3.0:1788459953.373430:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022265088 00010000:00010000:3.0:1788459953.373462:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4bef208600/0x5dfa74784542ab6c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542ab65 expref: 29 pid: 6525 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788459953.373490:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022265472 00000100:00100000:3.0:1788459953.373494:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022265472 00010000:00010000:3.0:1788459953.373506:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4bef208a00/0x5dfa74784542aafc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542aaf5 expref: 30 pid: 6526 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788459953.373521:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022264960 00000100:00100000:3.0:1788459953.373523:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022264960 00010000:00010000:3.0:1788459953.373532:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4bef209800/0x5dfa74784542acbc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542acb5 expref: 31 pid: 6526 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788459953.373544:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788459953.373551:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfa1e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0cf73fe6-82e2-434e-b670-631647721b2c+31:3661:x1875336022265088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788459953.373563:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788459953.373568:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4bef208600/0x5dfa74784542ab6c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542ab65 expref: 31 pid: 6525 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459953.373578:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4bef208600/0x5dfa74784542ab6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5dfa74784542ab65 expref: 31 pid: 6525 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459953.373602:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4bef208600/0x5dfa74784542ab6c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5dfa74784542ab65 expref: 31 pid: 6525 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459953.373615:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788459953.373648:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfa1e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0cf73fe6-82e2-434e-b670-631647721b2c+30:3661:x1875336022265088:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (1710us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459953.373655:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788459953.373672:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788459953.373678:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfa1e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0cf73fe6-82e2-434e-b670-631647721b2c+29:3659:x1875336022265472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788459953.373685:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788459953.373689:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4bef208a00/0x5dfa74784542aafc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542aaf5 expref: 29 pid: 6526 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459953.373698:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4bef208a00/0x5dfa74784542aafc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5dfa74784542aaf5 expref: 29 pid: 6526 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459953.373709:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4bef208a00/0x5dfa74784542aafc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5dfa74784542aaf5 expref: 29 pid: 6526 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459953.373719:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788459953.373723:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788459953.373736:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfa1e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0cf73fe6-82e2-434e-b670-631647721b2c+28:3659:x1875336022264960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788459953.373746:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1788459953.373751:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfa1e3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0cf73fe6-82e2-434e-b670-631647721b2c+28:3659:x1875336022265472:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (415us total) trans 0 rc 0/0 00010000:00010000:2.0:1788459953.373753:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4bef209800/0x5dfa74784542acbc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542acb5 expref: 28 pid: 6526 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788459953.373765:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:2.0:1788459953.373772:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4bef209800/0x5dfa74784542acbc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5dfa74784542acb5 expref: 28 pid: 6526 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459953.373786:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4bef209800/0x5dfa74784542acbc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5dfa74784542acb5 expref: 27 pid: 6526 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459953.373796:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788459953.373808:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0cf73fe6-82e2-434e-b670-631647721b2c:3661:1875336022265088:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788459953.373831:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfa1e0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0cf73fe6-82e2-434e-b670-631647721b2c+26:3659:x1875336022264960:12345-0@lo:103:ldlm_bl.0 Request processed in 98us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459953.373838:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0cf73fe6-82e2-434e-b670-631647721b2c:3659:1875336022264960:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788459953.373853:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788459953.373855:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfa1e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0cf73fe6-82e2-434e-b670-631647721b2c:3659:1875336022265472:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788459953.373889:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459953.374089:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022265344 00000100:00100000:1.0:1788459953.374094:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022265344 00010000:00010000:1.0:1788459953.374110:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4bc29d3c00/0x5dfa74784542ab0a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542ab03 expref: 26 pid: 6525 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788459953.374131:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788459953.374136:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfa1e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0cf73fe6-82e2-434e-b670-631647721b2c+26:3662:x1875336022265344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788459953.374143:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788459953.374146:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4bc29d3c00/0x5dfa74784542ab0a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542ab03 expref: 26 pid: 6525 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459953.374153:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4bc29d3c00/0x5dfa74784542ab0a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5dfa74784542ab03 expref: 26 pid: 6525 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459953.374169:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4bc29d3c00/0x5dfa74784542ab0a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5dfa74784542ab03 expref: 26 pid: 6525 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459953.374179:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788459953.374221:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfa1e0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0cf73fe6-82e2-434e-b670-631647721b2c+25:3662:x1875336022265344:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459953.374226:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788459953.374630:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfa1e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0cf73fe6-82e2-434e-b670-631647721b2c:3662:1875336022265344:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788459953.378387:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788459953.378449:0:9549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003327744 00000100:00100000:1.0:1788459953.378457:0:9549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003327744 00010000:00010000:1.0:1788459953.378493:0:9549:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4bfadc7e00/0x5dfa74784542ae0c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a4cb expref: 10 pid: 6525 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788459953.378525:0:9549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 47 00000100:00100000:1.0:1788459953.378534:0:9549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bedf6c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bed032f6-c389-485e-b2f7-e2ea34763c65+10:2394:x1875336003327744:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788459953.378547:0:9549:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788459953.378553:0:9549:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4bfadc7e00/0x5dfa74784542ae0c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a4cb expref: 10 pid: 6525 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459953.378566:0:9549:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4bfadc7e00/0x5dfa74784542ae0c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a4cb expref: 10 pid: 6525 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459953.378587:0:9549:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c4bef209e00/0x5dfa74784542aefa lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459953.378596:0:9549:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bef209e00/0x5dfa74784542aefa lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459953.378611:0:9549:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c4bef209e00/0x5dfa74784542aefa lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459953.378640:0:9549:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c4bef209e00/0x5dfa74784542aefa lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459953.378647:0:9549:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c4bef209e00/0x5dfa74784542aefa lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459953.378653:0:9549:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c4bef209e00/0x5dfa74784542aefa lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459953.378659:0:9549:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bef209e00 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:1.0:1788459953.378663:0:9549:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c4bef209e00/0x5dfa74784542aefa lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459953.378685:0:9549:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c4bef209e00/0x5dfa74784542aefa lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459953.378695:0:9549:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c4bef209e00/0x5dfa74784542aefa lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459953.378705:0:9549:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788459953.378762:0:9549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bedf6c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:bed032f6-c389-485e-b2f7-e2ea34763c65+10:2394:x1875336003327744:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 227us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459953.378770:0:9549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 47 00010000:00010000:0.0:1788459953.378914:0:10410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4bfadc7e00/0x5dfa74784542ae0c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a4cb expref: 9 pid: 6525 timeout: 350 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788459953.378929:0:10410:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10410:1875336022264448:192.168.206.5@tcp:104: 00010000:00010000:0.0:1788459953.379247:0:10410:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c4bef209e00/0x5dfa74784542aefa lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459953.379258:0:10410:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c4bef209e00/0x5dfa74784542aefa lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459953.379272:0:10410:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c4bef209e00/0x5dfa74784542aefa lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459953.379279:0:10410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4bef209e00/0x5dfa74784542aefa lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788459953.603221:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788459953.603269:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788459953.603298:0:8832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003328128 00000100:00100000:1.0:1788459953.603307:0:8832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003328128 00000100:00100000:1.0:1788459953.603392:0:8832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 18 00000100:00100000:1.0:1788459953.603402:0:8832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3b6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2393:x1875336003328128:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:1.0:1788459953.603476:0:8832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3b6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2393:x1875336003328128:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 75us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459953.603485:0:8832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 18 00000100:00100000:1.0:1788459953.603522:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788459953.603624:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788459953.603641:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003328256 00000100:00100000:1.0:1788459953.603645:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003328256 00000100:00100000:1.0:1788459953.603669:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 19 00000100:00100000:1.0:1788459953.603675:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3b6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2393:x1875336003328256:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:1.0:1788459953.603707:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3b6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2393:x1875336003328256:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 32us (82us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459953.603714:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 19 00000100:00100000:3.0:1788459953.604207:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003327872 00000100:00100000:3.0:1788459953.604213:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003327872 00000100:00100000:3.0:1788459953.604295:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003328000 00000100:00100000:3.0:1788459953.604299:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003328000 00000100:00100000:3.0:1788459953.604327:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 59 00000100:00100000:3.0:1788459953.604335:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3668700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:2393:x1875336003327872:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:3.0:1788459953.604590:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3668700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:2393:x1875336003327872:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 255us (1377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459953.604598:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 59 00000100:00100000:3.0:1788459953.604614:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 60 00000100:00100000:3.0:1788459953.604621:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3b6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2393:x1875336003328000:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:3.0:1788459953.604648:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3b6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2393:x1875336003328000:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 28us (1125us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459953.604654:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 60 00000100:00080000:2.0:1788459953.609645:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788459953.609655:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788459953.609659:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788459953.609732:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:3.0:1788459953.865055:0:6530:0:(mgc_request.c:715:do_requeue()) updating log params 10000000:01000000:3.0:1788459953.865063:0:6530:0:(mgc_request.c:2266:mgc_process_log()) Process log params-ffff8c4bfc4e5800 from 4 10000000:01000000:3.0:1788459953.865067:0:6530:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788459953.865108:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac2841200/0x5dfa74784542af01 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459953.865120:0:6530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4ac2841200/0x5dfa74784542af01 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459953.865131:0:6530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4ac2841200/0x5dfa74784542af01 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788459953.865169:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfa1e1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022265600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788459953.865232:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459953.865376:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022265600 00000100:00100000:1.0:1788459953.865383:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022265600 00000100:00100000:3.0:1788459953.865737:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac25b6000 going to sleep for 11 seconds 00000100:00100000:1.0:1788459953.867160:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1788459953.867176:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+25:6530:x1875336022265600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788459953.867191:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788459953.867207:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4ac395f600/0x5dfa74784542af08 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542af01 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459953.867230:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4ac395f600/0x5dfa74784542af08 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542af01 expref: 26 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459953.867241:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4ac395f600/0x5dfa74784542af08 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542af01 expref: 26 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459953.867250:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ac395f600, rc 0) 00000100:00100000:1.0:1788459953.867335:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+26:6530:x1875336022265600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 164us (2102us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459953.867341:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1788459953.867438:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfa1e1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022265600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788459953.867453:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4ac2841200/0x5dfa74784542af01 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542af08 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459953.867462:0:6530:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4ac2841200/0x5dfa74784542af01 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542af08 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788459953.867805:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1788459953.868051:0:6530:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788459953.868194:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1788459953.868214:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 112 off8528 00000040:00080000:3.0:1788459953.868228:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 224 off8752 00000040:00080000:3.0:1788459953.868231:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1788459953.868556:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfa1e1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022265728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788459953.868597:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459953.869680:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac25b6000 going to sleep for 11 seconds 00000100:00100000:0.0:1788459953.870001:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022265728 00000100:00100000:0.0:1788459953.870009:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022265728 00000100:00100000:0.0:1788459953.870051:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1788459953.870059:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+26:6530:x1875336022265728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788459953.870508:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+26:6530:x1875336022265728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 449us (1909us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459953.870516:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1788459953.871140:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfa1e1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022265728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788459953.871189:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfa1e1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022265856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788459953.871246:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459953.871452:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022265856 00000100:00100000:0.0:1788459953.871458:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022265856 00000100:00100000:1.0:1788459953.871585:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1788459953.871596:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+26:6530:x1875336022265856:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788459953.871700:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+26:6530:x1875336022265856:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 106us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459953.871707:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1788459953.872591:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac25b6000 going to sleep for 11 seconds 00000100:00100000:3.0:1788459953.872616:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfa1e1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022265856:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788459953.873239:0:6530:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788459953.874119:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfa1e1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022265984:0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788459953.874189:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459953.874237:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac25b6000 going to sleep for 11 seconds 00000100:00100000:0.0:1788459953.876262:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022265984 00000100:00100000:0.0:1788459953.876275:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022265984 00000100:00100000:0.0:1788459953.876349:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1788459953.876367:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+26:6530:x1875336022265984:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:0.0:1788459953.876904:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+26:6530:x1875336022265984:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 545us (2712us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459953.876913:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1788459953.877130:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfa1e1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022265984:0@lo:502:ll_cfg_requeue.0 00000040:00080000:3.0:1788459953.877333:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1788459953.877438:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:3.0:1788459953.877467:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:3.0:1788459953.877488:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:3.0:1788459953.878141:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000100:00100000:3.0:1788459953.878220:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfa1e1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022266112:0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788459953.878324:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459953.879029:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022266112 00000100:00100000:2.0:1788459953.879037:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022266112 00000100:00100000:2.0:1788459953.879088:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1788459953.879097:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4c02042850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+26:6530:x1875336022266112:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788459953.879228:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac25b6000 going to sleep for 11 seconds 00000100:00100000:2.0:1788459953.882668:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4c02042850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+26:6530:x1875336022266112:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 3555us (4327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459953.882683:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1788459953.883051:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfa1e1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022266112:0@lo:502:ll_cfg_requeue.0 00000040:00080000:3.0:1788459953.883139:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:3.0:1788459953.883153:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 6 count 7 00000020:01000000:1.0:1788459953.890896:0:10423:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788459953.890910:0:10423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788459953.890912:0:10423:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788459953.890919:0:10423:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c4bfc4e5800 00000020:00000080:1.0:1788459953.890922:0:10423:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788459953.891009:0:10423:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788459953.891013:0:10423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788459953.891015:0:10423:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788459953.891018:0:10423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 7 00000020:01000000:3.0:1788459953.891178:0:6530:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788459953.891194:0:6530:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788459953.891204:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac2841200/0x5dfa74784542af01 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542af08 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459953.891231:0:6530:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4ac2841200/0x5dfa74784542af01 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542af08 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788459953.891249:0:6530:0:(mgc_request.c:715:do_requeue()) updating log params 10000000:01000000:3.0:1788459953.891252:0:6530:0:(mgc_request.c:2266:mgc_process_log()) Process log params-ffff8c4bef21b800 from 4 10000000:01000000:3.0:1788459953.891255:0:6530:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788459953.891291:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac2840400/0x5dfa74784542af0f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459953.891318:0:6530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4ac2840400/0x5dfa74784542af0f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459953.891330:0:6530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4ac2840400/0x5dfa74784542af0f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788459953.891354:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfa1e1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022266240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788459953.891429:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459953.891655:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac25b6000 going to sleep for 11 seconds 00000100:00100000:1.0:1788459953.892672:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022266240 00000100:00100000:1.0:1788459953.892682:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022266240 00000100:00100000:1.0:1788459953.892741:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1788459953.892750:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc844a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+26:6530:x1875336022266240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788459953.892765:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788459953.892781:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4ac395f400/0x5dfa74784542af16 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542af0f expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459953.892805:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4ac395f400/0x5dfa74784542af16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542af0f expref: 27 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459953.892816:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4ac395f400/0x5dfa74784542af16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542af0f expref: 27 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459953.892833:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ac395f400, rc 0) 00000100:00100000:1.0:1788459953.892905:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc844a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+27:6530:x1875336022266240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (1475us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459953.892912:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1788459953.892980:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfa1e1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022266240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788459953.892997:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4ac2840400/0x5dfa74784542af0f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542af16 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788459953.893008:0:6530:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4ac2840400/0x5dfa74784542af0f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542af16 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788459953.893159:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1788459953.893426:0:6530:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788459953.893591:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1788459953.893616:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:3.0:1788459953.893635:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:3.0:1788459953.893641:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1788459953.893716:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfa1e1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022266368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788459953.894001:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459953.894038:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac25b6000 going to sleep for 11 seconds 00000100:00100000:1.0:1788459953.894443:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022266368 00000100:00100000:1.0:1788459953.894451:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022266368 00000100:00100000:1.0:1788459953.894496:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1788459953.894504:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bca61bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+27:6530:x1875336022266368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788459953.894619:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bca61bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+27:6530:x1875336022266368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 115us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459953.894627:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1788459953.894762:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfa1e1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022266368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788459953.894798:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfa1e1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022266496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788459953.894849:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459953.894919:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac25b6000 going to sleep for 11 seconds 00000100:00100000:1.0:1788459953.895061:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022266496 00000100:00100000:1.0:1788459953.895082:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022266496 00000100:00100000:1.0:1788459953.895532:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1788459953.895542:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bca61a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+27:6530:x1875336022266496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788459953.895644:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bca61a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+27:6530:x1875336022266496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 104us (795us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459953.895652:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1788459953.895709:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfa1e1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022266496:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788459953.896498:0:6530:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788459953.896575:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfa1e1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022266624:0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788459953.896628:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459953.896665:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac25b6000 going to sleep for 11 seconds 00000100:00100000:0.0:1788459953.897655:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022266624 00000100:00100000:0.0:1788459953.897677:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022266624 00000100:00100000:0.0:1788459953.897732:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1788459953.897751:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+27:6530:x1875336022266624:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:0.0:1788459953.897888:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+27:6530:x1875336022266624:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 148us (1259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459953.897902:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1788459953.898017:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfa1e1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022266624:0@lo:502:ll_cfg_requeue.0 00000040:00080000:1.0:1788459953.898244:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:1.0:1788459953.898283:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:1.0:1788459953.898300:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:1.0:1788459953.898313:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:1.0:1788459953.898328:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000100:00100000:1.0:1788459953.898374:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3b6d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022266752:0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788459953.898423:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459953.898520:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bfa3920c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788459953.898561:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022266752 00000100:00100000:0.0:1788459953.898566:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022266752 00000100:00100000:0.0:1788459953.898641:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1788459953.898653:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+27:6530:x1875336022266752:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:0.0:1788459953.898742:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+27:6530:x1875336022266752:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 93us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459953.898749:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1788459953.898811:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3b6d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022266752:0@lo:502:ll_cfg_requeue.0 00000040:00080000:0.0:1788459953.898861:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:0.0:1788459953.898934:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 6 count 7 00000020:01000000:0.0:1788459953.899393:0:10425:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788459953.899401:0:10425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788459953.899403:0:10425:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788459953.899411:0:10425:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c4bef21b800 00000020:00000080:0.0:1788459953.899413:0:10425:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788459953.899912:0:10425:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788459953.899917:0:10425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788459953.899919:0:10425:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788459953.899923:0:10425:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 7 count 7 00000020:01000000:0.0:1788459953.899981:0:6530:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788459953.899990:0:6530:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788459953.900000:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac2840400/0x5dfa74784542af0f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542af16 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459953.900012:0:6530:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4ac2840400/0x5dfa74784542af0f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542af16 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788459953.900038:0:6530:0:(mgc_request.c:715:do_requeue()) updating log params 10000000:01000000:0.0:1788459953.900041:0:6530:0:(mgc_request.c:2266:mgc_process_log()) Process log params-ffff8c4bc438f000 from 4 10000000:01000000:0.0:1788459953.900043:0:6530:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788459953.900071:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bef209e00/0x5dfa74784542af1d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459953.900080:0:6530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4bef209e00/0x5dfa74784542af1d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459953.900089:0:6530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4bef209e00/0x5dfa74784542af1d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788459953.900109:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022266880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788459953.900153:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459953.900182:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac36aa000 going to sleep for 11 seconds 00000100:00100000:0.0:1788459953.900199:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022266880 00000100:00100000:0.0:1788459953.900204:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022266880 00000100:00100000:0.0:1788459953.900235:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1788459953.900244:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+27:6530:x1875336022266880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788459953.900255:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788459953.900266:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4bef208c00/0x5dfa74784542af24 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542af1d expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459953.900631:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bef208c00/0x5dfa74784542af24 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542af1d expref: 28 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459953.900644:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4bef208c00/0x5dfa74784542af24 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542af1d expref: 28 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459953.900667:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bef208c00, rc 0) 00000100:00100000:0.0:1788459953.900764:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+28:6530:x1875336022266880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 520us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459953.900771:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1788459953.902798:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022266880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788459953.902826:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4bef209e00/0x5dfa74784542af1d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542af24 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459953.902837:0:6530:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4bef209e00/0x5dfa74784542af1d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542af24 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788459953.903220:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788459953.903597:0:6530:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788459953.903775:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].1, 224 off8416 00000040:00080000:0.0:1788459953.903801:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].2, 112 off8528 00000040:00080000:0.0:1788459953.903821:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].3, 224 off8752 00000040:00080000:0.0:1788459953.903827:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 3 count 4 00000100:00100000:0.0:1788459953.903936:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022267008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788459953.904025:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459953.904054:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac36aa240 going to sleep for 11 seconds 00000100:00100000:1.0:1788459953.904180:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022267008 00000100:00100000:1.0:1788459953.904187:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022267008 00000100:00100000:1.0:1788459953.904231:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1788459953.904241:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+28:6530:x1875336022267008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788459953.904335:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+28:6530:x1875336022267008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 95us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459953.904343:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1788459953.904436:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022267008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788459953.904466:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022267136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788459953.904505:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459953.904556:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac36aa240 going to sleep for 11 seconds 00000100:00100000:1.0:1788459953.904596:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022267136 00000100:00100000:1.0:1788459953.904600:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022267136 00000100:00100000:0.0:1788459953.904718:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1788459953.904726:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+28:6530:x1875336022267136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788459953.904802:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+28:6530:x1875336022267136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459953.904809:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1788459953.904847:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022267136:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788459953.905189:0:6530:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788459953.905251:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022267264:0@lo:502:ll_cfg_requeue.0 00000100:00100000:0.0:1788459953.905287:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459953.905302:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac36aa240 going to sleep for 11 seconds 00000100:00100000:0.0:1788459953.905316:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022267264 00000100:00100000:0.0:1788459953.905320:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022267264 00000100:00100000:0.0:1788459953.905338:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1788459953.905344:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+28:6530:x1875336022267264:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:0.0:1788459953.905430:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+28:6530:x1875336022267264:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 85us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459953.905436:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1788459953.905472:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022267264:0@lo:502:ll_cfg_requeue.0 00000040:00080000:0.0:1788459953.905617:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].1, 224 off8416 00000040:00080000:0.0:1788459953.905641:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].2, 112 off8528 00000040:00080000:0.0:1788459953.905655:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].3, 224 off8752 00000040:00080000:0.0:1788459953.905669:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].4, 224 off8976 00000040:00080000:0.0:1788459953.905682:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].5, 112 off9088 00000100:00100000:0.0:1788459953.905702:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022267392:0@lo:502:ll_cfg_requeue.0 00000100:00100000:0.0:1788459953.905735:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459953.905749:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac36aa240 going to sleep for 11 seconds 00000100:00100000:0.0:1788459953.905768:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022267392 00000100:00100000:0.0:1788459953.905772:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022267392 00000100:00100000:0.0:1788459953.905791:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1788459953.905797:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+28:6530:x1875336022267392:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:0.0:1788459953.905861:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+28:6530:x1875336022267392:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 63us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459953.905867:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1788459953.905903:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022267392:0@lo:502:ll_cfg_requeue.0 00000040:00080000:0.0:1788459953.905940:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].6, 224 off9312 00000040:00080000:0.0:1788459953.905970:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 6 count 7 00000020:01000000:0.0:1788459953.906294:0:10426:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788459953.906303:0:10426:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788459953.906305:0:10426:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788459953.906312:0:10426:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c4bc438f000 00000020:00000080:0.0:1788459953.906314:0:10426:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788459953.906704:0:10426:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788459953.906709:0:10426:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788459953.906711:0:10426:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788459953.906716:0:10426:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x16:0x0] index 7 count 7 00000020:01000000:0.0:1788459953.906758:0:6530:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788459953.906767:0:6530:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788459953.906777:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bef209e00/0x5dfa74784542af1d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542af24 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459953.906788:0:6530:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4bef209e00/0x5dfa74784542af1d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542af24 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788459953.906799:0:6530:0:(mgc_request.c:715:do_requeue()) updating log params 10000000:01000000:0.0:1788459953.906801:0:6530:0:(mgc_request.c:2266:mgc_process_log()) Process log params-ffff8c4be2d81000 from 4 10000000:01000000:0.0:1788459953.906804:0:6530:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788459953.906829:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bef208200/0x5dfa74784542af2b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459953.906837:0:6530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4bef208200/0x5dfa74784542af2b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459953.906845:0:6530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4bef208200/0x5dfa74784542af2b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788459953.906861:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022267520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788459953.906903:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459953.906926:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac36aacc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788459953.906960:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022267520 00000100:00100000:0.0:1788459953.906965:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022267520 00000100:00100000:0.0:1788459953.906989:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1788459953.906996:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+28:6530:x1875336022267520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788459953.907005:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788459953.907018:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4bef208400/0x5dfa74784542af32 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542af2b expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459953.907038:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bef208400/0x5dfa74784542af32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542af2b expref: 29 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459953.907048:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4bef208400/0x5dfa74784542af32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542af2b expref: 29 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459953.907057:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bef208400, rc 0) 00000100:00100000:0.0:1788459953.907095:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+29:6530:x1875336022267520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459953.907102:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1788459953.907137:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022267520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788459953.907150:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4bef208200/0x5dfa74784542af2b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542af32 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459953.907158:0:6530:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4bef208200/0x5dfa74784542af2b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542af32 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788459953.907187:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022267648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788459953.907218:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459953.907232:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac36aacc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788459953.907243:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022267648 00000100:00100000:0.0:1788459953.907246:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022267648 00000100:00100000:0.0:1788459953.907263:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1788459953.907268:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+29:6530:x1875336022267648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788459953.907343:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+29:6530:x1875336022267648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 75us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459953.907350:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1788459953.907391:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022267648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788459953.907415:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022267776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788459953.907449:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459953.907463:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac36aacc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788459953.907473:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022267776 00000100:00100000:0.0:1788459953.907476:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022267776 00000100:00100000:0.0:1788459953.907493:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1788459953.907498:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+29:6530:x1875336022267776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788459953.907719:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+29:6530:x1875336022267776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 219us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459953.907725:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1788459953.907761:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022267776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788459953.908461:0:10427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0cf73fe6-82e2-434e-b670-631647721b2c:10427:1875336022267904:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788459953.908504:0:10427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459953.908528:0:10427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac36aa3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788459953.908571:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022267904 00000100:00100000:1.0:1788459953.908576:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022267904 00000100:00100000:1.0:1788459953.908643:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1788459953.908652:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+29:10427:x1875336022267904:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788459953.908744:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+29:10427:x1875336022267904:12345-0@lo:502:llog_process_th.0 Request processed in 92us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459953.908752:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1788459953.908797:0:10427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0cf73fe6-82e2-434e-b670-631647721b2c:10427:1875336022267904:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788459953.908817:0:10427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788459953.908834:0:10427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788459953.908837:0:10427:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788459953.908843:0:10427:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c4be2d81000 00000020:00000080:1.0:1788459953.908846:0:10427:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788459953.908990:0:10427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3b6f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0cf73fe6-82e2-434e-b670-631647721b2c:10427:1875336022268032:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788459953.909023:0:10427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459953.909037:0:10427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bfa392240 going to sleep for 11 seconds 00000100:00100000:0.0:1788459953.909388:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022268032 00000100:00100000:0.0:1788459953.909401:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022268032 00000100:00100000:0.0:1788459953.909434:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1788459953.909441:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+29:10427:x1875336022268032:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788459953.910137:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+29:10427:x1875336022268032:12345-0@lo:502:llog_process_th.0 Request processed in 694us (1112us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459953.910145:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1788459953.910213:0:10427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3b6f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0cf73fe6-82e2-434e-b670-631647721b2c:10427:1875336022268032:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788459953.910238:0:10427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788459953.910244:0:10427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788459953.910246:0:10427:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788459953.910249:0:10427:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788459953.910801:0:6530:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788459953.910809:0:6530:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788459953.910819:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bef208200/0x5dfa74784542af2b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542af32 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459953.910830:0:6530:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4bef208200/0x5dfa74784542af2b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542af32 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788459953.938897:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788459954.770584:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022268160:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788459954.770658:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459954.771087:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022268160 00000100:00100000:2.0:1788459954.771095:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022268160 00000100:00080000:3.0:1788459954.771155:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788459954.771171:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788459954.771182:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfa1e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022268160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788459954.771209:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788459954.771269:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfa1e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022268160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (610us total) trans 0 rc 0/0 00010000:00080000:3.0:1788459954.771406:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3af4a80 x1875336022268160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788459970 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788459954.771426:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022268160:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788459954.771577:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:2.0:1788459954.961071:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788459955.282399:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788459955.287099:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfa1e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022268416:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788459955.287174:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459955.287228:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3b6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022268288:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788459955.287254:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459955.287332:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022268416 00000100:00100000:3.0:1788459955.287340:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022268416 00000100:00100000:3.0:1788459955.287405:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788459955.287415:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3afbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022268416:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788459955.287447:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788459955.287492:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3afbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022268416:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459955.287499:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788459955.287575:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfa1e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022268416:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788459955.288156:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022268288 00000100:00100000:1.0:1788459955.288162:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022268288 00000100:00100000:1.0:1788459955.288434:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788459955.288442:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3af8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022268288:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788459955.288536:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788459955.288594:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3af8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022268288:12345-0@lo:13:osp-pre-0-1.0 Request processed in 152us (1339us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459955.288601:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1788459955.288677:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3b6f100 x1875336022268288/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788459971 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788459955.288695:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3b6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022268288:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788459955.290981:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788459955.405765:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788459955.405930:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003328384 00000100:00100000:1.0:1788459955.405941:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003328384 00000100:00100000:1.0:1788459955.406009:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 301 00000100:00100000:1.0:1788459955.406019:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bed032f6-c389-485e-b2f7-e2ea34763c65+9:6163:x1875336003328384:12345-192.168.206.5@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788459955.406035:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788459955.406051:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4ac3677600/0x5dfa74784542af39 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a511 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459955.406094:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4ac3677600/0x5dfa74784542af39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a511 expref: 10 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459955.406105:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4ac3677600/0x5dfa74784542af39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a511 expref: 10 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459955.406113:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ac3677600, rc 0) 00000100:00100000:1.0:1788459955.406167:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bed032f6-c389-485e-b2f7-e2ea34763c65+10:6163:x1875336003328384:12345-192.168.206.5@tcp:101:ll_cfg_requeue.0 Request processed in 149us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459955.406175:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 301 00000100:00100000:0.0:1788459955.413165:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788459955.413775:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003328512 00000100:00100000:3.0:1788459955.413803:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003328512 00000100:00100000:3.0:1788459955.413862:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 302 00000100:00100000:3.0:1788459955.413874:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bed032f6-c389-485e-b2f7-e2ea34763c65+10:6163:x1875336003328512:12345-192.168.206.5@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788459955.414030:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bed032f6-c389-485e-b2f7-e2ea34763c65+10:6163:x1875336003328512:12345-192.168.206.5@tcp:501:ll_cfg_requeue.0 Request processed in 158us (873us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459955.414039:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 302 00000100:00100000:1.0:1788459955.422233:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788459955.422412:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003328640 00000100:00100000:0.0:1788459955.422423:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003328640 00000100:00100000:0.0:1788459955.422489:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 303 00000100:00100000:0.0:1788459955.422499:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bed032f6-c389-485e-b2f7-e2ea34763c65+10:6163:x1875336003328640:12345-192.168.206.5@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788459955.422654:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bed032f6-c389-485e-b2f7-e2ea34763c65+10:6163:x1875336003328640:12345-192.168.206.5@tcp:503:ll_cfg_requeue.0 Request processed in 156us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459955.422663:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 303 00000100:00100000:0.0:1788459955.429467:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788459955.429526:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003328768 00000100:00100000:2.0:1788459955.429537:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003328768 00000100:00100000:2.0:1788459955.429601:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 304 00000100:00100000:2.0:1788459955.429612:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bed032f6-c389-485e-b2f7-e2ea34763c65+10:6698:x1875336003328768:12345-192.168.206.5@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788459955.429783:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bed032f6-c389-485e-b2f7-e2ea34763c65+10:6698:x1875336003328768:12345-192.168.206.5@tcp:502:llog_process_th.0 Request processed in 172us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459955.429791:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 304 00000100:00100000:0.0:1788459955.448491:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788459955.448741:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003328896 00000100:00100000:3.0:1788459955.448751:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003328896 00000100:00100000:3.0:1788459955.448807:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 305 00000100:00100000:3.0:1788459955.448816:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf363f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bed032f6-c389-485e-b2f7-e2ea34763c65+10:6698:x1875336003328896:12345-192.168.206.5@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788459955.448972:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf363f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bed032f6-c389-485e-b2f7-e2ea34763c65+10:6698:x1875336003328896:12345-192.168.206.5@tcp:502:llog_process_th.0 Request processed in 156us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459955.448980:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 305 00010000:00010000:3.0:1788459955.987193:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788459956.305598:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022268544:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788459956.305683:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459956.305881:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022268544 00000100:00100000:2.0:1788459956.305890:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022268544 00000100:00100000:2.0:1788459956.305963:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788459956.305972:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3afb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022268544:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788459956.306002:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446453248 avail 1300213760 00000100:00100000:2.0:1788459956.306055:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3afb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022268544:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459956.306063:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788459956.306130:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022268544:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788459956.820829:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788459956.820850:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022268672:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788459956.820912:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459956.821264:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3b6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022268800:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788459956.821294:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459956.821386:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022268672 00000100:00100000:1.0:1788459956.821394:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022268672 00000100:00100000:1.0:1788459956.821445:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022268800 00000100:00100000:1.0:1788459956.821448:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022268800 00000100:00100000:1.0:1788459956.821465:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788459956.821474:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3af8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022268672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788459956.821500:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788459956.821547:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3af8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022268672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459956.821554:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788459956.821571:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788459956.821578:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3afaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022268800:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788459956.821588:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788459956.821614:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3afaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022268800:12345-0@lo:13:osp-pre-1-1.0 Request processed in 37us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459956.821636:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:0.0:1788459956.821696:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788459956.821726:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3b6c380 x1875336022268800/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788459972 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788459956.821743:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3b6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022268800:0@lo:13:osp-pre-1-1.0 00010000:00080000:0.0:1788459956.821781:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3af9f80 x1875336022268672/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788459972 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788459956.821792:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022268672:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788459956.825515:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022269184:0@lo:400:kworker.0 00000100:00100000:0.0:1788459956.825583:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459956.825611:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3afa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022269696:0@lo:400:kworker.0 00000100:00100000:0.0:1788459956.825631:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459956.825670:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788459956.825676:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3660:1875336022269056:0@lo:400:kworker.0 00000100:00100000:0.0:1788459956.825698:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459956.825711:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3660:1875336022269568:0@lo:400:kworker.0 00000100:00100000:0.0:1788459956.825727:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459956.825737:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3afad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3660:1875336022270080:0@lo:400:kworker.0 00000100:00100000:0.0:1788459956.825777:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459956.825807:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022269184 00000100:00100000:0.0:1788459956.825814:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022269184 00000100:00100000:0.0:1788459956.825859:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788459956.825867:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3af9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022269184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788459956.825917:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3af9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022269184:12345-0@lo:400:kworker.0 Request processed in 51us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459956.825925:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788459956.825974:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875336022269312:0@lo:400:kworker.0 00000100:00100000:0.0:1788459956.825999:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459956.826015:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3afa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022269824:0@lo:400:kworker.0 00000100:00100000:0.0:1788459956.826035:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459956.826056:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788459956.827517:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0cf73fe6-82e2-434e-b670-631647721b2c:3661:1875336022268928:0@lo:400:kworker.0 00000100:00100000:0.0:1788459956.827579:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459956.827620:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3661:1875336022269440:0@lo:400:kworker.0 00000100:00100000:0.0:1788459956.827644:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459956.827658:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3afb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3661:1875336022269952:0@lo:400:kworker.0 00000100:00100000:0.0:1788459956.827679:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459956.827721:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022268928 00000100:00100000:0.0:1788459956.827727:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022268928 00000100:00100000:0.0:1788459956.827777:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1788459956.827786:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf363d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+29:3661:x1875336022268928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788459956.827829:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf363d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+29:3661:x1875336022268928:12345-0@lo:400:kworker.0 Request processed in 43us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459956.827836:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1788459956.827881:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022269184:0@lo:400:kworker.0 00000100:00100000:0.0:1788459956.827912:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0cf73fe6-82e2-434e-b670-631647721b2c:3661:1875336022268928:0@lo:400:kworker.0 00000100:00100000:1.0:1788459956.828044:0:8832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022269696 00000100:00100000:1.0:1788459956.828049:0:8832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022269696 00000100:00100000:1.0:1788459956.828089:0:8832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022269824 00000100:00100000:1.0:1788459956.828092:0:8832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022269824 00000100:00100000:1.0:1788459956.828120:0:8832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788459956.828127:0:8832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac2976d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022269696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788459956.828168:0:8832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac2976d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022269696:12345-0@lo:400:kworker.0 Request processed in 41us (2536us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459956.828174:0:8832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788459956.828186:0:8832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788459956.828192:0:8832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfae8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3661:x1875336022269824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788459956.828221:0:8832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfae8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3661:x1875336022269824:12345-0@lo:400:kworker.0 Request processed in 30us (2185us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459956.828226:0:8832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788459956.828244:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022269056 00000100:00100000:1.0:1788459956.828247:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022269056 00000100:00100000:1.0:1788459956.828265:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022269568 00000100:00100000:1.0:1788459956.828268:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022269568 00000100:00100000:1.0:1788459956.828279:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022270080 00000100:00100000:1.0:1788459956.828281:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022270080 00000100:00100000:1.0:1788459956.828291:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022269312 00000100:00100000:1.0:1788459956.828293:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022269312 00000100:00100000:1.0:1788459956.828300:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022269440 00000100:00100000:1.0:1788459956.828302:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022269440 00000100:00100000:1.0:1788459956.828312:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022269952 00000100:00100000:1.0:1788459956.828313:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022269952 00000100:00100000:1.0:1788459956.828325:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788459956.828331:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac2976680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1875336022269056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788459956.828382:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac2976680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1875336022269056:12345-0@lo:400:kworker.0 Request processed in 51us (2683us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459956.828388:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788459956.828400:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788459956.828407:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfaea8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1875336022269568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788459956.828433:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfaea8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1875336022269568:12345-0@lo:400:kworker.0 Request processed in 27us (2705us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459956.828439:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788459956.828450:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788459956.828456:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfae8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1875336022270080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788459956.828481:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfae8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1875336022270080:12345-0@lo:400:kworker.0 Request processed in 26us (2718us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459956.828487:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788459956.828498:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788459956.828504:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfae8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1875336022269312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788459956.828530:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfae8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1875336022269312:12345-0@lo:400:kworker.0 Request processed in 27us (2531us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459956.828535:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788459956.828545:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788459956.828550:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfae8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1875336022269440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788459956.828571:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfae8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1875336022269440:12345-0@lo:400:kworker.0 Request processed in 21us (926us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459956.828575:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788459956.828584:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788459956.828588:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfae8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1875336022269952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788459956.828621:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfae8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1875336022269952:12345-0@lo:400:kworker.0 Request processed in 32us (941us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459956.828626:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:1.0:1788459956.828646:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788459956.828650:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788459956.828652:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788459956.828969:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3660:1875336022269056:0@lo:400:kworker.0 00010000:00080000:0.0:1788459956.828985:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3af9880 x1875336022269568/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788459972 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788459956.828996:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3660:1875336022269568:0@lo:400:kworker.0 00010000:00080000:0.0:1788459956.829005:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3afad80 x1875336022270080/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788459972 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788459956.829014:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3afad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3660:1875336022270080:0@lo:400:kworker.0 00010000:00080000:0.0:1788459956.829024:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3afa680 x1875336022269696/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788459972 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788459956.829033:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3afa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022269696:0@lo:400:kworker.0 00000100:00100000:0.0:1788459956.829120:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3661:1875336022269440:0@lo:400:kworker.0 00000100:00100000:0.0:1788459956.829130:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3afb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3661:1875336022269952:0@lo:400:kworker.0 00000100:00100000:0.0:1788459956.829140:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875336022269312:0@lo:400:kworker.0 00010000:00080000:0.0:1788459956.829162:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3afa300 x1875336022269824/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788459972 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788459956.829171:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3afa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022269824:0@lo:400:kworker.0 00010000:00010000:3.0:1788459957.012940:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788459958.033440:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788459958.719488:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788459958.719538:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788459958.719573:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788459958.719593:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003329280 00000100:00100000:1.0:1788459958.719603:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003329280 00000100:00100000:3.0:1788459958.719605:0:8832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003329536 00000100:00100000:3.0:1788459958.719612:0:8832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003329536 00000100:00100000:0.0:1788459958.719661:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003329024 00000100:00100000:0.0:1788459958.719665:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003329024 00000100:00100000:0.0:1788459958.719707:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 307 00000100:00100000:0.0:1788459958.719717:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf363cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bed032f6-c389-485e-b2f7-e2ea34763c65+10:2393:x1875336003329024:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:0.0:1788459958.719792:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf363cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bed032f6-c389-485e-b2f7-e2ea34763c65+10:2393:x1875336003329024:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 76us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459958.719800:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 307 00000100:00100000:3.0:1788459958.720227:0:8832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 22 00000100:00100000:3.0:1788459958.720237:0:8832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfa1e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2393:x1875336003329536:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:3.0:1788459958.720361:0:8832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfa1e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2393:x1875336003329536:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 125us (787us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459958.720369:0:8832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 22 00000100:00100000:1.0:1788459958.720695:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 67 00000100:00100000:1.0:1788459958.720705:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfa1e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2393:x1875336003329280:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:1.0:1788459958.721454:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfa1e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2393:x1875336003329280:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 738us (1912us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459958.721465:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 67 00000100:00080000:1.0:1788459958.721490:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788459958.721495:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788459958.730920:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788459958.731087:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003329152 00000100:00100000:3.0:1788459958.731096:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003329152 00000100:00100000:3.0:1788459958.731162:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 68 00000100:00100000:3.0:1788459958.731172:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfa1e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:2393:x1875336003329152:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:3.0:1788459958.731234:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfa1e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:2393:x1875336003329152:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 63us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459958.731247:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 68 00000100:00080000:0.0:1788459958.731344:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788459958.731405:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788459958.731503:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003329408 00000100:00100000:0.0:1788459958.731508:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003329408 00000100:00100000:0.0:1788459958.731550:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 23 00000100:00100000:0.0:1788459958.731559:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfa1e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2393:x1875336003329408:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:0.0:1788459958.731591:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfa1e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2393:x1875336003329408:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 34us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459958.731597:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 23 00000100:00080000:0.0:1788459958.731614:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788459959.057050:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788459959.829980:0:10709:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg605-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:0.0:1788459959.890838:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788459959.890860:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022270208:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788459959.890924:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459959.891027:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022270208 00000100:00100000:2.0:1788459959.891036:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022270208 00000100:00100000:2.0:1788459959.891082:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788459959.891102:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfae8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022270208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788459959.891128:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788459959.891189:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfae8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022270208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459959.891197:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:1.0:1788459959.891234:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3af7b80 x1875336022270208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788459975 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788459959.891252:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022270208:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788459959.891986:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788459960.092667:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788459960.401637:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788459960.401659:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfa1e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022270336:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788459960.401738:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459960.402663:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788459960.402677:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3b6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022270464:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788459960.402748:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459960.403366:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022270336 00000100:00100000:3.0:1788459960.403376:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022270336 00000100:00100000:3.0:1788459960.403430:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788459960.403439:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3af6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022270336:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788459960.403489:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788459960.403551:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3af6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022270336:12345-0@lo:41:osp-pre-0-1.0 Request processed in 112us (1812us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459960.403559:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788459960.403799:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022270464 00000100:00100000:1.0:1788459960.403804:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022270464 00000100:00100000:2.0:1788459960.403839:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfa1e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022270336:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788459960.403854:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788459960.403861:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfae8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022270464:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788459960.403876:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788459960.403914:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfae8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022270464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 54us (1166us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459960.403932:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1788459960.404503:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788459960.404534:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3b6fb80 x1875336022270464/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788459976 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788459960.404550:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3b6fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022270464:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788459961.105733:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788459961.432288:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788459961.432311:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022270592:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788459961.432391:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459961.432528:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022270592 00000100:00100000:2.0:1788459961.432536:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022270592 00000100:00100000:2.0:1788459961.432603:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788459961.432612:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfa1e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022270592:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788459961.432644:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446453248 avail 1300213760 00000100:00100000:2.0:1788459961.432688:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfa1e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022270592:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459961.432695:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788459961.432785:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022270592:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788459961.938803:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022270976:0@lo:400:kworker.0 00000100:00100000:2.0:1788459961.938861:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459961.938901:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3662:1875336022271488:0@lo:400:kworker.0 00000100:00100000:2.0:1788459961.938924:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459961.938959:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1875336022272000:0@lo:400:kworker.0 00000100:00100000:2.0:1788459961.938981:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459961.939009:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788459961.939015:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3662:1875336022270848:0@lo:400:kworker.0 00000100:00100000:2.0:1788459961.939034:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459961.939050:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3662:1875336022271360:0@lo:400:kworker.0 00000100:00100000:2.0:1788459961.939081:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459961.939103:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3662:1875336022271872:0@lo:400:kworker.0 00000100:00100000:2.0:1788459961.939123:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459961.939147:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022270976 00000100:00100000:2.0:1788459961.939153:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022270976 00000100:00100000:2.0:1788459961.939196:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788459961.939205:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3673800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022270976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788459961.939269:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3673800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022270976:12345-0@lo:400:kworker.0 Request processed in 65us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459961.939285:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788459961.939308:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022271488 00000100:00100000:2.0:1788459961.939311:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022271488 00000100:00100000:2.0:1788459961.939346:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022272000 00000100:00100000:2.0:1788459961.939349:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022272000 00000100:00100000:2.0:1788459961.939361:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022270848 00000100:00100000:2.0:1788459961.939364:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022270848 00000100:00100000:2.0:1788459961.939375:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022271360 00000100:00100000:2.0:1788459961.939377:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022271360 00000100:00100000:2.0:1788459961.939388:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022271872 00000100:00100000:2.0:1788459961.939391:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022271872 00000100:00100000:2.0:1788459961.939404:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788459961.939409:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3673480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875336022271488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788459961.939439:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3673480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875336022271488:12345-0@lo:400:kworker.0 Request processed in 30us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459961.939444:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788459961.939455:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788459961.939460:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3673100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875336022272000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788459961.939498:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3673100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875336022272000:12345-0@lo:400:kworker.0 Request processed in 38us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459961.939504:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788459961.939526:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788459961.939532:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3671880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1875336022270848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788459961.939557:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3671880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1875336022270848:12345-0@lo:400:kworker.0 Request processed in 26us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459961.939563:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788459961.939573:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788459961.939585:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1875336022271360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788459961.939613:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3b5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1875336022271360:12345-0@lo:400:kworker.0 Request processed in 29us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459961.939619:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788459961.939630:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788459961.939636:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3b59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1875336022271872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788459961.939661:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3b59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1875336022271872:12345-0@lo:400:kworker.0 Request processed in 26us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459961.939667:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788459961.939694:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1875336022271104:0@lo:400:kworker.0 00000100:00100000:2.0:1788459961.939715:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459961.939729:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022271616:0@lo:400:kworker.0 00000100:00100000:2.0:1788459961.939746:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459961.939759:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022272128:0@lo:400:kworker.0 00000100:00100000:2.0:1788459961.939774:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459961.939790:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1788459961.939795:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0cf73fe6-82e2-434e-b670-631647721b2c:3659:1875336022270720:0@lo:400:kworker.0 00000100:00100000:2.0:1788459961.939815:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459961.939833:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022271232:0@lo:400:kworker.0 00000100:00100000:2.0:1788459961.939847:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459961.939858:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022271744:0@lo:400:kworker.0 00000100:00100000:2.0:1788459961.939872:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459961.939884:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022272256:0@lo:400:kworker.0 00000100:00100000:2.0:1788459961.939901:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459961.939929:0:8832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022271616 00000100:00100000:2.0:1788459961.939933:0:8832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022271616 00000100:00100000:2.0:1788459961.939972:0:8832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022272128 00000100:00100000:2.0:1788459961.939975:0:8832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022272128 00000100:00100000:2.0:1788459961.939988:0:8832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022271744 00000100:00100000:2.0:1788459961.939990:0:8832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022271744 00000100:00100000:2.0:1788459961.940000:0:8832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022272256 00000100:00100000:2.0:1788459961.940002:0:8832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022272256 00000100:00100000:2.0:1788459961.940014:0:8832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788459961.940020:0:8832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3b58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022271616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788459961.940063:0:8832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3b58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022271616:12345-0@lo:400:kworker.0 Request processed in 43us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459961.940069:0:8832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788459961.940081:0:8832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788459961.940087:0:8832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3b59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022272128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788459961.940107:0:8832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3b59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022272128:12345-0@lo:400:kworker.0 Request processed in 21us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459961.940112:0:8832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788459961.940121:0:8832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788459961.940126:0:8832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3b58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022271744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788459961.940150:0:8832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3b58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022271744:12345-0@lo:400:kworker.0 Request processed in 23us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459961.940155:0:8832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788459961.940165:0:8832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788459961.940170:0:8832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3b5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022272256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788459961.940189:0:8832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3b5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022272256:12345-0@lo:400:kworker.0 Request processed in 19us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459961.940194:0:8832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788459961.940215:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022270720 00000100:00100000:2.0:1788459961.940218:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022270720 00000100:00100000:2.0:1788459961.940237:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1788459961.940242:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf363dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+29:3659:x1875336022270720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788459961.940265:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf363dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+29:3659:x1875336022270720:12345-0@lo:400:kworker.0 Request processed in 23us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459961.940271:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1788459961.940294:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022271232 00000100:00100000:2.0:1788459961.940297:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022271232 00000100:00100000:2.0:1788459961.940312:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788459961.940330:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3b5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022271232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788459961.940354:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3b5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022271232:12345-0@lo:400:kworker.0 Request processed in 37us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459961.940360:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788459961.940386:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0cf73fe6-82e2-434e-b670-631647721b2c:3659:1875336022270720:0@lo:400:kworker.0 00000100:00100000:2.0:1788459961.940396:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022271232:0@lo:400:kworker.0 00010000:00080000:2.0:1788459961.940406:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3af4700 x1875336022271744/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788459977 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788459961.940416:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022271744:0@lo:400:kworker.0 00010000:00080000:2.0:1788459961.940424:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3af4e00 x1875336022272256/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788459977 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788459961.940432:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022272256:0@lo:400:kworker.0 00010000:00080000:2.0:1788459961.940440:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3af7800 x1875336022271616/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788459977 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788459961.940458:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022271616:0@lo:400:kworker.0 00010000:00080000:2.0:1788459961.940468:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3af4000 x1875336022272128/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788459977 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788459961.940475:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022272128:0@lo:400:kworker.0 00000100:00100000:2.0:1788459961.940505:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3662:1875336022270848:0@lo:400:kworker.0 00000100:00100000:2.0:1788459961.940514:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3662:1875336022271360:0@lo:400:kworker.0 00000100:00100000:2.0:1788459961.940523:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3662:1875336022271872:0@lo:400:kworker.0 00000100:00100000:2.0:1788459961.940530:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022270976:0@lo:400:kworker.0 00010000:00080000:2.0:1788459961.940538:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3af5500 x1875336022271488/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788459977 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788459961.940546:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3662:1875336022271488:0@lo:400:kworker.0 00010000:00080000:2.0:1788459961.940556:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3af5180 x1875336022272000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788459977 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788459961.940563:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1875336022272000:0@lo:400:kworker.0 00000100:00100000:2.0:1788459961.940584:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022271104 00000100:00100000:2.0:1788459961.940587:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022271104 00000100:00100000:2.0:1788459961.940605:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788459961.940610:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3b59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1875336022271104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788459961.940636:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3b59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1875336022271104:12345-0@lo:400:kworker.0 Request processed in 26us (920us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459961.940641:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788459961.940669:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1875336022271104:0@lo:400:kworker.0 00000100:00100000:0.0:1788459961.942655:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfa1e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022272384:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788459961.942728:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788459961.942777:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788459961.942782:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788459961.942785:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788459961.942787:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788459961.942813:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022272384 00000100:00100000:0.0:1788459961.942820:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022272384 00000100:00100000:0.0:1788459961.942861:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788459961.942869:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfae8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022272384:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788459961.942896:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788459961.942935:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfae8ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022272384:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459961.942960:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:0.0:1788459961.942997:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bfa1e1f80 x1875336022272384/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788459977 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788459961.943015:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfa1e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022272384:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788459961.946974:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3b6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022272512:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788459961.947040:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459961.947111:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022272512 00000100:00100000:0.0:1788459961.947119:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022272512 00000100:00100000:0.0:1788459961.947162:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788459961.947171:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfa1e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875336022272512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788459961.947198:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788459961.954678:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfa1e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875336022272512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 7499us (7629us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459961.954693:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1788459961.955437:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3b6c000 x1875336022272512/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788459977 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788459961.955630:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3b6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022272512:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788459962.129264:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788459963.154648:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788459963.840665:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788459963.840702:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788459963.840728:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788459963.840745:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788459963.840765:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788459963.840790:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003329664 00000100:00100000:0.0:1788459963.840799:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003329664 00000100:00100000:0.0:1788459963.840845:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 309 00000100:00100000:0.0:1788459963.840854:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf363f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bed032f6-c389-485e-b2f7-e2ea34763c65+10:2394:x1875336003329664:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:0.0:1788459963.840917:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf363f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bed032f6-c389-485e-b2f7-e2ea34763c65+10:2394:x1875336003329664:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 64us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459963.840924:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 309 00000100:00100000:0.0:1788459963.840976:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003329920 00000100:00100000:0.0:1788459963.840980:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003329920 00000100:00100000:0.0:1788459963.841011:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003329792 00000100:00100000:0.0:1788459963.841013:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003329792 00000100:00100000:0.0:1788459963.841045:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 75 00000100:00100000:0.0:1788459963.841053:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfae8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2394:x1875336003329920:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:0.0:1788459963.841080:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfae8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2394:x1875336003329920:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 29us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459963.841087:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 75 00000100:00100000:0.0:1788459963.841106:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 76 00000100:00100000:0.0:1788459963.841111:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfae8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:2394:x1875336003329792:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:0.0:1788459963.841133:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfae8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:2394:x1875336003329792:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 22us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459963.841139:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 76 00000100:00100000:0.0:1788459963.841153:0:8832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003330176 00000100:00100000:0.0:1788459963.841156:0:8832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003330176 00000100:00100000:0.0:1788459963.841175:0:8832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003330048 00000100:00100000:0.0:1788459963.841177:0:8832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003330048 00000100:00100000:0.0:1788459963.841191:0:8832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 28 00000100:00100000:0.0:1788459963.841196:0:8832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfae8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2394:x1875336003330176:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:0.0:1788459963.841220:0:8832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfae8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2394:x1875336003330176:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 23us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459963.841226:0:8832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 28 00000100:00100000:0.0:1788459963.841237:0:8832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 29 00000100:00100000:0.0:1788459963.841242:0:8832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfae8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2394:x1875336003330048:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:0.0:1788459963.841264:0:8832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfae8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2394:x1875336003330048:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 21us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459963.841269:0:8832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 29 00000100:00080000:0.0:1788459963.841400:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788459963.841405:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788459963.841407:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788459963.841409:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1788459964.177394:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788459964.913624:0:10953:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg605-server.virtnet: executing yml_node 00000100:00100000:2.0:1788459965.011988:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3b58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022272640:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788459965.012056:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459965.012124:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022272640 00000100:00100000:2.0:1788459965.012131:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022272640 00000100:00100000:2.0:1788459965.012182:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788459965.012190:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3b59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022272640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788459965.012694:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788459965.012750:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3b59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022272640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 560us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459965.012758:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1788459965.012781:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788459965.013420:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3b58000 x1875336022272640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788459981 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788459965.013441:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3b58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022272640:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788459965.204515:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788459965.521540:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788459965.521559:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3b6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022272768:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788459965.521629:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459965.521690:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022272768 00000100:00100000:1.0:1788459965.521698:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022272768 00000100:00100000:1.0:1788459965.521739:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788459965.521748:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3b6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022272768:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788459965.521781:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788459965.521822:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3b6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022272768:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459965.521829:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788459965.521870:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3b6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022272768:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788459965.522244:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788459965.522254:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3b6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022272896:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788459965.522282:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459965.522329:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022272896 00000100:00100000:1.0:1788459965.522334:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022272896 00000100:00100000:1.0:1788459965.522372:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788459965.522379:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3b6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022272896:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788459965.522394:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788459965.522428:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3b6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022272896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 49us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459965.522442:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1788459965.522459:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788459965.522481:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3b6c000 x1875336022272896/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788459981 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788459965.522495:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3b6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022272896:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788459966.226972:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788459966.545491:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3b58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022273024:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788459966.545558:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459966.546650:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022273024 00000100:00100000:2.0:1788459966.546659:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022273024 00000100:00100000:2.0:1788459966.546712:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788459966.546722:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf2fe8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1875336022273024:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788459966.546755:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446453248 avail 1300213760 00000100:00100000:2.0:1788459966.550369:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf2fe8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1875336022273024:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3640us (4803us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459966.550383:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788459966.554030:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3b58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022273024:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788459967.057454:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788459967.057475:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3b6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022273152:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788459967.057531:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459967.057621:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf2feaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022273280:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788459967.057647:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459967.058002:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac383b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3662:1875336022273536:0@lo:400:kworker.0 00000100:00100000:3.0:1788459967.058015:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac383aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3660:1875336022273792:0@lo:400:kworker.0 00000100:00100000:0.0:1788459967.058039:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459967.058074:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022273536 00000100:00100000:3.0:1788459967.058081:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022273536 00000100:00100000:3.0:1788459967.058126:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788459967.058136:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfae8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1875336022273536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788459967.058137:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022273152 00000100:00100000:1.0:1788459967.058145:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022273152 00000100:00100000:1.0:1788459967.058213:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022273280 00000100:00100000:1.0:1788459967.058216:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022273280 00000100:00100000:1.0:1788459967.058234:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788459967.058240:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfae8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022273152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788459967.058261:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788459967.058313:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3839880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022273664:0@lo:400:kworker.0 00000100:00100000:3.0:1788459967.060607:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfae8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1875336022273536:12345-0@lo:400:kworker.0 Request processed in 2466us (2562us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459967.060617:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac383b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3662:1875336022273536:0@lo:400:kworker.0 00000100:00100000:3.0:1788459967.060623:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788459967.060641:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3839f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3662:1875336022274048:0@lo:400:kworker.0 00000100:00100000:3.0:1788459967.060676:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459967.060711:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf7711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022274304:0@lo:400:kworker.0 00000100:00080000:0.0:1788459967.060713:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788459967.060733:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022273792 00000100:00100000:0.0:1788459967.060739:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022273792 00000100:00100000:3.0:1788459967.060746:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459967.060807:0:8832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022274304 00000100:00100000:3.0:1788459967.060812:0:8832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022274304 00000100:00100000:3.0:1788459967.060847:0:8832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788459967.060854:0:8832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc43f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022274304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788459967.060906:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788459967.060915:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc471a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1875336022273792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788459967.061110:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459967.061145:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3838380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1875336022274176:0@lo:400:kworker.0 00000100:00100000:2.0:1788459967.061168:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459967.073658:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc471a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1875336022274688:0@lo:400:kworker.0 00000100:00100000:2.0:1788459967.073720:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459967.073891:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf2fe9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0cf73fe6-82e2-434e-b670-631647721b2c:3661:1875336022273408:0@lo:400:kworker.0 00000100:00100000:2.0:1788459967.073926:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459967.073968:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3838e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022273920:0@lo:400:kworker.0 00000100:00100000:2.0:1788459967.073996:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459967.074014:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf7710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022274432:0@lo:400:kworker.0 00000100:00100000:2.0:1788459967.074036:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459967.074084:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022273664 00000100:00100000:2.0:1788459967.074091:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022273664 00000100:00100000:2.0:1788459967.074138:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022273920 00000100:00100000:2.0:1788459967.074141:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022273920 00000100:00100000:2.0:1788459967.074158:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788459967.074166:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3b5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022273664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788459967.074219:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3b5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022273664:12345-0@lo:400:kworker.0 Request processed in 53us (13108us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459967.074226:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788459967.074242:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788459967.074249:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1875336022273920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788459967.074281:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1875336022273920:12345-0@lo:400:kworker.0 Request processed in 33us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459967.074424:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788459967.074465:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3838e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022273920:0@lo:400:kworker.0 00000100:00100000:2.0:1788459967.074514:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3839880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022273664:0@lo:400:kworker.0 00000100:00100000:2.0:1788459967.074551:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022274432 00000100:00100000:2.0:1788459967.074555:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022274432 00000100:00100000:2.0:1788459967.074586:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788459967.074593:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3b58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1875336022274432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788459967.074645:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3b58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1875336022274432:12345-0@lo:400:kworker.0 Request processed in 52us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459967.074652:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:2.0:1788459967.074668:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788459967.074688:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bf7710380 x1875336022274432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788459983 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788459967.074699:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf7710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022274432:0@lo:400:kworker.0 00000100:00100000:2.0:1788459967.074727:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac383aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3660:1875336022273792:0@lo:400:kworker.0 00010000:00080000:2.0:1788459967.074739:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bf7711880 x1875336022274304/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788459983 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788459967.074749:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf7711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022274304:0@lo:400:kworker.0 00010000:00080000:2.0:1788459967.074762:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3b6c000 x1875336022273152/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788459983 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788459967.074900:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3b6c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022273152:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788459967.074936:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022274176 00000100:00100000:2.0:1788459967.074940:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022274176 00000100:00100000:2.0:1788459967.074992:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022274688 00000100:00100000:2.0:1788459967.074995:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022274688 00000100:00100000:2.0:1788459967.075010:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788459967.075025:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3b59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1875336022274176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788459967.075063:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3b59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1875336022274176:12345-0@lo:400:kworker.0 Request processed in 40us (13893us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459967.075069:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788459967.075082:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788459967.075089:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3b58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1875336022274688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788459967.075192:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3b58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1875336022274688:12345-0@lo:400:kworker.0 Request processed in 103us (1471us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459967.075198:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:2.0:1788459967.075214:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1788459967.075234:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3838380 x1875336022274176/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788459983 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788459967.075245:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3838380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1875336022274176:0@lo:400:kworker.0 00010000:00080000:2.0:1788459967.075254:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bc471a680 x1875336022274688/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788459983 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788459967.075262:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc471a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1875336022274688:0@lo:400:kworker.0 00000100:00100000:2.0:1788459967.075390:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022273408 00000100:00100000:2.0:1788459967.075395:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022273408 00000100:00100000:2.0:1788459967.075421:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1788459967.075427:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf363d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+29:3661:x1875336022273408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788459967.075465:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf363d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+29:3661:x1875336022273408:12345-0@lo:400:kworker.0 Request processed in 37us (1537us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459967.075471:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1788459967.075507:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf2fe9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0cf73fe6-82e2-434e-b670-631647721b2c:3661:1875336022273408:0@lo:400:kworker.0 00000100:00100000:2.0:1788459967.075538:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459967.075564:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf7711f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3662:1875336022274560:0@lo:400:kworker.0 00000100:00100000:2.0:1788459967.075589:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459967.075618:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022274048 00000100:00100000:2.0:1788459967.076898:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022274048 00000100:00100000:3.0:1788459967.076905:0:8832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc43f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022274304:12345-0@lo:400:kworker.0 Request processed in 16047us (16155us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459967.076917:0:8832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788459967.076961:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022274560 00000100:00100000:2.0:1788459967.076965:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022274560 00000100:00100000:2.0:1788459967.076982:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788459967.076987:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc471a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1875336022273792:12345-0@lo:400:kworker.0 Request processed in 16074us (16312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459967.076988:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3b5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1875336022274048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788459967.076995:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788459967.077010:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788459967.077016:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3b5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1875336022274560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788459967.077039:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3b5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1875336022274048:12345-0@lo:400:kworker.0 Request processed in 50us (1500us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459967.077040:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3b5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1875336022274560:12345-0@lo:400:kworker.0 Request processed in 26us (1451us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459967.077045:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:2.0:1788459967.077063:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788459967.077093:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3839f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3662:1875336022274048:0@lo:400:kworker.0 00000100:00100000:1.0:1788459967.077102:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfae8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022273152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 18861us (19569us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459967.077103:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf7711f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3662:1875336022274560:0@lo:400:kworker.0 00000100:00100000:1.0:1788459967.077111:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788459967.077140:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788459967.077148:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfae8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022273280:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788459967.077164:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788459967.077218:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfae8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022273280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (19569us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459967.077225:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:2.0:1788459967.077332:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bf2feaa00 x1875336022273280/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788459983 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788459967.077347:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf2feaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022273280:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788459967.081539:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00010000:3.0:1788459967.249206:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788459968.273588:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788459968.964705:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788459968.964801:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003330432 00000100:00100000:2.0:1788459968.964811:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003330432 00000100:00100000:2.0:1788459968.964886:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 83 00000100:00100000:2.0:1788459968.964898:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfae8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:2394:x1875336003330432:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:2.0:1788459968.965012:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfae8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:2394:x1875336003330432:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 116us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459968.965020:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 83 00000100:00080000:0.0:1788459968.965096:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788459968.966024:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788459968.966075:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788459968.966153:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003330304 00000100:00100000:2.0:1788459968.966161:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003330304 00000100:00100000:2.0:1788459968.966219:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 311 00000100:00100000:2.0:1788459968.966227:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf363f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bed032f6-c389-485e-b2f7-e2ea34763c65+10:2394:x1875336003330304:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:2.0:1788459968.966295:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf363f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bed032f6-c389-485e-b2f7-e2ea34763c65+10:2394:x1875336003330304:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 68us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459968.966311:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 311 00000100:00100000:3.0:1788459968.966502:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003330560 00000100:00100000:3.0:1788459968.966506:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003330560 00000100:00100000:3.0:1788459968.966551:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 84 00000100:00100000:3.0:1788459968.966559:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfae8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2394:x1875336003330560:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:3.0:1788459968.966598:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfae8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2394:x1875336003330560:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 39us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459968.966605:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 84 00000100:00080000:2.0:1788459968.966710:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788459968.969403:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788459968.969479:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788459968.972960:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003330688 00000100:00100000:0.0:1788459968.973141:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003330688 00000100:00100000:0.0:1788459968.973413:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003330816 00000100:00100000:0.0:1788459968.973418:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003330816 00000100:00100000:2.0:1788459968.973482:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 18 00000100:00100000:2.0:1788459968.973496:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc43f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2392:x1875336003330688:12345-192.168.206.5@tcp:9:kworker.0 00000020:00000080:2.0:1788459968.973533:0:8448:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5dfa74784542ae21 00000100:00080000:2.0:1788459968.973544:0:8448:0:(import.c:65:import_set_state_nolock()) ffff8c4ac3844800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788459968.973588:0:8448:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1788459968.973735:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc43f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+2:2392:x1875336003330688:12345-192.168.206.5@tcp:9:kworker.0 Request processed in 242us (4338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459968.973743:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 18 00010000:00010000:2.0:1788459968.973766:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788459968.978133:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788459968.978144:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788459968.980236:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 19 00000100:00100000:0.0:1788459968.980254:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc43fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2392:x1875336003330816:12345-192.168.206.5@tcp:9:kworker.0 00000020:00000080:0.0:1788459968.980414:0:8449:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5dfa74784542ae28 00000100:00080000:0.0:1788459968.980428:0:8449:0:(import.c:65:import_set_state_nolock()) ffff8c4ac35cd800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788459968.980480:0:8449:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1788459968.980629:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc43fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+2:2392:x1875336003330816:12345-192.168.206.5@tcp:9:kworker.0 Request processed in 381us (11148us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459968.980637:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 19 00010000:00010000:3.0:1788459968.980694:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788459969.298396:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788459969.921936:0:11137:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.7 00000100:00100000:2.0:1788459970.129379:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3998e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022274816:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788459970.129443:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459970.129597:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022274816 00000100:00100000:3.0:1788459970.129605:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022274816 00000100:00100000:3.0:1788459970.129661:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788459970.129671:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3b5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022274816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788459970.129704:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788459970.129749:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3b5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022274816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459970.129756:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1788459970.129790:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3998e00 x1875336022274816/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788459986 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788459970.129806:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3998e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022274816:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788459970.130797:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788459970.322801:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788459970.641627:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3b6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022274944:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788459970.641695:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459970.641794:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022274944 00000100:00100000:1.0:1788459970.641803:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022274944 00000100:00100000:1.0:1788459970.641870:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788459970.641890:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfae8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022274944:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788459970.641911:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788459970.641978:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfae8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022274944:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459970.641986:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:1.0:1788459970.642026:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3b6df80 x1875336022274944/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788459986 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788459970.642046:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3b6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022274944:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788459970.642107:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788459970.643905:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3998e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022275072:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788459970.643986:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459970.644120:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022275072 00000100:00100000:3.0:1788459970.644129:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022275072 00000100:00100000:3.0:1788459970.644180:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788459970.644190:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3b6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022275072:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788459970.644362:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788459970.644416:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3b6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022275072:12345-0@lo:41:osp-pre-0-1.0 Request processed in 227us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459970.644423:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788459970.644582:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3998e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022275072:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788459971.345097:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788459971.667078:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3b58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022275200:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788459971.667145:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459971.667396:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022275200 00000100:00100000:1.0:1788459971.667404:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022275200 00000100:00100000:1.0:1788459971.667486:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788459971.667495:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3afa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022275200:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788459971.667524:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446453248 avail 1300213760 00000100:00100000:1.0:1788459971.667696:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3afa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022275200:12345-0@lo:41:osp-pre-1-0.0 Request processed in 202us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459971.667703:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788459971.667988:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3b58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022275200:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788459972.180158:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788459972.180180:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac399aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0cf73fe6-82e2-434e-b670-631647721b2c:3659:1875336022275328:0@lo:400:kworker.0 00000100:00100000:3.0:1788459972.180248:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459972.180338:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3998700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875336022275456:0@lo:400:kworker.0 00000100:00100000:3.0:1788459972.180367:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459972.180417:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac399a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022275584:0@lo:400:kworker.0 00000100:00100000:3.0:1788459972.180443:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459972.180505:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3999880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3661:1875336022275968:0@lo:400:kworker.0 00000100:00100000:3.0:1788459972.180527:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459972.180556:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022275456 00000100:00100000:3.0:1788459972.180561:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022275456 00000100:00100000:3.0:1788459972.180600:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022275968 00000100:00100000:3.0:1788459972.180615:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022275968 00000100:00100000:3.0:1788459972.180646:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788459972.180654:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac399a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1875336022275456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788459972.180701:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac399a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1875336022275456:12345-0@lo:400:kworker.0 Request processed in 48us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459972.180708:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788459972.180724:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788459972.180730:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3998a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1875336022275968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788459972.180755:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3998a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1875336022275968:12345-0@lo:400:kworker.0 Request processed in 25us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459972.180760:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:3.0:1788459972.180779:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788459972.180810:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3999880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3661:1875336022275968:0@lo:400:kworker.0 00000100:00100000:3.0:1788459972.180820:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3998700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875336022275456:0@lo:400:kworker.0 00000100:00100000:3.0:1788459972.180874:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac399ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1875336022275712:0@lo:400:kworker.0 00000100:00100000:3.0:1788459972.180898:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459972.180916:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788459972.180921:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3999500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022275840:0@lo:400:kworker.0 00000100:00100000:3.0:1788459972.180940:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459972.180993:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022275584 00000100:00100000:3.0:1788459972.180996:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022275584 00000100:00100000:3.0:1788459972.181014:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022275840 00000100:00100000:3.0:1788459972.181017:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022275840 00000100:00100000:3.0:1788459972.181028:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788459972.181034:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac399b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022275584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788459972.181068:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac399b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022275584:12345-0@lo:400:kworker.0 Request processed in 35us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459972.181074:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788459972.181084:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788459972.181090:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3999880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022275840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788459972.181119:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3999880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022275840:12345-0@lo:400:kworker.0 Request processed in 29us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459972.181125:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788459972.181146:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac399a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022275584:0@lo:400:kworker.0 00000100:00100000:3.0:1788459972.181167:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022275712 00000100:00100000:3.0:1788459972.181170:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022275712 00000100:00100000:3.0:1788459972.181189:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788459972.181195:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3998700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1875336022275712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788459972.181224:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3998700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1875336022275712:12345-0@lo:400:kworker.0 Request processed in 29us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459972.181240:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788459972.181497:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3999500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022275840:0@lo:400:kworker.0 00000100:00100000:3.0:1788459972.181514:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac399ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1875336022275712:0@lo:400:kworker.0 00000100:00100000:3.0:1788459972.181556:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac399ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3662:1875336022276096:0@lo:400:kworker.0 00000100:00100000:3.0:1788459972.181580:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459972.181605:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022276096 00000100:00100000:3.0:1788459972.181610:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022276096 00000100:00100000:3.0:1788459972.181637:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788459972.181643:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3999500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875336022276096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788459972.181689:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3999500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875336022276096:12345-0@lo:400:kworker.0 Request processed in 46us (108us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459972.181695:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:3.0:1788459972.181709:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788459972.181726:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac399ad80 x1875336022276096/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788459988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788459972.181736:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac399ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3662:1875336022276096:0@lo:400:kworker.0 00000100:00100000:3.0:1788459972.181803:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac399b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1875336022276608:0@lo:400:kworker.0 00000100:00100000:3.0:1788459972.181827:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459972.182015:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac399a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022276352:0@lo:400:kworker.0 00000100:00100000:0.0:1788459972.182049:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459972.182068:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac399bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022276864:0@lo:400:kworker.0 00000100:00100000:0.0:1788459972.182086:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459972.182104:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788459972.182118:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac399ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022276224:0@lo:400:kworker.0 00000100:00100000:0.0:1788459972.182139:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459972.182155:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3998380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022276736:0@lo:400:kworker.0 00000100:00100000:0.0:1788459972.182174:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459972.182197:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022276352 00000100:00100000:0.0:1788459972.182202:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022276352 00000100:00100000:0.0:1788459972.182228:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022276864 00000100:00100000:0.0:1788459972.182231:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022276864 00000100:00100000:0.0:1788459972.182243:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022276224 00000100:00100000:0.0:1788459972.182245:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022276224 00000100:00100000:0.0:1788459972.182257:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022276736 00000100:00100000:0.0:1788459972.182271:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022276736 00000100:00100000:0.0:1788459972.182289:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788459972.182295:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfaf6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022276352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788459972.182332:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfaf6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022276352:12345-0@lo:400:kworker.0 Request processed in 38us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459972.182338:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788459972.182462:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788459972.182468:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3af9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022276864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788459972.182495:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3af9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022276864:12345-0@lo:400:kworker.0 Request processed in 28us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459972.182500:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788459972.182512:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788459972.182518:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3afb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022276224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788459972.182542:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3afb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022276224:12345-0@lo:400:kworker.0 Request processed in 25us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459972.182547:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788459972.182566:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788459972.182571:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3af8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022276736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788459972.182599:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3af8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022276736:12345-0@lo:400:kworker.0 Request processed in 28us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459972.182618:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1788459972.182647:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac399ad80 x1875336022276224/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788459988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788459972.182657:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac399ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022276224:0@lo:400:kworker.0 00010000:00080000:0.0:1788459972.182667:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3998380 x1875336022276736/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788459988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788459972.182675:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3998380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022276736:0@lo:400:kworker.0 00010000:00080000:0.0:1788459972.182683:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac399a300 x1875336022276352/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788459988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788459972.182690:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac399a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022276352:0@lo:400:kworker.0 00010000:00080000:0.0:1788459972.182698:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac399bb80 x1875336022276864/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788459988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788459972.182705:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac399bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022276864:0@lo:400:kworker.0 00000100:00080000:0.0:1788459972.182725:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788459972.182729:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788459972.182836:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788459972.182919:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3999180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3662:1875336022276480:0@lo:400:kworker.0 00000100:00100000:3.0:1788459972.182973:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459972.183012:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022276608 00000100:00100000:3.0:1788459972.183017:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022276608 00000100:00100000:3.0:1788459972.183048:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022276480 00000100:00100000:3.0:1788459972.183058:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022276480 00000100:00100000:3.0:1788459972.183077:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788459972.183083:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3998000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875336022276608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788459972.183119:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3998000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875336022276608:12345-0@lo:400:kworker.0 Request processed in 36us (1290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459972.183125:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788459972.183137:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788459972.183144:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3999c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1875336022276480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788459972.183169:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3999c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1875336022276480:12345-0@lo:400:kworker.0 Request processed in 27us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459972.183175:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788459972.183213:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3999180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3662:1875336022276480:0@lo:400:kworker.0 00010000:00080000:3.0:1788459972.183225:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac399b100 x1875336022276608/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788459988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788459972.183233:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac399b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1875336022276608:0@lo:400:kworker.0 00000100:00100000:3.0:1788459972.183295:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022275328 00000100:00100000:3.0:1788459972.183299:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022275328 00000100:00100000:3.0:1788459972.183323:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1788459972.183328:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf363fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+29:3659:x1875336022275328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788459972.183361:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf363fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+29:3659:x1875336022275328:12345-0@lo:400:kworker.0 Request processed in 33us (3113us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459972.183366:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1788459972.183395:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac399aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0cf73fe6-82e2-434e-b670-631647721b2c:3659:1875336022275328:0@lo:400:kworker.0 00000100:00080000:0.0:1788459972.184030:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788459972.184035:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788459972.184252:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788459972.184331:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3afa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022276992:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788459972.184374:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459972.184421:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022276992 00000100:00100000:0.0:1788459972.184427:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022276992 00000100:00100000:0.0:1788459972.184460:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788459972.184467:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3afad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875336022276992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788459972.184490:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788459972.184528:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3afad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875336022276992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459972.184534:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:0.0:1788459972.184566:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3afa680 x1875336022276992/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788459988 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788459972.184581:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3afa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022276992:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788459972.185437:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788459972.185450:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac399aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022277120:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788459972.185493:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459972.185563:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022277120 00000100:00100000:1.0:1788459972.185570:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022277120 00000100:00100000:1.0:1788459972.185623:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788459972.185631:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3b58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022277120:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788459972.185653:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788459972.185692:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3b58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022277120:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459972.185709:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:2.0:1788459972.185973:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac399aa00 x1875336022277120/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788459988 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788459972.186001:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac399aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022277120:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788459972.370107:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788459972.569634:0:11234:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.7 00010000:00010000:0.0:1788459973.396058:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788459974.083152:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788459974.083396:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788459974.083440:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788459974.083517:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003331200 00000100:00100000:2.0:1788459974.083526:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003331200 00000100:00100000:2.0:1788459974.083590:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003331072 00000100:00100000:2.0:1788459974.083595:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003331072 00000100:00100000:1.0:1788459974.083607:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 91 00000100:00100000:1.0:1788459974.083626:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac399b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2394:x1875336003331200:12345-192.168.206.5@tcp:400:kworker.0 00000100:00080000:3.0:1788459974.083661:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788459974.083675:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788459974.083701:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac399b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2394:x1875336003331200:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 82us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459974.083764:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003330944 00000100:00100000:0.0:1788459974.083770:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003330944 00000100:00100000:0.0:1788459974.083811:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 313 00000100:00100000:0.0:1788459974.083819:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf363e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bed032f6-c389-485e-b2f7-e2ea34763c65+10:2394:x1875336003330944:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:0.0:1788459974.083848:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf363e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bed032f6-c389-485e-b2f7-e2ea34763c65+10:2394:x1875336003330944:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 30us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459974.083854:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 313 00000100:00100000:2.0:1788459974.086013:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 92 00000100:00100000:2.0:1788459974.086031:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3999180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:2394:x1875336003331072:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:2.0:1788459974.086113:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3999180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:2394:x1875336003331072:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 89us (2672us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459974.086122:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 92 00000100:00100000:1.0:1788459974.089531:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 91 00010000:00010000:3.0:1788459974.418107:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788459974.741541:0:8443:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f8767d3e-bfef-4d3d-8163-ef8ae18a3514 00000020:00000080:3.0:1788459974.741551:0:8443:0:(genops.c:885:class_export_put()) final put ffff8c4ac3841800/f8767d3e-bfef-4d3d-8163-ef8ae18a3514 00000020:00000080:2.0:1788459974.742283:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c4ac3841800/f8767d3e-bfef-4d3d-8163-ef8ae18a3514 for lustre-OST0000 00000020:00000080:2.0:1788459974.742339:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c4ac3844800 for lustre-OST0000 00000001:00100000:3.0:1788459974.746659:0:9527:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f8767d3e-bfef-4d3d-8163-ef8ae18a3514 00000020:00000080:3.0:1788459974.746668:0:9527:0:(genops.c:885:class_export_put()) final put ffff8c4ac35c8000/f8767d3e-bfef-4d3d-8163-ef8ae18a3514 00000020:00000080:2.0:1788459974.746727:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c4ac35c8000/f8767d3e-bfef-4d3d-8163-ef8ae18a3514 for lustre-OST0001 00000020:00000080:2.0:1788459974.746774:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c4ac35cd800 for lustre-OST0001 00000001:02000400:0.0:1788459975.036708:0:11332:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.7 00000100:00100000:0.0:1788459975.249789:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac399b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022277248:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788459975.249857:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459975.249997:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022277248 00000100:00100000:3.0:1788459975.250005:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022277248 00000100:00100000:3.0:1788459975.250056:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788459975.250066:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3afa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022277248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788459975.250093:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788459975.250139:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3afa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022277248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459975.250147:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1788459975.250215:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788459975.250257:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac399b800 x1875336022277248/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788459991 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788459975.250294:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac399b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022277248:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788459975.442824:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788459975.761268:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3b6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022277376:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788459975.761337:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459975.761397:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3999f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022277504:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788459975.761430:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459975.761527:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022277504 00000100:00100000:2.0:1788459975.761534:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022277504 00000100:00100000:2.0:1788459975.761586:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788459975.761595:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac399b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022277504:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788459975.761626:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788459975.761677:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac399b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022277504:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459975.761683:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788459975.761784:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3999f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022277504:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788459975.762078:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022277376 00000100:00100000:1.0:1788459975.762083:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022277376 00000100:00100000:1.0:1788459975.762138:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788459975.762145:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3b59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022277376:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788459975.762160:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00080000:0.0:1788459975.762181:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788459975.762211:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3b59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022277376:12345-0@lo:13:osp-pre-0-1.0 Request processed in 66us (872us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459975.762218:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:2.0:1788459975.762347:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3b6ce00 x1875336022277376/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788459991 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788459975.762362:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3b6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022277376:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788459976.465794:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788459976.785600:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3b6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022277632:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788459976.785667:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459976.785737:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022277632 00000100:00100000:1.0:1788459976.785744:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022277632 00000100:00100000:1.0:1788459976.785787:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788459976.785795:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3b6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1875336022277632:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788459976.785825:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446453248 avail 1300213760 00000100:00100000:1.0:1788459976.785870:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3b6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1875336022277632:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459976.785877:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788459976.785917:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3b6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022277632:0@lo:41:osp-pre-1-0.0 00000001:02000400:2.0:1788459976.878092:0:11380:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Thu Sep 3 14:26:14 EDT 2026 00000100:00100000:2.0:1788459977.297271:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788459977.297294:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac399aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022277760:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788459977.297363:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459977.297433:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0cf73fe6-82e2-434e-b670-631647721b2c:3660:1875336022277888:0@lo:400:kworker.0 00000100:00100000:2.0:1788459977.297487:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459977.297519:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfaeabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022278400:0@lo:400:kworker.0 00000100:00100000:2.0:1788459977.297552:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459977.297556:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875336022278016:0@lo:400:kworker.0 00000100:00100000:2.0:1788459977.297578:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022278912:0@lo:400:kworker.0 00000100:00100000:0.0:1788459977.297598:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459977.297612:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459977.297625:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfaea9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3661:1875336022278528:0@lo:400:kworker.0 00000100:00100000:0.0:1788459977.297654:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459977.297656:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788459977.297665:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3660:1875336022278272:0@lo:400:kworker.0 00000100:00100000:0.0:1788459977.297678:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3661:1875336022279040:0@lo:400:kworker.0 00000100:00100000:2.0:1788459977.297710:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459977.297718:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022278144:0@lo:400:kworker.0 00000100:00100000:2.0:1788459977.297751:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022278784:0@lo:400:kworker.0 00000100:00100000:0.0:1788459977.297759:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459977.298153:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022278016 00000100:00100000:1.0:1788459977.298162:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022278016 00000100:00100000:1.0:1788459977.298200:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022278528 00000100:00100000:1.0:1788459977.298203:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022278528 00000100:00100000:1.0:1788459977.298223:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022278272 00000100:00100000:1.0:1788459977.298226:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022278272 00000100:00100000:1.0:1788459977.298255:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788459977.298263:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc4396d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1875336022278016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788459977.298383:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022278400 00000100:00100000:3.0:1788459977.298388:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022278400 00000100:00100000:3.0:1788459977.298407:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022278144 00000100:00100000:3.0:1788459977.298410:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022278144 00000100:00100000:3.0:1788459977.298423:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788459977.298430:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3b5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022278400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788459977.302350:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459977.302415:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4397b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022279296:0@lo:400:kworker.0 00000100:00100000:2.0:1788459977.302484:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459977.302517:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac399bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022279424:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788459977.302543:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459977.302591:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022278912 00000100:00100000:2.0:1788459977.302597:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022278912 00000100:00100000:2.0:1788459977.302939:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022278784 00000100:00100000:2.0:1788459977.302960:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022278784 00000100:00100000:2.0:1788459977.302980:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022279296 00000100:00100000:2.0:1788459977.302985:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022279296 00000100:00100000:2.0:1788459977.303004:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788459977.303018:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3b58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022278912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788459977.303073:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3b58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022278912:12345-0@lo:400:kworker.0 Request processed in 56us (5461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459977.303080:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788459977.303098:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788459977.303104:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf2feb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022278784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788459977.303132:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf2feb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022278784:12345-0@lo:400:kworker.0 Request processed in 28us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459977.303138:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788459977.303148:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788459977.303154:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf2feaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022279296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788459977.303472:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc4396d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1875336022278016:12345-0@lo:400:kworker.0 Request processed in 5207us (5873us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459977.303482:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788459977.303502:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788459977.303511:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3671500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1875336022278528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788459977.303544:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3671500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1875336022278528:12345-0@lo:400:kworker.0 Request processed in 36us (5891us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459977.303550:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788459977.303564:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788459977.303570:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3b58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1875336022278272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788459977.303600:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3b58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1875336022278272:12345-0@lo:400:kworker.0 Request processed in 30us (5891us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459977.303605:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:1.0:1788459977.303641:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788459977.303645:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788459977.303648:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788459977.303666:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459977.303712:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875336022278016:0@lo:400:kworker.0 00000100:00100000:0.0:1788459977.304058:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfaeab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3662:1875336022278656:0@lo:400:kworker.0 00000100:00100000:0.0:1788459977.304091:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459977.304109:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4394380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1875336022279168:0@lo:400:kworker.0 00000100:00100000:0.0:1788459977.304125:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459977.304168:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022279040 00000100:00100000:0.0:1788459977.304173:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022279040 00000100:00100000:2.0:1788459977.304354:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf2feaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022279296:12345-0@lo:400:kworker.0 Request processed in 1200us (1869us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459977.304362:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788459977.304385:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022278656 00000100:00100000:2.0:1788459977.304389:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022278656 00000100:00100000:2.0:1788459977.304408:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022279168 00000100:00100000:2.0:1788459977.304411:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022279168 00000100:00100000:2.0:1788459977.304427:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788459977.304433:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3b6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1875336022279040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788459977.304465:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3b6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1875336022279040:12345-0@lo:400:kworker.0 Request processed in 32us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459977.304486:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788459977.304501:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788459977.304507:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac1e63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875336022278656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788459977.304544:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac1e63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875336022278656:12345-0@lo:400:kworker.0 Request processed in 37us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459977.304550:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788459977.304563:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788459977.304569:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac1e61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875336022279168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788459977.304600:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac1e61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875336022279168:12345-0@lo:400:kworker.0 Request processed in 31us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459977.304608:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788459977.304641:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022277760 00000100:00100000:2.0:1788459977.304645:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022277760 00000100:00100000:2.0:1788459977.304666:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022279424 00000100:00100000:2.0:1788459977.304669:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022279424 00000100:00100000:2.0:1788459977.304684:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788459977.304691:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3b58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022277760:12345-0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1788459977.304704:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788459977.304711:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00002000:00000024:2.0:1788459977.304713:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00080000:0.0:1788459977.304713:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788459977.304828:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3b58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022277760:12345-0@lo:13:osp-pre-1-1.0 Request processed in 138us (7466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459977.304835:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788459977.304847:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788459977.304854:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf2fe9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022279424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788459977.304863:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788459977.304887:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf2fe9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022279424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 35us (2343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459977.304911:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:2.0:1788459977.305854:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac399bb80 x1875336022279424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788459993 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788459977.305877:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac399bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022279424:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788459977.305893:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3660:1875336022278272:0@lo:400:kworker.0 00010000:00080000:2.0:1788459977.305916:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bf75e0700 x1875336022278784/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788459993 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788459977.305925:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022278784:0@lo:400:kworker.0 00010000:00080000:2.0:1788459977.305936:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bc4397b80 x1875336022279296/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788459993 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788459977.305958:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4397b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022279296:0@lo:400:kworker.0 00010000:00080000:2.0:1788459977.305970:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bf75e2680 x1875336022278912/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788459993 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788459977.305978:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022278912:0@lo:400:kworker.0 00010000:00080000:2.0:1788459977.305989:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac399aa00 x1875336022277760/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788459993 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788459977.306000:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac399aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022277760:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788459977.306063:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022277888 00000100:00100000:2.0:1788459977.306067:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022277888 00000100:00100000:2.0:1788459977.306106:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1788459977.306114:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf363e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+29:3660:x1875336022277888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788459977.306467:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf363e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+29:3660:x1875336022277888:12345-0@lo:400:kworker.0 Request processed in 353us (8980us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459977.306486:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1788459977.306530:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0cf73fe6-82e2-434e-b670-631647721b2c:3660:1875336022277888:0@lo:400:kworker.0 00010000:00080000:2.0:1788459977.306576:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bfaeab100 x1875336022278656/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788459993 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788459977.306586:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfaeab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3662:1875336022278656:0@lo:400:kworker.0 00010000:00080000:2.0:1788459977.306599:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bc4394380 x1875336022279168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788459993 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788459977.306607:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4394380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1875336022279168:0@lo:400:kworker.0 00000100:00100000:1.0:1788459977.308607:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfaea9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3661:1875336022278528:0@lo:400:kworker.0 00000100:00100000:1.0:1788459977.308655:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3661:1875336022279040:0@lo:400:kworker.0 00000100:00100000:3.0:1788459977.311995:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3b5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022278400:12345-0@lo:400:kworker.0 Request processed in 13555us (14433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459977.312026:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788459977.312060:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788459977.312070:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3671f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022278144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788459977.312141:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3671f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022278144:12345-0@lo:400:kworker.0 Request processed in 73us (14383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459977.312149:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788459977.314366:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022278144:0@lo:400:kworker.0 00000100:00100000:2.0:1788459977.316592:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfaeabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022278400:0@lo:400:kworker.0 00010000:00010000:3.0:1788459977.493591:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788459978.513137:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788459979.200362:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788459979.200398:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788459979.200419:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788459979.200472:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003331328 00000100:00100000:2.0:1788459979.200481:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003331328 00000100:00100000:2.0:1788459979.200528:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 315 00000100:00100000:2.0:1788459979.200537:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf363c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bed032f6-c389-485e-b2f7-e2ea34763c65+10:2396:x1875336003331328:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:2.0:1788459979.200592:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf363c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bed032f6-c389-485e-b2f7-e2ea34763c65+10:2396:x1875336003331328:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 57us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459979.200600:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 315 00000100:00100000:2.0:1788459979.200627:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003331584 00000100:00100000:2.0:1788459979.200630:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003331584 00000100:00100000:2.0:1788459979.200657:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003331456 00000100:00100000:2.0:1788459979.200659:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003331456 00000100:00100000:2.0:1788459979.200675:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 99 00000100:00100000:2.0:1788459979.200680:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac1e61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2396:x1875336003331584:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:2.0:1788459979.200704:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac1e61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2396:x1875336003331584:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 24us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459979.200716:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 99 00000100:00100000:2.0:1788459979.200729:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 100 00000100:00100000:2.0:1788459979.200734:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3668000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:2396:x1875336003331456:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:2.0:1788459979.200755:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3668000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:2396:x1875336003331456:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 21us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459979.200760:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 100 00000100:00080000:2.0:1788459979.200873:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788459979.200877:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788459979.537778:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788459980.369407:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac399a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022279552:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788459980.369505:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459980.369732:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022279552 00000100:00100000:2.0:1788459980.369743:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022279552 00000100:00100000:2.0:1788459980.369833:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788459980.369846:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3b6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1875336022279552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788459980.369888:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788459980.369983:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3b6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1875336022279552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 141us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459980.369992:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:1.0:1788459980.370198:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac399a300 x1875336022279552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788459996 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788459980.370231:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac399a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022279552:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788459980.370321:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788459980.568416:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788459980.881853:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3b6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022279680:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788459980.881965:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459980.882170:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022279680 00000100:00100000:1.0:1788459980.882181:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022279680 00000100:00100000:1.0:1788459980.882270:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788459980.882281:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac366b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022279680:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788459980.882310:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788459980.882368:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac366b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022279680:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459980.882376:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:1.0:1788459980.882426:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3b6e300 x1875336022279680/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788459996 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788459980.882447:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3b6e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022279680:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788459980.882813:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788459980.882825:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3998380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022279808:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788459980.882864:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788459980.882936:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788459980.882994:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022279808 00000100:00100000:3.0:1788459980.883000:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022279808 00000100:00100000:3.0:1788459980.883041:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788459980.883048:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfaeabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022279808:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788459980.883130:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788459980.883184:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfaeabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022279808:12345-0@lo:41:osp-pre-0-1.0 Request processed in 136us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459980.883191:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788459980.883274:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3998380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022279808:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788459981.585105:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788459981.905197:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788459981.905228:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfaea9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022279936:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788459981.905296:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459981.905376:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022279936 00000100:00100000:2.0:1788459981.905385:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022279936 00000100:00100000:2.0:1788459981.905434:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788459981.905457:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfaeab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022279936:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788459981.905493:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446453248 avail 1300213760 00000100:00100000:2.0:1788459981.905542:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfaeab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022279936:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459981.905550:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788459981.905842:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfaea9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022279936:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788459982.417166:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac2975180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3660:1875336022280448:0@lo:400:kworker.0 00000100:00100000:0.0:1788459982.417244:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459982.417287:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfa1e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022280960:0@lo:400:kworker.0 00000100:00100000:0.0:1788459982.417313:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459982.417335:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfa1e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022281472:0@lo:400:kworker.0 00000100:00100000:0.0:1788459982.417354:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459982.417375:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788459982.417381:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac366a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022280320:0@lo:400:kworker.0 00000100:00100000:0.0:1788459982.417413:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459982.417428:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfa1e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022280832:0@lo:400:kworker.0 00000100:00100000:0.0:1788459982.417448:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459982.417463:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfa1e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022281344:0@lo:400:kworker.0 00000100:00100000:0.0:1788459982.417482:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459982.417527:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022280960 00000100:00100000:0.0:1788459982.417534:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022280960 00000100:00100000:0.0:1788459982.417575:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022281472 00000100:00100000:0.0:1788459982.417579:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022281472 00000100:00100000:0.0:1788459982.417593:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022280832 00000100:00100000:0.0:1788459982.417595:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022280832 00000100:00100000:0.0:1788459982.417608:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022281344 00000100:00100000:0.0:1788459982.417610:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022281344 00000100:00100000:0.0:1788459982.417623:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788459982.417642:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfae8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022280960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788459982.417698:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfae8e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022280960:12345-0@lo:400:kworker.0 Request processed in 56us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459982.417705:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788459982.417722:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788459982.417729:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfae8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022281472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788459982.417755:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfae8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022281472:12345-0@lo:400:kworker.0 Request processed in 28us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459982.417760:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788459982.417771:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788459982.417776:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc43f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022280832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788459982.417801:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc43f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022280832:12345-0@lo:400:kworker.0 Request processed in 26us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459982.417807:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788459982.417817:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788459982.417823:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc43f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022281344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788459982.417846:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc43f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022281344:12345-0@lo:400:kworker.0 Request processed in 24us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459982.417851:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:0.0:1788459982.417866:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788459982.417869:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788459982.417891:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bfa1e3800 x1875336022280832/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788459998 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788459982.417904:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfa1e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022280832:0@lo:400:kworker.0 00010000:00080000:0.0:1788459982.417914:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bfa1e3100 x1875336022281344/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788459998 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788459982.417935:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfa1e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022281344:0@lo:400:kworker.0 00010000:00080000:0.0:1788459982.417972:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bfa1e0e00 x1875336022280960/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788459998 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788459982.417981:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfa1e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022280960:0@lo:400:kworker.0 00010000:00080000:0.0:1788459982.417991:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bfa1e3480 x1875336022281472/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788459998 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788459982.417998:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfa1e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022281472:0@lo:400:kworker.0 00000100:00100000:3.0:1788459982.418684:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac366ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0cf73fe6-82e2-434e-b670-631647721b2c:3661:1875336022280064:0@lo:400:kworker.0 00000100:00100000:3.0:1788459982.418727:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459982.418767:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac2974380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3661:1875336022280576:0@lo:400:kworker.0 00000100:00100000:3.0:1788459982.418791:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459982.418808:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfa1e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3661:1875336022281088:0@lo:400:kworker.0 00000100:00100000:3.0:1788459982.418825:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459982.418853:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788459982.418860:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac366b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875336022280192:0@lo:400:kworker.0 00000100:00100000:3.0:1788459982.418881:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459982.418899:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac2976d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1875336022280704:0@lo:400:kworker.0 00000100:00100000:3.0:1788459982.418916:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459982.418925:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfa1e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1875336022281216:0@lo:400:kworker.0 00000100:00100000:3.0:1788459982.419083:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459982.419389:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022280448 00000100:00100000:2.0:1788459982.419396:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022280448 00000100:00100000:2.0:1788459982.419438:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022280576 00000100:00100000:2.0:1788459982.419441:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022280576 00000100:00100000:2.0:1788459982.419461:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022281088 00000100:00100000:2.0:1788459982.419464:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022281088 00000100:00100000:2.0:1788459982.419475:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022280192 00000100:00100000:2.0:1788459982.419477:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022280192 00000100:00100000:2.0:1788459982.419486:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022280704 00000100:00100000:2.0:1788459982.419489:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022280704 00000100:00100000:2.0:1788459982.419616:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022281216 00000100:00100000:2.0:1788459982.419620:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022281216 00000100:00100000:2.0:1788459982.419654:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788459982.419661:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfa1e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1875336022280448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788459982.419718:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfa1e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1875336022280448:12345-0@lo:400:kworker.0 Request processed in 57us (2474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459982.419726:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788459982.419747:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788459982.419753:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac399ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1875336022280576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788459982.419787:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac399ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1875336022280576:12345-0@lo:400:kworker.0 Request processed in 35us (995us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459982.419794:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788459982.419816:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788459982.419821:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3998e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1875336022281088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788459982.419851:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3998e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1875336022281088:12345-0@lo:400:kworker.0 Request processed in 30us (1024us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459982.419856:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788459982.419867:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788459982.419872:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3998380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1875336022280192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788459982.419894:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3998380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1875336022280192:12345-0@lo:400:kworker.0 Request processed in 23us (1013us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459982.419900:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788459982.419909:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788459982.419913:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac399a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1875336022280704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788459982.419939:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac399a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1875336022280704:12345-0@lo:400:kworker.0 Request processed in 26us (1022us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459982.420335:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788459982.420348:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788459982.420354:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac399aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1875336022281216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788459982.420385:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac399aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1875336022281216:12345-0@lo:400:kworker.0 Request processed in 33us (1443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459982.420391:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788459982.420481:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022280320 00000100:00100000:2.0:1788459982.420486:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022280320 00000100:00100000:0.0:1788459982.420602:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022280064 00000100:00100000:0.0:1788459982.420607:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022280064 00000100:00100000:0.0:1788459982.420637:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1788459982.420643:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf363d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+29:3661:x1875336022280064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788459982.420674:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf363d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+29:3661:x1875336022280064:12345-0@lo:400:kworker.0 Request processed in 32us (1947us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459982.420679:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1788459982.420747:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788459982.420754:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfae8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022280320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788459982.420784:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfae8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022280320:12345-0@lo:400:kworker.0 Request processed in 32us (3382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459982.420796:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:2.0:1788459982.420853:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788459982.420856:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788459982.420869:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfaea9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022281600:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788459982.420896:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459982.420940:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac366b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875336022280192:0@lo:400:kworker.0 00010000:00080000:2.0:1788459982.421271:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac2976d80 x1875336022280704/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788459998 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788459982.421282:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac2976d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1875336022280704:0@lo:400:kworker.0 00010000:00080000:2.0:1788459982.421294:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bfa1e1180 x1875336022281216/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788459998 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788459982.421302:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfa1e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1875336022281216:0@lo:400:kworker.0 00000100:00100000:2.0:1788459982.421312:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac366ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0cf73fe6-82e2-434e-b670-631647721b2c:3661:1875336022280064:0@lo:400:kworker.0 00000100:00100000:2.0:1788459982.421322:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac2974380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3661:1875336022280576:0@lo:400:kworker.0 00000100:00100000:2.0:1788459982.421333:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfa1e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3661:1875336022281088:0@lo:400:kworker.0 00000100:00100000:2.0:1788459982.421358:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788459982.421364:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac399bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022281728:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788459982.421388:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459982.421537:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac366a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022280320:0@lo:400:kworker.0 00000100:00100000:2.0:1788459982.421550:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac2975180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3660:1875336022280448:0@lo:400:kworker.0 00000100:00100000:0.0:1788459982.423285:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022281600 00000100:00100000:0.0:1788459982.423296:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022281600 00000100:00100000:0.0:1788459982.423332:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022281728 00000100:00100000:0.0:1788459982.423334:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022281728 00000100:00100000:0.0:1788459982.423352:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788459982.423360:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc4394380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1875336022281600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788459982.423387:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788459982.423631:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc4394380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1875336022281600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 271us (2732us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459982.423639:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788459982.423664:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788459982.423671:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc4397b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022281728:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788459982.423682:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788459982.423709:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc4397b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022281728:12345-0@lo:13:osp-pre-1-1.0 Request processed in 39us (2320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459982.423715:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1788459982.423816:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bfaea9c00 x1875336022281600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788459998 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788459982.423843:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfaea9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022281600:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1788459982.423872:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac399bb80 x1875336022281728/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788459998 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788459982.423885:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac399bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022281728:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788459982.610385:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788459983.633074:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788459984.320826:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788459984.320876:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788459984.320899:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788459984.320925:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003331840 00000100:00100000:1.0:1788459984.320935:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003331840 00000100:00100000:1.0:1788459984.321005:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003331968 00000100:00100000:1.0:1788459984.321009:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003331968 00000100:00100000:1.0:1788459984.321032:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 107 00000100:00100000:1.0:1788459984.321048:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3b6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:2396:x1875336003331840:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:1.0:1788459984.321118:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3b6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:2396:x1875336003331840:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 72us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459984.321126:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 107 00000100:00100000:1.0:1788459984.321142:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 108 00000100:00100000:1.0:1788459984.321149:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3b6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2396:x1875336003331968:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:1.0:1788459984.321173:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3b6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2396:x1875336003331968:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 24us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459984.321191:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 108 00000100:00080000:1.0:1788459984.321225:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788459984.321229:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788459984.321339:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003331712 00000100:00100000:0.0:1788459984.321344:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003331712 00000100:00100000:0.0:1788459984.321383:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 317 00000100:00100000:0.0:1788459984.321399:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf363e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bed032f6-c389-485e-b2f7-e2ea34763c65+10:2396:x1875336003331712:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:0.0:1788459984.321427:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf363e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bed032f6-c389-485e-b2f7-e2ea34763c65+10:2396:x1875336003331712:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 38us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459984.321433:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 317 00010000:00010000:0.0:1788459984.657226:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788459985.489997:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3b6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022281856:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788459985.490067:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459985.492069:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022281856 00000100:00100000:0.0:1788459985.492083:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022281856 00000100:00100000:0.0:1788459985.492157:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788459985.492168:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3999f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022281856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788459985.492210:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00080000:1.0:1788459985.492317:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788459985.495205:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3999f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022281856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3022us (5119us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459985.495221:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:3.0:1788459985.495380:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3b6ed80 x1875336022281856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460001 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788459985.495413:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3b6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022281856:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788459985.684819:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788459986.001131:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788459986.001153:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc43fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022282112:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788459986.001161:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3b6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022281984:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788459986.004433:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459986.004502:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022281984 00000100:00100000:1.0:1788459986.004511:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022281984 00000100:00100000:1.0:1788459986.004578:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788459986.004588:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac399bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022281984:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788459986.004612:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788459986.004672:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac399bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022281984:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459986.004679:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:2.0:1788459986.004979:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788459986.004986:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3b6ed80 x1875336022281984/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460002 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788459986.005008:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3b6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022281984:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788459986.005612:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459986.006175:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022282112 00000100:00100000:2.0:1788459986.006183:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022282112 00000100:00100000:2.0:1788459986.006244:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788459986.006252:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfa1e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022282112:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788459986.006283:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788459986.006340:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfa1e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022282112:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (729us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459986.006348:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788459986.006428:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc43fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022282112:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788459986.706338:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788459987.025583:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3b6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022282240:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788459987.025652:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459987.025727:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022282240 00000100:00100000:1.0:1788459987.025734:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022282240 00000100:00100000:1.0:1788459987.025777:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788459987.025794:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3b6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1875336022282240:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788459987.025826:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446453248 avail 1300213760 00000100:00100000:1.0:1788459987.025868:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3b6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1875336022282240:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459987.025875:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788459987.025918:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3b6ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022282240:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788459987.539752:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac36cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3660:1875336022282496:0@lo:400:kworker.0 00000100:00100000:1.0:1788459987.539822:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459987.539888:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac36cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3660:1875336022283008:0@lo:400:kworker.0 00000100:00100000:1.0:1788459987.539911:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459987.539934:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac36ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3660:1875336022283520:0@lo:400:kworker.0 00000100:00100000:1.0:1788459987.539989:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459987.540016:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788459987.540023:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc43fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0cf73fe6-82e2-434e-b670-631647721b2c:3660:1875336022282368:0@lo:400:kworker.0 00000100:00100000:1.0:1788459987.540050:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459987.540075:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac36cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3660:1875336022282880:0@lo:400:kworker.0 00000100:00100000:1.0:1788459987.540092:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459987.540119:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac36ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3660:1875336022283392:0@lo:400:kworker.0 00000100:00100000:1.0:1788459987.540136:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459987.540154:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac36cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022282624:0@lo:400:kworker.0 00000100:00100000:1.0:1788459987.540174:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459987.540201:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac36cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022283136:0@lo:400:kworker.0 00000100:00100000:1.0:1788459987.540220:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459987.540233:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac36cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022283648:0@lo:400:kworker.0 00000100:00100000:1.0:1788459987.540258:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459987.540275:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788459987.540280:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac36cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875336022282752:0@lo:400:kworker.0 00000100:00100000:1.0:1788459987.540305:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459987.540317:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac36cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022283264:0@lo:400:kworker.0 00000100:00100000:1.0:1788459987.540333:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459987.540346:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac36ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022283776:0@lo:400:kworker.0 00000100:00100000:1.0:1788459987.540361:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459987.540497:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022282496 00000100:00100000:1.0:1788459987.540503:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022282496 00000100:00100000:1.0:1788459987.540537:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022283008 00000100:00100000:1.0:1788459987.540539:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022283008 00000100:00100000:1.0:1788459987.540559:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022283520 00000100:00100000:1.0:1788459987.540561:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022283520 00000100:00100000:1.0:1788459987.540571:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022282880 00000100:00100000:1.0:1788459987.540573:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022282880 00000100:00100000:1.0:1788459987.540582:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022283392 00000100:00100000:1.0:1788459987.540584:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022283392 00000100:00100000:1.0:1788459987.540593:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022282752 00000100:00100000:1.0:1788459987.540595:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022282752 00000100:00100000:1.0:1788459987.540607:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788459987.540613:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3b6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1875336022282496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788459987.540660:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3b6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1875336022282496:12345-0@lo:400:kworker.0 Request processed in 47us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459987.540667:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788459987.540682:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788459987.540688:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3b6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1875336022283008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788459987.540713:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3b6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1875336022283008:12345-0@lo:400:kworker.0 Request processed in 26us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459987.540726:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788459987.540738:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788459987.540744:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3b6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1875336022283520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788459987.540772:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3b6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1875336022283520:12345-0@lo:400:kworker.0 Request processed in 28us (783us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459987.540778:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788459987.540788:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788459987.540793:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3b6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1875336022282880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788459987.540815:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3b6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1875336022282880:12345-0@lo:400:kworker.0 Request processed in 23us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459987.540820:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788459987.540828:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788459987.540833:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3b6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1875336022283392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788459987.540854:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3b6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1875336022283392:12345-0@lo:400:kworker.0 Request processed in 21us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459987.540859:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788459987.540867:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788459987.540873:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3a32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1875336022282752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788459987.540903:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3a32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1875336022282752:12345-0@lo:400:kworker.0 Request processed in 30us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459987.540908:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788459987.540929:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022282624 00000100:00100000:1.0:1788459987.540933:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022282624 00000100:00100000:3.0:1788459987.541407:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022282368 00000100:00100000:3.0:1788459987.541412:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022282368 00000100:00100000:3.0:1788459987.541439:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1788459987.541445:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf363c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+29:3660:x1875336022282368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788459987.541480:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf363c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+29:3660:x1875336022282368:12345-0@lo:400:kworker.0 Request processed in 36us (1430us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459987.541496:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:0.0:1788459987.541689:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022283136 00000100:00100000:0.0:1788459987.541699:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022283136 00000100:00100000:0.0:1788459987.541720:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022283648 00000100:00100000:0.0:1788459987.541722:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022283648 00000100:00100000:0.0:1788459987.541733:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022283264 00000100:00100000:0.0:1788459987.541735:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022283264 00000100:00100000:0.0:1788459987.541744:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022283776 00000100:00100000:0.0:1788459987.541746:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022283776 00000100:00100000:0.0:1788459987.541757:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788459987.541762:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3b6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022283136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788459987.541795:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3b6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022283136:12345-0@lo:400:kworker.0 Request processed in 33us (1573us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459987.541801:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788459987.541812:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788459987.541817:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3b6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022283648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788459987.541840:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3b6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022283648:12345-0@lo:400:kworker.0 Request processed in 23us (1581us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459987.541845:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788459987.541855:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788459987.541861:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3a30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1875336022283264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788459987.541899:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3a30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1875336022283264:12345-0@lo:400:kworker.0 Request processed in 38us (1564us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459987.541905:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788459987.541914:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788459987.541920:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3a32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1875336022283776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788459987.541940:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3a32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1875336022283776:12345-0@lo:400:kworker.0 Request processed in 21us (1578us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459987.541963:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788459987.542031:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788459987.542040:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3b6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022282624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788459987.542078:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3b6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022282624:12345-0@lo:400:kworker.0 Request processed in 40us (1903us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459987.542084:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788459987.546269:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfaea9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022283904:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788459987.546335:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459987.546386:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788459987.546392:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfa1e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022284032:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788459987.546414:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459987.546446:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022283904 00000100:00100000:0.0:1788459987.546453:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022283904 00000100:00100000:0.0:1788459987.546488:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022284032 00000100:00100000:0.0:1788459987.546490:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022284032 00000100:00100000:0.0:1788459987.546503:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788459987.546510:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfa1e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022283904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788459987.546540:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788459987.546583:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfa1e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022283904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459987.546590:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788459987.546606:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788459987.546613:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfa1e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022284032:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788459987.546622:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788459987.546647:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfa1e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022284032:12345-0@lo:13:osp-pre-1-1.0 Request processed in 35us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459987.546654:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:0.0:1788459987.546695:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bfa1e1180 x1875336022284032/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460003 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788459987.546713:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfa1e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022284032:0@lo:13:osp-pre-1-1.0 00010000:00080000:0.0:1788459987.546724:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bfaea9c00 x1875336022283904/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460003 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788459987.546755:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfaea9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022283904:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788459987.549292:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788459987.549302:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788459987.549304:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788459987.549307:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788459987.551070:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc43fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0cf73fe6-82e2-434e-b670-631647721b2c:3660:1875336022282368:0@lo:400:kworker.0 00000100:00100000:3.0:1788459987.551091:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac36cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3660:1875336022282880:0@lo:400:kworker.0 00000100:00100000:3.0:1788459987.551114:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac36ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3660:1875336022283392:0@lo:400:kworker.0 00000100:00100000:3.0:1788459987.551127:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac36cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3660:1875336022282496:0@lo:400:kworker.0 00010000:00080000:3.0:1788459987.551139:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac36cce00 x1875336022283008/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460003 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788459987.551150:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac36cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3660:1875336022283008:0@lo:400:kworker.0 00010000:00080000:3.0:1788459987.551164:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac36ce300 x1875336022283520/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460003 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788459987.551172:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac36ce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3660:1875336022283520:0@lo:400:kworker.0 00000100:00100000:0.0:1788459987.552019:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac36cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875336022282752:0@lo:400:kworker.0 00010000:00080000:0.0:1788459987.552034:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac36cc700 x1875336022283264/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788460003 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788459987.552043:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac36cc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022283264:0@lo:400:kworker.0 00010000:00080000:0.0:1788459987.552054:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac36ced80 x1875336022283776/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788460003 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788459987.552069:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac36ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022283776:0@lo:400:kworker.0 00000100:00100000:0.0:1788459987.552081:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac36cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022282624:0@lo:400:kworker.0 00010000:00080000:0.0:1788459987.552092:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac36cea00 x1875336022283136/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788460003 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788459987.552101:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac36cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022283136:0@lo:400:kworker.0 00010000:00080000:0.0:1788459987.552112:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac36cf480 x1875336022283648/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788460003 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788459987.552119:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac36cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022283648:0@lo:400:kworker.0 00010000:00010000:2.0:1788459987.732014:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788459988.753550:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788459989.447429:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788459989.447470:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788459989.447494:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788459989.447530:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003332224 00000100:00100000:0.0:1788459989.447538:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003332224 00000100:00100000:0.0:1788459989.447590:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003332352 00000100:00100000:0.0:1788459989.447594:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003332352 00000100:00100000:0.0:1788459989.447616:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 115 00000100:00100000:0.0:1788459989.447627:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfa1e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:2394:x1875336003332224:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:0.0:1788459989.447693:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfa1e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:2394:x1875336003332224:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 68us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459989.447702:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 115 00000100:00100000:0.0:1788459989.447718:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 116 00000100:00100000:0.0:1788459989.447724:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfa1e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2394:x1875336003332352:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:0.0:1788459989.447814:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfa1e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2394:x1875336003332352:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 89us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459989.447822:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 116 00000100:00100000:0.0:1788459989.447906:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003332096 00000100:00100000:0.0:1788459989.447983:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003332096 00000100:00100000:0.0:1788459989.448011:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 319 00000100:00100000:0.0:1788459989.448018:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf363c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bed032f6-c389-485e-b2f7-e2ea34763c65+10:2394:x1875336003332096:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:0.0:1788459989.448044:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf363c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bed032f6-c389-485e-b2f7-e2ea34763c65+10:2394:x1875336003332096:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 26us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459989.448050:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 319 00000100:00080000:0.0:1788459989.448076:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788459989.448080:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788459989.777280:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788459990.609584:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788459990.609606:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3a32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022284160:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788459990.609671:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459990.609792:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022284160 00000100:00100000:1.0:1788459990.609800:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022284160 00000100:00100000:1.0:1788459990.609864:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788459990.609873:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfaea9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875336022284160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788459990.609900:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788459990.609977:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfaea9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875336022284160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459990.609984:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:2.0:1788459990.610104:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788459990.610137:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3a32300 x1875336022284160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460006 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788459990.610188:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3a32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022284160:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788459990.801217:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788459991.121738:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788459991.121759:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3a33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022284288:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788459991.121834:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459991.121891:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788459991.121901:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfa1e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022284416:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788459991.121975:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459991.122532:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022284288 00000100:00100000:1.0:1788459991.122541:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022284288 00000100:00100000:1.0:1788459991.122608:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788459991.122616:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac36ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022284288:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788459991.122636:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788459991.122685:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac36ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022284288:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459991.122692:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:1.0:1788459991.122728:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3a33480 x1875336022284288/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460007 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788459991.122745:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3a33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022284288:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788459991.122765:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022284416 00000100:00100000:3.0:1788459991.122770:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022284416 00000100:00080000:2.0:1788459991.122805:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788459991.122825:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788459991.122833:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf76eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022284416:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788459991.122865:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788459991.122909:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf76eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022284416:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (934us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459991.122922:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788459991.122977:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfa1e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022284416:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788459991.833782:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788459992.105447:0:12009:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 14:26:29 (1788459989) === 00000100:00100000:2.0:1788459992.148475:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3a33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022284544:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788459992.148646:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459992.148807:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022284544 00000100:00100000:1.0:1788459992.148817:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022284544 00000100:00100000:1.0:1788459992.148887:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788459992.148910:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfa1e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022284544:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788459992.149596:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446453248 avail 1300213760 00000100:00100000:1.0:1788459992.149807:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfa1e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022284544:12345-0@lo:41:osp-pre-1-0.0 Request processed in 896us (1159us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459992.149818:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788459992.149894:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3a33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022284544:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788459992.458540:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788459992.459306:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003332480 00000100:00100000:0.0:1788459992.459321:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003332480 00000100:00100000:0.0:1788459992.459469:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 320 00000100:00100000:0.0:1788459992.459483:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd0a6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bed032f6-c389-485e-b2f7-e2ea34763c65+10:8705:x1875336003332480:12345-192.168.206.5@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788459992.459500:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788459992.459519:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4bef208a00/0x5dfa74784542af40 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a518 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459992.459547:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bef208a00/0x5dfa74784542af40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a518 expref: 11 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459992.459569:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4bef208a00/0x5dfa74784542af40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a518 expref: 11 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459992.459577:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bef208a00, rc 0) 00000100:00100000:0.0:1788459992.459641:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd0a6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bed032f6-c389-485e-b2f7-e2ea34763c65+11:8705:x1875336003332480:12345-192.168.206.5@tcp:101:mount.lustre.0 Request processed in 160us (1114us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459992.459647:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 320 00000100:00100000:0.0:1788459992.470507:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788459992.473206:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003332608 00000100:00100000:3.0:1788459992.473228:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003332608 00000100:00100000:3.0:1788459992.473321:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 321 00000100:00100000:3.0:1788459992.473333:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd0a6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bed032f6-c389-485e-b2f7-e2ea34763c65+11:8705:x1875336003332608:12345-192.168.206.5@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788459992.473583:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd0a6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bed032f6-c389-485e-b2f7-e2ea34763c65+11:8705:x1875336003332608:12345-192.168.206.5@tcp:501:mount.lustre.0 Request processed in 250us (3089us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788459992.473593:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 321 00000100:00100000:2.0:1788459992.482256:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788459992.482381:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003332736 00000100:00100000:1.0:1788459992.482395:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003332736 00000100:00100000:1.0:1788459992.482463:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 322 00000100:00100000:1.0:1788459992.482474:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd0a6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bed032f6-c389-485e-b2f7-e2ea34763c65+11:8705:x1875336003332736:12345-192.168.206.5@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788459992.482496:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788459992.482519:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4ac3677400/0x5dfa74784542af47 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a51f expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459992.482558:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4ac3677400/0x5dfa74784542af47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x50000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a51f expref: 12 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459992.482572:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4ac3677400/0x5dfa74784542af47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a51f expref: 12 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788459992.482583:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ac3677400, rc 0) 00000100:00100000:1.0:1788459992.482658:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd0a6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bed032f6-c389-485e-b2f7-e2ea34763c65+12:8705:x1875336003332736:12345-192.168.206.5@tcp:101:mount.lustre.0 Request processed in 185us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459992.482665:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 322 00000100:00100000:1.0:1788459992.493300:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788459992.493691:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003332864 00000100:00100000:0.0:1788459992.493705:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003332864 00000100:00100000:0.0:1788459992.493786:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 323 00000100:00100000:0.0:1788459992.493798:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd0a6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bed032f6-c389-485e-b2f7-e2ea34763c65+12:8705:x1875336003332864:12345-192.168.206.5@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788459992.494044:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd0a6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bed032f6-c389-485e-b2f7-e2ea34763c65+12:8705:x1875336003332864:12345-192.168.206.5@tcp:501:mount.lustre.0 Request processed in 247us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459992.494053:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 323 00000100:00100000:2.0:1788459992.505395:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788459992.506427:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003332992 00000100:00100000:0.0:1788459992.506443:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003332992 00000100:00100000:0.0:1788459992.506542:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 324 00000100:00100000:0.0:1788459992.506554:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd0a6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bed032f6-c389-485e-b2f7-e2ea34763c65+12:8705:x1875336003332992:12345-192.168.206.5@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788459992.506746:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd0a6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bed032f6-c389-485e-b2f7-e2ea34763c65+12:8705:x1875336003332992:12345-192.168.206.5@tcp:503:mount.lustre.0 Request processed in 192us (1363us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459992.506754:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 324 00000100:00100000:3.0:1788459992.514062:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788459992.514430:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003333120 00000100:00100000:0.0:1788459992.514443:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003333120 00000100:00100000:0.0:1788459992.514517:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 325 00000100:00100000:0.0:1788459992.514530:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd0a6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bed032f6-c389-485e-b2f7-e2ea34763c65+12:8709:x1875336003333120:12345-192.168.206.5@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788459992.514739:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd0a6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bed032f6-c389-485e-b2f7-e2ea34763c65+12:8709:x1875336003333120:12345-192.168.206.5@tcp:502:llog_process_th.0 Request processed in 211us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459992.514748:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 325 00000100:00100000:2.0:1788459992.550923:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788459992.551133:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003333248 00000100:00100000:1.0:1788459992.551147:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003333248 00000100:00100000:1.0:1788459992.551219:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 326 00000100:00100000:1.0:1788459992.551230:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd0a6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bed032f6-c389-485e-b2f7-e2ea34763c65+12:8709:x1875336003333248:12345-192.168.206.5@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788459992.551431:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd0a6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bed032f6-c389-485e-b2f7-e2ea34763c65+12:8709:x1875336003333248:12345-192.168.206.5@tcp:502:llog_process_th.0 Request processed in 203us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459992.551440:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 326 00000100:00100000:2.0:1788459992.560454:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788459992.560757:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003333376 00000100:00100000:3.0:1788459992.560771:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003333376 00000100:00100000:3.0:1788459992.560848:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 327 00000100:00100000:3.0:1788459992.560859:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd0a6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bed032f6-c389-485e-b2f7-e2ea34763c65+12:8709:x1875336003333376:12345-192.168.206.5@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788459992.562890:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd0a6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bed032f6-c389-485e-b2f7-e2ea34763c65+12:8709:x1875336003333376:12345-192.168.206.5@tcp:502:llog_process_th.0 Request processed in 2012us (2432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459992.562908:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 327 00000100:00100000:3.0:1788459992.568230:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788459992.571428:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003333504 00000100:00100000:0.0:1788459992.571451:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003333504 00000100:00100000:0.0:1788459992.571681:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 328 00000100:00100000:0.0:1788459992.571695:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd0a6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bed032f6-c389-485e-b2f7-e2ea34763c65+12:8705:x1875336003333504:12345-192.168.206.5@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788459992.571719:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788459992.571759:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4bef208600/0x5dfa74784542af4e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a550 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459992.571798:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bef208600/0x5dfa74784542af4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a550 expref: 13 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459992.571811:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4bef208600/0x5dfa74784542af4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a550 expref: 13 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459992.571822:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bef208600, rc 0) 00000100:00100000:0.0:1788459992.571931:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd0a6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bed032f6-c389-485e-b2f7-e2ea34763c65+13:8705:x1875336003333504:12345-192.168.206.5@tcp:101:mount.lustre.0 Request processed in 238us (3714us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459992.571939:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 328 00000100:00100000:2.0:1788459992.576895:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788459992.577243:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003333632 00000100:00100000:3.0:1788459992.577258:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003333632 00000100:00100000:3.0:1788459992.577337:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 329 00000100:00100000:3.0:1788459992.577349:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd0a6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bed032f6-c389-485e-b2f7-e2ea34763c65+13:8705:x1875336003333632:12345-192.168.206.5@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788459992.577388:0:6525:0:(mgs_nids.c:1209:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788459992.577422:0:6525:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788459992.577432:0:6525:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788459992.577436:0:6525:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788459992.577439:0:6525:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1788459992.577442:0:6525:0:(mgs_nids.c:325:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:3.0:1788459992.588593:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd0a6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bed032f6-c389-485e-b2f7-e2ea34763c65+13:8705:x1875336003333632:12345-192.168.206.5@tcp:256:mount.lustre.0 Request processed in 11229us (11695us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459992.588613:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 329 00000100:00100000:2.0:1788459992.594711:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788459992.596363:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003333760 00000100:00100000:0.0:1788459992.596380:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003333760 00000100:00100000:0.0:1788459992.596473:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 330 00000100:00100000:0.0:1788459992.596487:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd0a6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bed032f6-c389-485e-b2f7-e2ea34763c65+13:8705:x1875336003333760:12345-192.168.206.5@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788459992.596511:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788459992.596537:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4bef209800/0x5dfa74784542af55 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a557 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459992.596579:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bef209800/0x5dfa74784542af55 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a557 expref: 14 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459992.596592:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4bef209800/0x5dfa74784542af55 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a557 expref: 14 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788459992.596602:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bef209800, rc 0) 00000100:00100000:0.0:1788459992.596737:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd0a6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bed032f6-c389-485e-b2f7-e2ea34763c65+14:8705:x1875336003333760:12345-192.168.206.5@tcp:101:mount.lustre.0 Request processed in 252us (2042us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459992.596746:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 330 00000100:00100000:2.0:1788459992.601277:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788459992.601453:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003333888 00000100:00100000:3.0:1788459992.601466:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003333888 00000100:00100000:3.0:1788459992.601593:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 331 00000100:00100000:3.0:1788459992.601605:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd0a6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bed032f6-c389-485e-b2f7-e2ea34763c65+14:8705:x1875336003333888:12345-192.168.206.5@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788459992.601812:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd0a6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bed032f6-c389-485e-b2f7-e2ea34763c65+14:8705:x1875336003333888:12345-192.168.206.5@tcp:501:mount.lustre.0 Request processed in 208us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459992.601821:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 331 00000100:00100000:2.0:1788459992.604765:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788459992.604887:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003334016 00000100:00100000:1.0:1788459992.604901:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003334016 00000100:00100000:1.0:1788459992.605760:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 332 00000100:00100000:1.0:1788459992.605776:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bed032f6-c389-485e-b2f7-e2ea34763c65+14:8705:x1875336003334016:12345-192.168.206.5@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788459992.605987:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bed032f6-c389-485e-b2f7-e2ea34763c65+14:8705:x1875336003334016:12345-192.168.206.5@tcp:503:mount.lustre.0 Request processed in 215us (1236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459992.605997:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 332 00000100:00100000:2.0:1788459992.612014:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788459992.612099:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003334144 00000100:00100000:3.0:1788459992.612112:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003334144 00000100:00100000:3.0:1788459992.612189:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 333 00000100:00100000:3.0:1788459992.612200:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bed032f6-c389-485e-b2f7-e2ea34763c65+14:8714:x1875336003334144:12345-192.168.206.5@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788459992.612405:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bed032f6-c389-485e-b2f7-e2ea34763c65+14:8714:x1875336003334144:12345-192.168.206.5@tcp:502:llog_process_th.0 Request processed in 205us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459992.612414:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 333 00000100:00100000:2.0:1788459992.616792:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788459992.618408:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003334272 00000100:00100000:1.0:1788459992.618426:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003334272 00000100:00100000:1.0:1788459992.618509:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 334 00000100:00100000:1.0:1788459992.618521:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd0a6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bed032f6-c389-485e-b2f7-e2ea34763c65+14:8714:x1875336003334272:12345-192.168.206.5@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788459992.618742:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd0a6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bed032f6-c389-485e-b2f7-e2ea34763c65+14:8714:x1875336003334272:12345-192.168.206.5@tcp:502:llog_process_th.0 Request processed in 222us (1961us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459992.618751:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 334 00000100:00100000:2.0:1788459992.629093:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788459992.629127:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788459992.629172:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788459992.629211:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788459992.629301:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003334784 00000100:00100000:3.0:1788459992.629316:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003334784 00000100:00100000:3.0:1788459992.629392:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003334656 00000100:00100000:3.0:1788459992.629395:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003334656 00000100:00100000:3.0:1788459992.629409:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003334400 00000100:00100000:3.0:1788459992.629411:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003334400 00000100:00100000:3.0:1788459992.629418:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003334912 00000100:00100000:3.0:1788459992.629435:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003334912 00000100:00100000:3.0:1788459992.629450:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 117 00000100:00100000:3.0:1788459992.629461:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac2975180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2396:x1875336003334784:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:3.0:1788459992.629551:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac2975180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2396:x1875336003334784:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 92us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459992.629559:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 117 00000100:00100000:3.0:1788459992.629578:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 118 00000100:00100000:3.0:1788459992.629584:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac2974380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:2396:x1875336003334656:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:3.0:1788459992.629610:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac2974380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:2396:x1875336003334656:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 25us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459992.629615:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 118 00000100:00100000:3.0:1788459992.629628:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 16 00000100:00100000:3.0:1788459992.629632:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac2976d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2392:x1875336003334400:12345-192.168.206.5@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788459992.629658:0:7760:0:(ldlm_lib.c:1461:target_handle_connect()) lustre-MDT0000: connection from a5915a6d-4114-41fb-8d95-33add86e0720@192.168.206.5@tcp t0 exp 0000000000000000 cur 289 last 0 00000020:00000080:3.0:1788459992.629698:0:7760:0:(genops.c:1385:class_connect()) connect: client a5915a6d-4114-41fb-8d95-33add86e0720, cookie 0x5dfa74784542af5c 00000004:00100000:3.0:1788459992.629728:0:7760:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788459992.629868:0:7760:0:(import.c:65:import_set_state_nolock()) ffff8c4ac3ae6800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788459992.629901:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac2976d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a5915a6d-4114-41fb-8d95-33add86e0720+6:2392:x1875336003334400:12345-192.168.206.5@tcp:38:mount.lustre.0 Request processed in 267us (728us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459992.629908:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 16 00000100:00100000:3.0:1788459992.629921:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 17 00000100:00100000:3.0:1788459992.629926:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac366a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2392:x1875336003334912:12345-192.168.206.5@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788459992.629973:0:7760:0:(ldlm_lib.c:1461:target_handle_connect()) lustre-MDT0001: connection from a5915a6d-4114-41fb-8d95-33add86e0720@192.168.206.5@tcp t0 exp 0000000000000000 cur 289 last 0 00000020:00000080:3.0:1788459992.630002:0:7760:0:(genops.c:1385:class_connect()) connect: client a5915a6d-4114-41fb-8d95-33add86e0720, cookie 0x5dfa74784542af63 00000004:00100000:3.0:1788459992.630023:0:7760:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788459992.630085:0:7760:0:(import.c:65:import_set_state_nolock()) ffff8c4ac3ae4800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788459992.630108:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac366a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a5915a6d-4114-41fb-8d95-33add86e0720+6:2392:x1875336003334912:12345-192.168.206.5@tcp:38:mount.lustre.0 Request processed in 181us (897us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459992.630115:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 17 00000100:00080000:2.0:1788459992.630496:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788459992.630501:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788459992.650298:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788459992.650333:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788459992.650414:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788459992.650611:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003335168 00000100:00100000:0.0:1788459992.650623:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003335168 00000100:00100000:0.0:1788459992.650698:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003334528 00000100:00100000:0.0:1788459992.650701:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003334528 00000100:00100000:0.0:1788459992.650709:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003335040 00000100:00100000:0.0:1788459992.650711:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003335040 00000100:00100000:0.0:1788459992.650729:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 18 00000100:00100000:0.0:1788459992.650739:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac366ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a5915a6d-4114-41fb-8d95-33add86e0720+7:8705:x1875336003335168:12345-192.168.206.5@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788459992.650808:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788459992.650917:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac366ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a5915a6d-4114-41fb-8d95-33add86e0720+7:8705:x1875336003335168:12345-192.168.206.5@tcp:41:mount.lustre.0 Request processed in 179us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459992.650925:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 18 00000100:00100000:0.0:1788459992.650966:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 19 00000100:00100000:0.0:1788459992.650973:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac366b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a5915a6d-4114-41fb-8d95-33add86e0720+6:0:x1875336003334528:12345-192.168.206.5@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788459992.650986:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788459992.651006:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac366b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a5915a6d-4114-41fb-8d95-33add86e0720+6:0:x1875336003334528:12345-192.168.206.5@tcp:41:mount.lustre.0 Request processed in 34us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459992.651011:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 19 00000100:00100000:0.0:1788459992.651021:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 20 00000100:00100000:0.0:1788459992.651027:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf75e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a5915a6d-4114-41fb-8d95-33add86e0720+6:0:x1875336003335040:12345-192.168.206.5@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788459992.651037:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446453248 avail 1300213760 00000100:00100000:0.0:1788459992.651067:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf75e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a5915a6d-4114-41fb-8d95-33add86e0720+6:0:x1875336003335040:12345-192.168.206.5@tcp:41:mount.lustre.0 Request processed in 40us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459992.651084:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 20 00000100:00080000:2.0:1788459992.651821:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788459992.651828:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788459992.657524:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac36cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3662:1875336022284800:0@lo:400:kworker.0 00000100:00100000:2.0:1788459992.657655:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459992.657730:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac36cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3662:1875336022285312:0@lo:400:kworker.0 00000100:00100000:2.0:1788459992.657754:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459992.657782:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac36cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1875336022285824:0@lo:400:kworker.0 00000100:00100000:2.0:1788459992.657805:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459992.657834:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788459992.657841:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac36cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0cf73fe6-82e2-434e-b670-631647721b2c:3662:1875336022284672:0@lo:400:kworker.0 00000100:00100000:2.0:1788459992.657873:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459992.657895:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac36cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3662:1875336022285184:0@lo:400:kworker.0 00000100:00100000:2.0:1788459992.657919:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459992.657937:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac36cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3662:1875336022285696:0@lo:400:kworker.0 00000100:00100000:2.0:1788459992.658004:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459992.658029:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac36cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3660:1875336022285056:0@lo:400:kworker.0 00000100:00100000:2.0:1788459992.658053:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459992.658066:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac36cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022285568:0@lo:400:kworker.0 00000100:00100000:2.0:1788459992.658182:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459992.658207:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac36cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022286080:0@lo:400:kworker.0 00000100:00100000:2.0:1788459992.658230:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459992.658250:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788459992.658256:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac36ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022284928:0@lo:400:kworker.0 00000100:00100000:2.0:1788459992.658283:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459992.658301:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac36cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022285440:0@lo:400:kworker.0 00000100:00100000:2.0:1788459992.658320:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459992.658338:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac36cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022285952:0@lo:400:kworker.0 00000100:00100000:2.0:1788459992.658371:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459992.658419:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022285568 00000100:00100000:2.0:1788459992.658429:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022285568 00000100:00100000:2.0:1788459992.658490:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022286080 00000100:00100000:2.0:1788459992.658493:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022286080 00000100:00100000:2.0:1788459992.658506:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022285440 00000100:00100000:2.0:1788459992.658508:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022285440 00000100:00100000:2.0:1788459992.658520:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022285952 00000100:00100000:2.0:1788459992.658523:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022285952 00000100:00100000:2.0:1788459992.658540:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788459992.658549:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc471a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022285568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788459992.658605:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc471a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022285568:12345-0@lo:400:kworker.0 Request processed in 57us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459992.658614:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788459992.658631:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788459992.658637:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf7713b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022286080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788459992.658663:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf7713b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022286080:12345-0@lo:400:kworker.0 Request processed in 27us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459992.658669:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788459992.658678:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788459992.658684:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf7713800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022285440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788459992.658707:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf7713800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022285440:12345-0@lo:400:kworker.0 Request processed in 24us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459992.658713:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788459992.658723:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788459992.658728:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf7712300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022285952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788459992.658754:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf7712300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022285952:12345-0@lo:400:kworker.0 Request processed in 26us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459992.658768:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788459992.658797:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022284800 00000100:00100000:2.0:1788459992.658802:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022284800 00000100:00100000:2.0:1788459992.658821:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022285312 00000100:00100000:2.0:1788459992.658823:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022285312 00000100:00100000:2.0:1788459992.658835:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022285824 00000100:00100000:2.0:1788459992.658837:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022285824 00000100:00100000:2.0:1788459992.658848:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022285184 00000100:00100000:2.0:1788459992.658851:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022285184 00000100:00100000:2.0:1788459992.658862:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022285696 00000100:00100000:2.0:1788459992.658864:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022285696 00000100:00100000:2.0:1788459992.658875:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022285056 00000100:00100000:2.0:1788459992.658877:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022285056 00000100:00100000:2.0:1788459992.658889:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788459992.658895:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf75e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1875336022284800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788459992.658933:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf75e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1875336022284800:12345-0@lo:400:kworker.0 Request processed in 38us (1279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459992.658940:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788459992.658985:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788459992.658992:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf75e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875336022285312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788459992.659040:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf75e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875336022285312:12345-0@lo:400:kworker.0 Request processed in 49us (1285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459992.659048:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788459992.659060:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788459992.659067:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3af9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875336022285824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788459992.659216:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788459992.659227:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3af8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1875336022285184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788459992.659266:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3af8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1875336022285184:12345-0@lo:400:kworker.0 Request processed in 43us (1347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459992.659273:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788459992.659286:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788459992.659292:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3af9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1875336022285696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788459992.659333:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3af9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1875336022285696:12345-0@lo:400:kworker.0 Request processed in 41us (1328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459992.659340:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788459992.659352:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788459992.659358:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3af9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1875336022285056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788459992.659386:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3af9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1875336022285056:12345-0@lo:400:kworker.0 Request processed in 29us (1332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459992.659392:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:1.0:1788459992.659436:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788459992.659442:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788459992.659445:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788459992.659447:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788459992.659483:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac36cca80 x1875336022285440/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788460008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788459992.659501:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac36cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022285440:0@lo:400:kworker.0 00010000:00080000:1.0:1788459992.659513:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac36cfb80 x1875336022285952/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788460008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788459992.659523:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac36cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022285952:0@lo:400:kworker.0 00000100:00100000:1.0:1788459992.659534:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac36cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3660:1875336022285056:0@lo:400:kworker.0 00010000:00080000:1.0:1788459992.659544:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac36cd180 x1875336022285568/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788460008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788459992.659553:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac36cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022285568:0@lo:400:kworker.0 00010000:00080000:1.0:1788459992.659564:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac36cf480 x1875336022286080/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788460008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788459992.659586:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac36cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022286080:0@lo:400:kworker.0 00000100:00100000:1.0:1788459992.659638:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac36cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3662:1875336022285184:0@lo:400:kworker.0 00000100:00100000:1.0:1788459992.659649:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac36cf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3662:1875336022285696:0@lo:400:kworker.0 00000100:00100000:1.0:1788459992.659659:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac36cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3662:1875336022284800:0@lo:400:kworker.0 00010000:00080000:1.0:1788459992.659671:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac36cd880 x1875336022285312/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788459992.659681:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac36cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3662:1875336022285312:0@lo:400:kworker.0 00000100:00100000:3.0:1788459992.660068:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022284928 00000100:00100000:3.0:1788459992.660085:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022284928 00000100:00100000:3.0:1788459992.660137:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788459992.660145:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf7711c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022284928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788459992.660222:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf7711c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022284928:12345-0@lo:400:kworker.0 Request processed in 78us (1938us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459992.660229:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788459992.660261:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac36ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022284928:0@lo:400:kworker.0 00000100:00100000:3.0:1788459992.660693:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788459992.661352:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf76ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022286208:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788459992.661406:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459992.661458:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022286208 00000100:00100000:0.0:1788459992.661465:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022286208 00000100:00100000:0.0:1788459992.661508:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788459992.661516:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf76ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022286208:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788459992.661549:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788459992.661590:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf76ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022286208:12345-0@lo:13:osp-pre-1-1.0 Request processed in 75us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459992.661612:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:0.0:1788459992.661654:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bf76ed180 x1875336022286208/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460008 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788459992.661673:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf76ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022286208:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788459992.661699:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022284672 00000100:00100000:0.0:1788459992.661702:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022284672 00000100:00100000:0.0:1788459992.661733:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:0.0:1788459992.661740:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+29:3662:x1875336022284672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788459992.661777:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+29:3662:x1875336022284672:12345-0@lo:400:kworker.0 Request processed in 38us (3902us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459992.661783:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:0.0:1788459992.661842:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac36cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0cf73fe6-82e2-434e-b670-631647721b2c:3662:1875336022284672:0@lo:400:kworker.0 00000100:00100000:2.0:1788459992.661998:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3af9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875336022285824:12345-0@lo:400:kworker.0 Request processed in 2930us (4190us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459992.662008:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788459992.662036:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003335296 00000100:00100000:2.0:1788459992.662040:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003335296 00000100:00100000:3.0:1788459992.662169:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788459992.662179:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac36cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022286336:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788459992.662211:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459992.662238:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022286336 00000100:00100000:3.0:1788459992.662242:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022286336 00000100:00100000:3.0:1788459992.662265:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788459992.662271:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac36cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1875336022286336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788459992.662283:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788459992.662310:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac36cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1875336022286336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 39us (98us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459992.662317:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:3.0:1788459992.662342:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac36cea00 x1875336022286336/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460008 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788459992.662369:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac36cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022286336:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1788459992.662660:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac36cc380 x1875336022285824/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788459992.662672:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac36cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1875336022285824:0@lo:400:kworker.0 00000100:00100000:1.0:1788459992.663445:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 21 00000100:00100000:1.0:1788459992.663462:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac36ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a5915a6d-4114-41fb-8d95-33add86e0720+6:8705:x1875336003335296:12345-192.168.206.5@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788459992.663585:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac36ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a5915a6d-4114-41fb-8d95-33add86e0720+6:8705:x1875336003335296:12345-192.168.206.5@tcp:40:mount.lustre.0 Request processed in 129us (2893us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459992.663594:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 21 00000100:00100000:0.0:1788459992.666411:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788459992.666510:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788459992.666663:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788459992.666811:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003335424 00000100:00100000:2.0:1788459992.666824:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003335424 00000100:00100000:2.0:1788459992.666870:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003335552 00000100:00100000:2.0:1788459992.666872:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003335552 00000100:00100000:2.0:1788459992.666893:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 20 00000100:00100000:2.0:1788459992.666901:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf76ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2392:x1875336003335424:12345-192.168.206.5@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788459992.666940:0:8450:0:(ldlm_lib.c:1461:target_handle_connect()) lustre-OST0000: connection from a5915a6d-4114-41fb-8d95-33add86e0720@192.168.206.5@tcp t0 exp 0000000000000000 cur 289 last 0 00000020:00000080:2.0:1788459992.667014:0:8450:0:(genops.c:1385:class_connect()) connect: client a5915a6d-4114-41fb-8d95-33add86e0720, cookie 0x5dfa74784542af6a 00002000:00100000:2.0:1788459992.667030:0:8450:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a5915a6d-4114-41fb-8d95-33add86e0720/ffff8c4ac2be7000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a07 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788459992.667052:0:8450:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788459992.667148:0:8450:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788459992.667194:0:8450:0:(import.c:65:import_set_state_nolock()) ffff8c4ac2be0000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788459992.667261:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf76ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a5915a6d-4114-41fb-8d95-33add86e0720+6:2392:x1875336003335424:12345-192.168.206.5@tcp:8:mount.lustre.0 Request processed in 360us (863us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459992.667269:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 20 00000100:00100000:2.0:1788459992.667285:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 21 00000100:00100000:2.0:1788459992.667289:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf76ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2392:x1875336003335552:12345-192.168.206.5@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788459992.667304:0:8450:0:(ldlm_lib.c:1461:target_handle_connect()) lustre-OST0001: connection from a5915a6d-4114-41fb-8d95-33add86e0720@192.168.206.5@tcp t0 exp 0000000000000000 cur 289 last 0 00000020:00000080:2.0:1788459992.667318:0:8450:0:(genops.c:1385:class_connect()) connect: client a5915a6d-4114-41fb-8d95-33add86e0720, cookie 0x5dfa74784542af71 00002000:00100000:2.0:1788459992.667323:0:8450:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a5915a6d-4114-41fb-8d95-33add86e0720/ffff8c4ac2be6800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a07 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788459992.667330:0:8450:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788459992.667379:0:8450:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788459992.667396:0:8450:0:(import.c:65:import_set_state_nolock()) ffff8c4ac2be6000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788459992.667398:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003335680 00000100:00100000:1.0:1788459992.667405:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003335680 00000100:00100000:2.0:1788459992.667423:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf76ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a5915a6d-4114-41fb-8d95-33add86e0720+6:2392:x1875336003335552:12345-192.168.206.5@tcp:8:mount.lustre.0 Request processed in 131us (912us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459992.667448:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 21 00000100:00100000:1.0:1788459992.667455:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 5 00000100:00100000:1.0:1788459992.667467:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf76efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a5915a6d-4114-41fb-8d95-33add86e0720+6:8705:x1875336003335680:12345-192.168.206.5@tcp:900:mount.lustre.0 00000100:00100000:1.0:1788459992.667708:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf76efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a5915a6d-4114-41fb-8d95-33add86e0720+6:8705:x1875336003335680:12345-192.168.206.5@tcp:900:mount.lustre.0 Request processed in 242us (1044us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459992.667717:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 5 00000100:00100000:0.0:1788459992.669565:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788459992.669647:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003335808 00000100:00100000:3.0:1788459992.669660:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003335808 00000100:00100000:3.0:1788459992.669722:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 1 00000100:00100000:3.0:1788459992.669731:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf76ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a5915a6d-4114-41fb-8d95-33add86e0720+6:8705:x1875336003335808:12345-192.168.206.5@tcp:33:mount.lustre.0 00000004:00200000:3.0:1788459992.669845:0:6536:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788459992.669935:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf76ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a5915a6d-4114-41fb-8d95-33add86e0720+6:8705:x1875336003335808:12345-192.168.206.5@tcp:33:mount.lustre.0 Request processed in 206us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459992.670236:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 1 00010000:00010000:3.0:1788459992.851163:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788459993.873736:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788459994.899101:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788459995.733337:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788459995.733371:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3a32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022286464:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788459995.733451:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459995.733515:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022286464 00000100:00100000:1.0:1788459995.733522:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022286464 00000100:00100000:1.0:1788459995.733572:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788459995.733581:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3a31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022286464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788459995.733607:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788459995.733651:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3a31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022286464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459995.733657:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1788459995.733676:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788459995.733705:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3a32d80 x1875336022286464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460011 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788459995.733727:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3a32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022286464:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788459995.926062:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788459996.241224:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788459996.241244:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf76edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022286720:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788459996.241309:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459996.241524:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3a32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022286592:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788459996.241559:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459996.241643:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022286592 00000100:00100000:1.0:1788459996.241651:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022286592 00000100:00100000:1.0:1788459996.241717:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788459996.241726:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf7712a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022286592:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788459996.241746:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788459996.241793:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf7712a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022286592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459996.241800:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:1.0:1788459996.241837:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3a32d80 x1875336022286592/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460012 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788459996.241853:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3a32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022286592:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788459996.241966:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788459996.242234:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022286720 00000100:00100000:3.0:1788459996.242239:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022286720 00000100:00100000:3.0:1788459996.242277:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788459996.242285:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf76ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022286720:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788459996.242309:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788459996.242354:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf76ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022286720:12345-0@lo:41:osp-pre-0-1.0 Request processed in 70us (1045us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459996.242361:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788459996.242449:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf76edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022286720:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788459996.945274:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788459997.266188:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3a32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022286848:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788459997.266260:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788459997.266437:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022286848 00000100:00100000:1.0:1788459997.266457:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022286848 00000100:00100000:1.0:1788459997.266512:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788459997.266521:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf76edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1875336022286848:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788459997.266553:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446453248 avail 1300213760 00000100:00100000:1.0:1788459997.266611:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf76edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1875336022286848:12345-0@lo:41:osp-pre-1-0.0 Request processed in 92us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459997.266629:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788459997.266907:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3a32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022286848:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788459997.777275:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788459997.777298:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac36cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022286976:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788459997.777363:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788459997.777587:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022286976 00000100:00100000:3.0:1788459997.777595:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022286976 00000100:00100000:3.0:1788459997.777700:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788459997.777711:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3a31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022286976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788459997.777741:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788459997.777801:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3a31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022286976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459997.777809:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788459997.778395:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf76ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875336022287232:0@lo:400:kworker.0 00000100:00100000:0.0:1788459997.778432:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459997.778452:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf76ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1875336022287744:0@lo:400:kworker.0 00000100:00100000:0.0:1788459997.778472:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459997.778486:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf76ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1875336022288256:0@lo:400:kworker.0 00000100:00100000:0.0:1788459997.778502:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459997.778530:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788459997.778535:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf76eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022287360:0@lo:400:kworker.0 00000100:00100000:0.0:1788459997.778575:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459997.778603:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf76ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022287872:0@lo:400:kworker.0 00000100:00100000:0.0:1788459997.778625:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459997.778640:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfa359500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022288384:0@lo:400:kworker.0 00000100:00100000:0.0:1788459997.778655:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788459997.778682:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022287872 00000100:00100000:0.0:1788459997.778686:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022287872 00000100:00100000:0.0:1788459997.778713:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022288384 00000100:00100000:0.0:1788459997.778715:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022288384 00000100:00100000:1.0:1788459997.778772:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022287232 00000100:00100000:1.0:1788459997.778776:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022287232 00000100:00100000:1.0:1788459997.778815:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022287744 00000100:00100000:1.0:1788459997.778819:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022287744 00000100:00100000:3.0:1788459997.778889:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022288256 00000100:00100000:3.0:1788459997.778892:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022288256 00000100:00080000:2.0:1788459997.779523:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788459997.779529:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788459997.779546:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788459997.779557:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfa359880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1875336022287232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788459997.779635:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfa359880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1875336022287232:12345-0@lo:400:kworker.0 Request processed in 82us (1202us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459997.779642:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788459997.779681:0:8832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788459997.779689:0:8832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfa358380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022287872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788459997.779720:0:8832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfa358380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022287872:12345-0@lo:400:kworker.0 Request processed in 33us (1094us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459997.779726:0:8832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788459997.779764:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf76ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1875336022287488:0@lo:400:kworker.0 00000100:00100000:2.0:1788459997.779791:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459997.779819:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf76eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022288000:0@lo:400:kworker.0 00000100:00100000:2.0:1788459997.779840:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459997.779855:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac36ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022288512:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788459997.779872:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459997.779891:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788459997.779897:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf76edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0cf73fe6-82e2-434e-b670-631647721b2c:3659:1875336022287104:0@lo:400:kworker.0 00000100:00100000:2.0:1788459997.779935:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459997.780169:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf76ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1875336022287616:0@lo:400:kworker.0 00000100:00100000:2.0:1788459997.780194:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459997.780204:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf76ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1875336022288128:0@lo:400:kworker.0 00000100:00100000:2.0:1788459997.780219:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788459997.780238:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022287488 00000100:00100000:2.0:1788459997.780243:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022287488 00000100:00100000:2.0:1788459997.780263:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022287616 00000100:00100000:2.0:1788459997.780265:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022287616 00000100:00100000:2.0:1788459997.780282:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022288128 00000100:00100000:2.0:1788459997.780285:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022288128 00000100:00100000:2.0:1788459997.780296:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788459997.780301:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf7711f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1875336022287488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788459997.780333:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf7711f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1875336022287488:12345-0@lo:400:kworker.0 Request processed in 32us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459997.780339:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788459997.780350:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788459997.780533:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac383a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1875336022287616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788459997.780563:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac383a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1875336022287616:12345-0@lo:400:kworker.0 Request processed in 208us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459997.780569:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788459997.780582:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788459997.780589:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac383b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1875336022288128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788459997.780696:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac383b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1875336022288128:12345-0@lo:400:kworker.0 Request processed in 27us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459997.780704:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788459997.780749:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf76ee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1875336022287616:0@lo:400:kworker.0 00000100:00100000:2.0:1788459997.780760:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf76ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1875336022288128:0@lo:400:kworker.0 00000100:00100000:2.0:1788459997.780771:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf76ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1875336022287488:0@lo:400:kworker.0 00000100:00100000:2.0:1788459997.780798:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022287360 00000100:00100000:2.0:1788459997.780803:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022287360 00000100:00100000:2.0:1788459997.780831:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788459997.780838:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfa35b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022287360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788459997.780871:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfa35b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022287360:12345-0@lo:400:kworker.0 Request processed in 34us (2296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459997.780877:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:2.0:1788459997.780896:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788459997.780919:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022287104 00000100:00100000:2.0:1788459997.780922:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022287104 00000100:00100000:2.0:1788459997.781511:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1788459997.781523:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+29:3659:x1875336022287104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788459997.781570:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+29:3659:x1875336022287104:12345-0@lo:400:kworker.0 Request processed in 51us (1634us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459997.781576:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1788459997.781612:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf76edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0cf73fe6-82e2-434e-b670-631647721b2c:3659:1875336022287104:0@lo:400:kworker.0 00000100:00100000:2.0:1788459997.781644:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022288512 00000100:00100000:2.0:1788459997.781648:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022288512 00000100:00100000:2.0:1788459997.781667:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788459997.781673:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf7710380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3659:x1875336022288512:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788459997.781686:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788459997.781717:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf7710380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3659:x1875336022288512:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (1844us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459997.781733:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:2.0:1788459997.781760:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac36ced80 x1875336022288512/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460013 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788459997.781778:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac36ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022288512:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788459997.781827:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022288000 00000100:00100000:2.0:1788459997.781831:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022288000 00000100:00100000:2.0:1788459997.781863:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788459997.781869:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf7711880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022288000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788459997.781903:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf7711880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022288000:12345-0@lo:400:kworker.0 Request processed in 34us (2062us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459997.781909:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:2.0:1788459997.781934:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bf76eed80 x1875336022288000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788460013 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788459997.782103:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788459997.782110:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfa35bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022288384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788459997.782158:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfa35bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022288384:12345-0@lo:400:kworker.0 Request processed in 48us (3500us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459997.782164:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:0.0:1788459997.782221:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac36cea00 x1875336022286976/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460013 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788459997.782235:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac36cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022286976:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788459997.782282:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf76eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022287360:0@lo:400:kworker.0 00010000:00080000:0.0:1788459997.782294:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bf76ef480 x1875336022287872/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788460013 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788459997.782303:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf76ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022287872:0@lo:400:kworker.0 00010000:00080000:0.0:1788459997.782312:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bfa359500 x1875336022288384/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788460013 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788459997.782319:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfa359500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022288384:0@lo:400:kworker.0 00000100:00100000:0.0:1788459997.782329:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf76ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875336022287232:0@lo:400:kworker.0 00000100:00100000:2.0:1788459997.783471:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf76eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022288000:0@lo:400:kworker.0 00000100:00080000:2.0:1788459997.783507:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788459997.783691:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788459997.783700:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfa358a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1875336022287744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788459997.783766:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfa358a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1875336022287744:12345-0@lo:400:kworker.0 Request processed in 68us (5293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788459997.783773:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00010000:00080000:1.0:1788459997.783817:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bf76ee300 x1875336022287744/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460013 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788459997.783828:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf76ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1875336022287744:0@lo:400:kworker.0 00000100:00100000:3.0:1788459997.784870:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788459997.784880:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfa359180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1875336022288256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788459997.784976:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfa359180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1875336022288256:12345-0@lo:400:kworker.0 Request processed in 98us (6472us total) trans 0 rc 0/0 00000100:00100000:3.0:1788459997.784983:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00010000:00080000:1.0:1788459997.785139:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bf76ed880 x1875336022288256/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460013 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788459997.785151:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf76ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1875336022288256:0@lo:400:kworker.0 00010000:00010000:3.0:1788459997.972176:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788459998.147463:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788459998.147505:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788459998.147538:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788459998.147567:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788459998.147595:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003336192 00000100:00100000:3.0:1788459998.147604:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003336192 00000100:00100000:0.0:1788459998.147630:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003335936 00000100:00100000:0.0:1788459998.147637:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003335936 00000100:00100000:3.0:1788459998.147659:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003336448 00000100:00100000:3.0:1788459998.147664:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003336448 00000100:00100000:0.0:1788459998.147679:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 337 00000100:00100000:0.0:1788459998.147692:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bed032f6-c389-485e-b2f7-e2ea34763c65+14:2396:x1875336003335936:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:3.0:1788459998.147698:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 131 00000100:00100000:0.0:1788459998.147760:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bed032f6-c389-485e-b2f7-e2ea34763c65+14:2396:x1875336003335936:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 71us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788459998.147767:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 337 00000100:00100000:3.0:1788459998.148173:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac36cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2396:x1875336003336192:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:3.0:1788459998.148209:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac36cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2396:x1875336003336192:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 41us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459998.153056:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 132 00000100:00100000:2.0:1788459998.153075:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac36cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a5915a6d-4114-41fb-8d95-33add86e0720+6:2396:x1875336003336448:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:2.0:1788459998.153155:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac36cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a5915a6d-4114-41fb-8d95-33add86e0720+6:2396:x1875336003336448:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 89us (5616us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459998.153163:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 132 00000100:00100000:2.0:1788459998.153204:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003336704 00000100:00100000:2.0:1788459998.153211:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003336704 00000100:00100000:2.0:1788459998.153971:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 54 00000100:00100000:2.0:1788459998.153980:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac36cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5915a6d-4114-41fb-8d95-33add86e0720+6:2396:x1875336003336704:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:2.0:1788459998.154021:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac36cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5915a6d-4114-41fb-8d95-33add86e0720+6:2396:x1875336003336704:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 43us (6453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459998.154028:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 54 00000100:00080000:2.0:1788459998.154046:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788459998.154050:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788459998.154093:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788459998.154161:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788459998.154187:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788459998.155072:0:8832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003336576 00000100:00100000:2.0:1788459998.155081:0:8832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003336576 00000100:00100000:2.0:1788459998.155141:0:8832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 55 00000100:00100000:2.0:1788459998.155150:0:8832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3839f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a5915a6d-4114-41fb-8d95-33add86e0720+6:2395:x1875336003336576:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:2.0:1788459998.155198:0:8832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3839f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a5915a6d-4114-41fb-8d95-33add86e0720+6:2395:x1875336003336576:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 50us (1010us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459998.155206:0:8832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 55 00000100:00080000:2.0:1788459998.155221:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788459998.155262:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003336064 00000100:00100000:2.0:1788459998.155266:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003336064 00000100:00100000:2.0:1788459998.155290:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003336320 00000100:00100000:2.0:1788459998.155293:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003336320 00000100:00100000:2.0:1788459998.155310:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 133 00000100:00100000:2.0:1788459998.155316:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3838a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:2395:x1875336003336064:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:2.0:1788459998.155360:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3838a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:2395:x1875336003336064:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 43us (1266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459998.155368:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 133 00000100:00100000:2.0:1788459998.155380:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 134 00000100:00100000:2.0:1788459998.155387:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3838000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a5915a6d-4114-41fb-8d95-33add86e0720+6:2395:x1875336003336320:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:2.0:1788459998.155419:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3838000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a5915a6d-4114-41fb-8d95-33add86e0720+6:2395:x1875336003336320:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 33us (1258us total) trans 0 rc 0/0 00000100:00100000:2.0:1788459998.155426:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 134 00000100:00080000:2.0:1788459998.155441:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788459998.164412:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 131 00000001:02000400:0.0:1788459998.560746:0:12202:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg605-client.virtnet: executing check_config_client /mnt/lustre 00000001:00100000:3.0:1788459998.803873:0:9527:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a5915a6d-4114-41fb-8d95-33add86e0720 00000001:00100000:2.0:1788459998.804660:0:8443:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a5915a6d-4114-41fb-8d95-33add86e0720 00000001:00100000:0.0:1788459998.805501:0:6513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a5915a6d-4114-41fb-8d95-33add86e0720 00000001:00100000:1.0:1788459998.807518:0:7465:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of a5915a6d-4114-41fb-8d95-33add86e0720 00010000:00010000:0.0:1788459998.993587:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460000.020245:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788460000.849131:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788460000.849153:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3a30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022288640:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788460000.849218:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460000.849360:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022288640 00000100:00100000:1.0:1788460000.849368:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022288640 00000100:00100000:1.0:1788460000.849427:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788460000.849438:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac383b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022288640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788460000.849465:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788460000.849510:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac383b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022288640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460000.849517:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:1.0:1788460000.849554:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3a30a80 x1875336022288640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460016 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460000.849571:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3a30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022288640:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788460000.852739:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788460001.041918:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788460001.361139:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788460001.361161:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3a30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022288768:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788460001.361221:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460001.361382:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022288768 00000100:00100000:1.0:1788460001.361390:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022288768 00000100:00100000:1.0:1788460001.361491:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788460001.361501:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3838380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022288768:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788460001.361522:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788460001.361567:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3838380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022288768:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460001.361574:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:1.0:1788460001.361610:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3a30a80 x1875336022288768/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460017 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460001.361626:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3a30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022288768:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788460001.361692:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788460001.365439:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3a30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022288896:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788460001.365501:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460001.366036:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022288896 00000100:00100000:3.0:1788460001.366045:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022288896 00000100:00100000:3.0:1788460001.366127:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788460001.366137:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac383aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022288896:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788460001.366171:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788460001.380888:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac383aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022288896:12345-0@lo:41:osp-pre-0-1.0 Request processed in 14743us (15376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460001.380903:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788460001.381583:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3a30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022288896:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788460002.065232:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460002.386519:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788460002.386550:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3839880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022289024:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788460002.386631:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460002.387827:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022289024 00000100:00100000:1.0:1788460002.387838:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022289024 00000100:00100000:1.0:1788460002.387890:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788460002.387900:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac36ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022289024:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788460002.387938:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446453248 avail 1300213760 00000100:00100000:1.0:1788460002.388024:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac36ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022289024:12345-0@lo:41:osp-pre-1-0.0 Request processed in 126us (1392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460002.388032:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788460002.388127:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3839880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022289024:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788460002.897509:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3838e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022289280:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788460002.897599:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460002.897668:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022289280 00000100:00100000:2.0:1788460002.897675:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022289280 00000100:00100000:2.0:1788460002.897722:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788460002.897731:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3839880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022289280:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788460002.897771:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788460002.897812:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3839880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022289280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460002.897833:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:2.0:1788460002.898069:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788460002.898108:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3838e00 x1875336022289280/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460018 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460002.898125:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3838e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022289280:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788460002.898402:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfa359500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0cf73fe6-82e2-434e-b670-631647721b2c:3662:1875336022289408:0@lo:400:kworker.0 00000100:00100000:2.0:1788460002.898436:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460002.898464:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfa359f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022289920:0@lo:400:kworker.0 00000100:00100000:2.0:1788460002.898486:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460002.898503:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfa35a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022290432:0@lo:400:kworker.0 00000100:00100000:2.0:1788460002.898523:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460002.898599:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3bdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022290944:0@lo:400:kworker.0 00000100:00100000:2.0:1788460002.898623:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460002.898650:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788460002.898656:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfa35b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3662:1875336022289792:0@lo:400:kworker.0 00000100:00100000:2.0:1788460002.898681:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460002.898698:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfa358700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022290304:0@lo:400:kworker.0 00000100:00100000:2.0:1788460002.898717:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460002.898732:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfa35ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022290816:0@lo:400:kworker.0 00000100:00100000:2.0:1788460002.898749:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460002.898777:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022289408 00000100:00100000:2.0:1788460002.898782:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022289408 00000100:00100000:2.0:1788460002.898811:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1788460002.898819:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+29:3662:x1875336022289408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460002.898874:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+29:3662:x1875336022289408:12345-0@lo:400:kworker.0 Request processed in 56us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460002.898881:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1788460002.898908:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022289920 00000100:00100000:2.0:1788460002.898912:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022289920 00000100:00100000:2.0:1788460002.898934:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788460002.898939:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3838e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1875336022289920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460002.899003:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3838e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1875336022289920:12345-0@lo:400:kworker.0 Request processed in 62us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460002.899009:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788460002.899025:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022290432 00000100:00100000:2.0:1788460002.899029:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022290432 00000100:00100000:2.0:1788460002.899052:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022290944 00000100:00100000:2.0:1788460002.899055:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022290944 00000100:00100000:2.0:1788460002.899067:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022290304 00000100:00100000:2.0:1788460002.899069:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022290304 00000100:00100000:2.0:1788460002.899078:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022290816 00000100:00100000:2.0:1788460002.899080:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022290816 00000100:00100000:2.0:1788460002.899091:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788460002.899116:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf76ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1875336022290432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460002.899144:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf76ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1875336022290432:12345-0@lo:400:kworker.0 Request processed in 47us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460002.899150:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788460002.899162:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788460002.899168:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf76ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1875336022290944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460002.899192:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf76ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1875336022290944:12345-0@lo:400:kworker.0 Request processed in 24us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460002.899340:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788460002.899354:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788460002.899362:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf76ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022290304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460002.899391:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf76ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022290304:12345-0@lo:400:kworker.0 Request processed in 31us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460002.899396:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788460002.899405:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788460002.899410:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf76ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022290816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460002.899432:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf76ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022290816:12345-0@lo:400:kworker.0 Request processed in 22us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460002.899437:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788460002.899454:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022289792 00000100:00100000:2.0:1788460002.899458:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022289792 00000100:00100000:2.0:1788460002.899480:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788460002.899485:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf76eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1875336022289792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460002.899512:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf76eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1875336022289792:12345-0@lo:400:kworker.0 Request processed in 27us (831us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460002.899517:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:2.0:1788460002.899538:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788460002.899541:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788460002.899563:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfa35b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3662:1875336022289792:0@lo:400:kworker.0 00010000:00080000:2.0:1788460002.899576:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bfa358700 x1875336022290304/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788460018 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460002.899585:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfa358700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022290304:0@lo:400:kworker.0 00010000:00080000:2.0:1788460002.899594:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bfa35ad80 x1875336022290816/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788460018 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460002.899608:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfa35ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022290816:0@lo:400:kworker.0 00010000:00080000:2.0:1788460002.899619:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3bdbb80 x1875336022290944/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788460018 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460002.899625:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3bdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022290944:0@lo:400:kworker.0 00000100:00100000:2.0:1788460002.899633:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfa359f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022289920:0@lo:400:kworker.0 00010000:00080000:2.0:1788460002.899641:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bfa35a680 x1875336022290432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788460018 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460002.899649:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfa35a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022290432:0@lo:400:kworker.0 00000100:00100000:2.0:1788460002.899658:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfa359500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0cf73fe6-82e2-434e-b670-631647721b2c:3662:1875336022289408:0@lo:400:kworker.0 00000100:00100000:3.0:1788460002.900805:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac36cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022289152:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788460002.900871:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460002.900905:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfa359c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022289664:0@lo:400:kworker.0 00000100:00100000:3.0:1788460002.900990:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460002.901024:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfa35aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3660:1875336022290176:0@lo:400:kworker.0 00000100:00100000:3.0:1788460002.901046:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460002.901064:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfa35b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3660:1875336022290688:0@lo:400:kworker.0 00000100:00100000:3.0:1788460002.901085:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460002.901129:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788460002.901137:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfa358000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3660:1875336022289536:0@lo:400:kworker.0 00000100:00100000:2.0:1788460002.901301:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022289152 00000100:00100000:2.0:1788460002.901309:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022289152 00000100:00100000:2.0:1788460002.901347:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788460002.901355:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac36cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022289152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788460002.901375:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788460002.901911:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022290176 00000100:00100000:0.0:1788460002.901922:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022290176 00000100:00100000:0.0:1788460002.901980:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022290688 00000100:00100000:0.0:1788460002.901983:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022290688 00000100:00100000:0.0:1788460002.902001:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788460002.902007:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac36cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1875336022290176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460002.902595:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac36cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022289152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1238us (1722us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460002.902603:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:2.0:1788460002.902628:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788460002.902643:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788460002.902652:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac36cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1875336022290688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460002.902684:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac36cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1875336022290688:12345-0@lo:400:kworker.0 Request processed in 34us (1598us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460002.902700:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788460002.903083:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022289664 00000100:00100000:1.0:1788460002.903089:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022289664 00000100:00100000:1.0:1788460002.903130:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788460002.903136:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac36cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022289664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460002.903270:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac36cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022289664:12345-0@lo:400:kworker.0 Request processed in 133us (2280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460002.903277:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788460002.903411:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460002.903416:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac36cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1875336022290176:12345-0@lo:400:kworker.0 Request processed in 1409us (2369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460002.903424:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788460002.903438:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022289536 00000100:00100000:0.0:1788460002.903441:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022289536 00000100:00100000:3.0:1788460002.903446:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfa358e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3660:1875336022290048:0@lo:400:kworker.0 00000100:00100000:0.0:1788460002.903461:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788460002.903466:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac36cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1875336022289536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460002.903471:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460002.903483:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfa35a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3660:1875336022290560:0@lo:400:kworker.0 00000100:00100000:0.0:1788460002.903491:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac36cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1875336022289536:12345-0@lo:400:kworker.0 Request processed in 26us (81us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460002.903496:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788460002.903506:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022290048 00000100:00100000:0.0:1788460002.903509:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022290048 00000100:00100000:3.0:1788460002.903511:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460002.903526:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022290560 00000100:00100000:0.0:1788460002.903528:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022290560 00010000:00080000:3.0:1788460002.903535:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac36cc380 x1875336022289152/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460018 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460002.903540:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788460002.903544:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac36cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1875336022290048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460002.903554:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac36cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022289152:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788460002.903566:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfa359c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022289664:0@lo:400:kworker.0 00010000:00080000:3.0:1788460002.903575:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bfa35aa00 x1875336022290176/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460018 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460002.903583:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfa35aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3660:1875336022290176:0@lo:400:kworker.0 00010000:00080000:3.0:1788460002.903592:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bfa35b480 x1875336022290688/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460018 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460002.903600:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfa35b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3660:1875336022290688:0@lo:400:kworker.0 00000100:00100000:3.0:1788460002.903628:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfa358000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3660:1875336022289536:0@lo:400:kworker.0 00000100:00100000:3.0:1788460002.903649:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788460002.903656:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac36cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1875336022290560:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788460002.903702:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788460002.904134:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac36cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1875336022290560:12345-0@lo:400:kworker.0 Request processed in 476us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460002.904134:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac36cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1875336022290048:12345-0@lo:400:kworker.0 Request processed in 587us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460002.904141:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788460002.904147:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788460002.904178:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfa358e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3660:1875336022290048:0@lo:400:kworker.0 00000100:00100000:2.0:1788460002.904187:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfa35a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3660:1875336022290560:0@lo:400:kworker.0 00010000:00010000:0.0:1788460003.091775:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788460003.265337:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460003.265384:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460003.265408:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460003.265426:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460003.265442:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460003.265458:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460003.265480:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460003.265503:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003337088 00000100:00100000:2.0:1788460003.265521:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003337088 00000100:00100000:2.0:1788460003.265565:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003337344 00000100:00100000:2.0:1788460003.265568:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003337344 00000100:00100000:2.0:1788460003.265579:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003336960 00000100:00100000:2.0:1788460003.265581:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003336960 00000100:00100000:2.0:1788460003.265590:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003337216 00000100:00100000:2.0:1788460003.265592:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003337216 00000100:00100000:2.0:1788460003.265604:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 141 00000100:00100000:2.0:1788460003.265612:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf76eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2395:x1875336003337088:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:2.0:1788460003.265675:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf76eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2395:x1875336003337088:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 64us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460003.265682:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 141 00000100:00100000:2.0:1788460003.265704:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 142 00000100:00100000:2.0:1788460003.265711:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf76edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a5915a6d-4114-41fb-8d95-33add86e0720+5:2395:x1875336003337344:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:2.0:1788460003.265736:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf76edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a5915a6d-4114-41fb-8d95-33add86e0720+5:2395:x1875336003337344:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 25us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460003.265741:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 142 00000100:00100000:2.0:1788460003.265752:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 143 00000100:00100000:2.0:1788460003.265771:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf76ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:2395:x1875336003336960:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:2.0:1788460003.265790:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf76ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:2395:x1875336003336960:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 21us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460003.265796:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 143 00000100:00100000:2.0:1788460003.265806:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 144 00000100:00100000:2.0:1788460003.265811:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf76ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a5915a6d-4114-41fb-8d95-33add86e0720+5:2395:x1875336003337216:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:2.0:1788460003.265828:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf76ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a5915a6d-4114-41fb-8d95-33add86e0720+5:2395:x1875336003337216:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 18us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460003.265833:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 144 00000100:00100000:2.0:1788460003.265852:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003337600 00000100:00100000:2.0:1788460003.265856:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003337600 00000100:00100000:2.0:1788460003.265877:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003337472 00000100:00100000:2.0:1788460003.265880:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003337472 00000100:00100000:2.0:1788460003.265898:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 60 00000100:00100000:2.0:1788460003.265904:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf76ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5915a6d-4114-41fb-8d95-33add86e0720+5:2395:x1875336003337600:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:2.0:1788460003.265925:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf76ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5915a6d-4114-41fb-8d95-33add86e0720+5:2395:x1875336003337600:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 22us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460003.265930:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 60 00000100:00100000:2.0:1788460003.265977:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 61 00000100:00100000:2.0:1788460003.265990:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfa35a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5915a6d-4114-41fb-8d95-33add86e0720+5:2395:x1875336003337472:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:2.0:1788460003.266023:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfa35a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5915a6d-4114-41fb-8d95-33add86e0720+5:2395:x1875336003337472:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 35us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460003.266030:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 61 00000100:00080000:2.0:1788460003.266051:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788460003.266054:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788460003.266056:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788460003.266057:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788460003.266383:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003336832 00000100:00100000:3.0:1788460003.266389:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003336832 00000100:00100000:3.0:1788460003.266425:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 339 00000100:00100000:3.0:1788460003.266434:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bed032f6-c389-485e-b2f7-e2ea34763c65+14:2395:x1875336003336832:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:3.0:1788460003.266468:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bed032f6-c389-485e-b2f7-e2ea34763c65+14:2395:x1875336003336832:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 36us (1141us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460003.266474:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 339 00010000:00010000:3.0:1788460004.121791:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460005.137175:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788460005.970166:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788460005.970188:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfa358e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022291072:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788460005.970993:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460005.971110:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022291072 00000100:00100000:1.0:1788460005.971118:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022291072 00000100:00100000:1.0:1788460005.971179:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788460005.971188:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfa358000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022291072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788460005.971228:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788460005.971272:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfa358000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022291072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460005.971280:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:2.0:1788460005.971536:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788460005.971571:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bfa358e00 x1875336022291072/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460021 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460005.971591:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfa358e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022291072:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788460006.161269:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788460006.485797:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3a31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022291200:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788460006.485865:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460006.486280:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022291200 00000100:00100000:1.0:1788460006.486287:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022291200 00000100:00100000:1.0:1788460006.486338:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788460006.486347:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfa358e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022291200:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788460006.486379:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788460006.486431:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfa358e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022291200:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460006.486454:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788460006.486499:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3a31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022291200:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788460006.486653:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3bd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022291328:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788460006.486684:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460006.486858:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022291328 00000100:00100000:1.0:1788460006.486862:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022291328 00000100:00100000:1.0:1788460006.486912:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788460006.486919:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfa35b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022291328:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788460006.486933:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788460006.486996:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfa35b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022291328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460006.487002:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:0.0:1788460006.487100:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3bd8000 x1875336022291328/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460022 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460006.487114:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3bd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022291328:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788460006.487218:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788460007.192255:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788460007.516348:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfa35aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022291456:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788460007.516412:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460007.516483:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022291456 00000100:00100000:2.0:1788460007.516490:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022291456 00000100:00100000:2.0:1788460007.516532:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788460007.516541:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfa359c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1875336022291456:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788460007.516585:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446453248 avail 1300213760 00000100:00100000:2.0:1788460007.516630:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfa359c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1875336022291456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460007.516637:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788460007.516906:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfa35aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022291456:0@lo:41:osp-pre-1-0.0 00000020:00000004:1.0:1788460007.817376:0:12518:0:(tgt_mount.c:2486:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788460007.817724:0:12518:0:(tgt_mount.c:2501:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788460008.017302:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788460008.017326:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfa35aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022291584:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788460008.017397:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460008.017460:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022291584 00000100:00100000:2.0:1788460008.017466:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022291584 00000100:00100000:2.0:1788460008.017519:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788460008.017529:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfa359500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022291584:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788460008.017555:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788460008.017595:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfa359500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022291584:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460008.017601:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:2.0:1788460008.017622:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788460008.017650:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bfa35aa00 x1875336022291584/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460024 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460008.017667:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfa35aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022291584:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788460008.019132:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3a33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875336022291840:0@lo:400:kworker.0 00000100:00100000:1.0:1788460008.019185:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460008.019213:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3a31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3661:1875336022292352:0@lo:400:kworker.0 00000100:00100000:1.0:1788460008.019249:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460008.019279:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3a30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3661:1875336022292864:0@lo:400:kworker.0 00000100:00100000:1.0:1788460008.019301:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460008.019325:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788460008.019330:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3a30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022291968:0@lo:400:kworker.0 00000100:00100000:1.0:1788460008.019354:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460008.019373:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3a33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1875336022292480:0@lo:400:kworker.0 00000100:00100000:1.0:1788460008.019392:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460008.019408:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3a32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1875336022292992:0@lo:400:kworker.0 00000100:00100000:1.0:1788460008.019438:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460008.019466:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022291840 00000100:00100000:1.0:1788460008.019471:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022291840 00000100:00100000:1.0:1788460008.019501:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022292352 00000100:00100000:1.0:1788460008.019504:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022292352 00000100:00100000:1.0:1788460008.019524:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022292864 00000100:00100000:1.0:1788460008.019527:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022292864 00000100:00100000:1.0:1788460008.019538:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022292480 00000100:00100000:1.0:1788460008.019539:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022292480 00000100:00100000:1.0:1788460008.019549:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022292992 00000100:00100000:1.0:1788460008.019551:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022292992 00000100:00100000:1.0:1788460008.019564:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788460008.019571:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3a32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1875336022291840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460008.019614:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3a32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1875336022291840:12345-0@lo:400:kworker.0 Request processed in 43us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460008.019621:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788460008.019634:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788460008.019640:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac39d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1875336022292352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460008.019666:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac39d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1875336022292352:12345-0@lo:400:kworker.0 Request processed in 26us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460008.019672:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788460008.019683:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788460008.019689:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac39d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1875336022292864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460008.019713:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac39d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1875336022292864:12345-0@lo:400:kworker.0 Request processed in 25us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460008.019719:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788460008.019730:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788460008.019736:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac39d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1875336022292480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460008.019784:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac39d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1875336022292480:12345-0@lo:400:kworker.0 Request processed in 48us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460008.019790:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788460008.019801:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788460008.019807:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac39d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1875336022292992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460008.019830:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac39d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1875336022292992:12345-0@lo:400:kworker.0 Request processed in 24us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460008.019835:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788460008.019859:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022291968 00000100:00100000:1.0:1788460008.019863:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022291968 00000100:00100000:1.0:1788460008.019888:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788460008.019894:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac39d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022291968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460008.019924:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac39d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022291968:12345-0@lo:400:kworker.0 Request processed in 30us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460008.019930:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788460008.019977:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3a33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1875336022292096:0@lo:400:kworker.0 00000100:00100000:1.0:1788460008.020000:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460008.020018:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3a31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022292608:0@lo:400:kworker.0 00000100:00100000:1.0:1788460008.020037:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460008.020052:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3a33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022293120:0@lo:400:kworker.0 00000100:00100000:1.0:1788460008.020081:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460008.020100:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788460008.020107:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3a31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0cf73fe6-82e2-434e-b670-631647721b2c:3659:1875336022291712:0@lo:400:kworker.0 00000100:00100000:1.0:1788460008.020135:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460008.020157:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3a30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022292224:0@lo:400:kworker.0 00000100:00100000:1.0:1788460008.020189:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460008.020205:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3a30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022292736:0@lo:400:kworker.0 00000100:00100000:1.0:1788460008.020225:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788460008.020248:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788460008.020251:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788460008.020258:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022292224 00000100:00100000:1.0:1788460008.020261:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022292224 00000100:00100000:1.0:1788460008.020282:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788460008.020287:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf2ea5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022292224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460008.020319:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf2ea5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022292224:12345-0@lo:400:kworker.0 Request processed in 32us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460008.020325:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788460008.020557:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3a30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022292224:0@lo:400:kworker.0 00000100:00100000:1.0:1788460008.020584:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3a30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022291968:0@lo:400:kworker.0 00010000:00080000:1.0:1788460008.020596:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3a33800 x1875336022292480/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460024 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460008.020606:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3a33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1875336022292480:0@lo:400:kworker.0 00010000:00080000:1.0:1788460008.020616:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3a32d80 x1875336022292992/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460024 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460008.020623:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3a32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1875336022292992:0@lo:400:kworker.0 00000100:00100000:1.0:1788460008.020636:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3a33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875336022291840:0@lo:400:kworker.0 00000100:00100000:1.0:1788460008.020643:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3a31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3661:1875336022292352:0@lo:400:kworker.0 00000100:00100000:1.0:1788460008.020651:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3a30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3661:1875336022292864:0@lo:400:kworker.0 00000100:00100000:1.0:1788460008.020681:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022292096 00000100:00100000:1.0:1788460008.020685:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022292096 00000100:00100000:1.0:1788460008.020706:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788460008.020713:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac39d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1875336022292096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460008.020748:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac39d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1875336022292096:12345-0@lo:400:kworker.0 Request processed in 36us (747us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460008.020754:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788460008.020778:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3a33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1875336022292096:0@lo:400:kworker.0 00000100:00100000:2.0:1788460008.021253:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022292608 00000100:00100000:2.0:1788460008.021257:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022292608 00000100:00100000:2.0:1788460008.021291:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022293120 00000100:00100000:2.0:1788460008.021294:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022293120 00000100:00100000:2.0:1788460008.021307:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022292736 00000100:00100000:2.0:1788460008.021309:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022292736 00000100:00100000:2.0:1788460008.021333:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788460008.021339:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac39d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022292608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460008.021374:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac39d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022292608:12345-0@lo:400:kworker.0 Request processed in 36us (1336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460008.021380:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788460008.021392:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788460008.021398:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac39d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022293120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460008.021423:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac39d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022293120:12345-0@lo:400:kworker.0 Request processed in 26us (1341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460008.021428:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788460008.021438:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788460008.021444:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac39d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022292736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460008.021468:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac39d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022292736:12345-0@lo:400:kworker.0 Request processed in 25us (1242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460008.021473:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788460008.021493:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022291712 00000100:00100000:2.0:1788460008.021496:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022291712 00000100:00100000:2.0:1788460008.021519:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:2.0:1788460008.021524:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+29:3659:x1875336022291712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460008.021551:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+29:3659:x1875336022291712:12345-0@lo:400:kworker.0 Request processed in 27us (1415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460008.021557:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00080000:2.0:1788460008.021586:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788460008.021589:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788460008.021911:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfa35aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022293248:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788460008.021972:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460008.022060:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022293248 00000100:00100000:2.0:1788460008.022065:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022293248 00000100:00100000:2.0:1788460008.022115:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788460008.022131:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3bd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022293248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788460008.022147:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788460008.022182:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3bd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022293248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460008.022188:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:0.0:1788460008.022299:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bfa35aa00 x1875336022293248/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460024 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460008.022316:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfa35aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022293248:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788460008.026514:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3a31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0cf73fe6-82e2-434e-b670-631647721b2c:3659:1875336022291712:0@lo:400:kworker.0 00010000:00080000:1.0:1788460008.026539:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3a30e00 x1875336022292736/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788460024 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460008.026552:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3a30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022292736:0@lo:400:kworker.0 00010000:00080000:1.0:1788460008.026566:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3a31f80 x1875336022292608/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788460024 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460008.026575:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3a31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022292608:0@lo:400:kworker.0 00010000:00080000:1.0:1788460008.026588:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3a33480 x1875336022293120/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788460024 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460008.026597:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3a33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022293120:0@lo:400:kworker.0 00010000:00010000:3.0:1788460008.209133:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788460008.393206:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460008.393250:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460008.393311:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460008.393346:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003337728 00000100:00100000:0.0:1788460008.393354:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003337728 00000100:00100000:0.0:1788460008.393402:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 341 00000100:00100000:0.0:1788460008.393411:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bed032f6-c389-485e-b2f7-e2ea34763c65+14:2396:x1875336003337728:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:0.0:1788460008.393478:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bed032f6-c389-485e-b2f7-e2ea34763c65+14:2396:x1875336003337728:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 68us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460008.393486:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 341 00000100:00100000:2.0:1788460008.400575:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460008.400595:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460008.400640:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003338496 00000100:00100000:3.0:1788460008.400658:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003338496 00000100:00100000:3.0:1788460008.400716:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 65 00000100:00100000:3.0:1788460008.400726:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfa35ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5915a6d-4114-41fb-8d95-33add86e0720+5:2396:x1875336003338496:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:3.0:1788460008.400794:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfa35ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5915a6d-4114-41fb-8d95-33add86e0720+5:2396:x1875336003338496:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 69us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460008.400801:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 65 00000100:00080000:3.0:1788460008.400822:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788460008.401345:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003337984 00000100:00100000:1.0:1788460008.401350:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003337984 00000100:00100000:1.0:1788460008.401387:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003338240 00000100:00100000:1.0:1788460008.401390:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003338240 00000100:00100000:1.0:1788460008.401408:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 151 00000100:00100000:1.0:1788460008.401415:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfa35a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2396:x1875336003337984:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:1.0:1788460008.401460:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfa35a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2396:x1875336003337984:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 46us (8210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460008.401467:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 151 00000100:00100000:1.0:1788460008.401479:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 152 00000100:00100000:1.0:1788460008.401485:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfa359f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a5915a6d-4114-41fb-8d95-33add86e0720+5:2396:x1875336003338240:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:1.0:1788460008.401503:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfa359f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a5915a6d-4114-41fb-8d95-33add86e0720+5:2396:x1875336003338240:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 19us (8192us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460008.401509:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 152 00000100:00080000:1.0:1788460008.401526:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788460008.405322:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460008.405358:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460008.405388:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003337856 00000100:00100000:2.0:1788460008.405397:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003337856 00000100:00100000:2.0:1788460008.405448:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003338112 00000100:00100000:2.0:1788460008.405451:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003338112 00000100:00100000:2.0:1788460008.405469:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 153 00000100:00100000:2.0:1788460008.405477:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfa358700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:2395:x1875336003337856:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:2.0:1788460008.405546:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfa358700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:2395:x1875336003337856:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 70us (4949us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460008.405566:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 153 00000100:00100000:2.0:1788460008.405583:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 154 00000100:00100000:2.0:1788460008.405590:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfa35b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a5915a6d-4114-41fb-8d95-33add86e0720+5:2395:x1875336003338112:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:2.0:1788460008.405614:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfa35b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a5915a6d-4114-41fb-8d95-33add86e0720+5:2395:x1875336003338112:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 25us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460008.405621:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 154 00000100:00100000:2.0:1788460008.405884:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003338368 00000100:00100000:2.0:1788460008.405890:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003338368 00000100:00100000:2.0:1788460008.405925:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 66 00000100:00100000:2.0:1788460008.405931:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfa35aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a5915a6d-4114-41fb-8d95-33add86e0720+5:2395:x1875336003338368:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:2.0:1788460008.405982:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfa35aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a5915a6d-4114-41fb-8d95-33add86e0720+5:2395:x1875336003338368:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 51us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460008.405987:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 66 00000100:00080000:2.0:1788460008.406009:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788460008.406014:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788460009.233905:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788460010.178883:0:12616:0:(tgt_mount.c:2486:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788460010.180664:0:12616:0:(tgt_mount.c:2501:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788460010.257380:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788460011.089365:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfa35b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022293376:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788460011.089431:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460011.089593:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022293376 00000100:00100000:2.0:1788460011.089601:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022293376 00000100:00100000:2.0:1788460011.089663:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788460011.089673:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac39d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1875336022293376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788460011.089698:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788460011.089739:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac39d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1875336022293376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460011.089745:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:1.0:1788460011.089794:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788460011.089822:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bfa35b100 x1875336022293376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460027 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460011.089841:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfa35b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022293376:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788460011.284965:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460011.602451:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3bd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022293504:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788460011.602555:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460011.603360:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022293504 00000100:00100000:0.0:1788460011.603369:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022293504 00000100:00100000:0.0:1788460011.603431:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788460011.603440:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac36cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022293504:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788460011.603462:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788460011.603521:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac36cc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022293504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (967us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460011.603529:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788460011.603570:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:3.0:1788460011.603574:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788460011.603584:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac39d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022293632:0@lo:41:osp-pre-0-1.0 00010000:00080000:3.0:1788460011.603609:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3bd9c00 x1875336022293504/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460027 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460011.603632:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3bd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022293504:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788460011.603673:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460011.603720:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022293632 00000100:00100000:3.0:1788460011.603726:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022293632 00000100:00100000:3.0:1788460011.604596:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788460011.604609:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3bdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022293632:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788460011.604637:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788460011.604690:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3bdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022293632:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (1016us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460011.604696:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788460011.608247:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac39d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022293632:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788460012.308322:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788460012.627720:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788460012.627741:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfa358e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022293760:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788460012.627803:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460012.627857:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022293760 00000100:00100000:2.0:1788460012.627863:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022293760 00000100:00100000:2.0:1788460012.627903:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788460012.627911:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfa359c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022293760:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788460012.627958:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446453248 avail 1300213760 00000100:00100000:2.0:1788460012.628002:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfa359c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022293760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460012.628017:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788460012.628071:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfa358e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022293760:0@lo:41:osp-pre-1-0.0 00000020:00000004:3.0:1788460012.694499:0:12713:0:(tgt_mount.c:2486:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788460012.694759:0:12713:0:(tgt_mount.c:2501:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788460013.137604:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788460013.137627:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfa358e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022293888:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788460013.137719:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460013.137785:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022293888 00000100:00100000:0.0:1788460013.137792:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022293888 00000100:00100000:0.0:1788460013.137845:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788460013.137855:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bef633050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022293888:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788460013.137881:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788460013.137922:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bef633050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022293888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460013.137941:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:0.0:1788460013.138352:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788460013.138381:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bfa358e00 x1875336022293888/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460029 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460013.138400:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfa358e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022293888:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788460013.138743:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfa358e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022294016:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788460013.138774:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460013.138936:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022294016 00000100:00100000:2.0:1788460013.138959:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022294016 00000100:00100000:2.0:1788460013.139004:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00080000:1.0:1788460013.139135:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788460013.139185:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3bd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875336022294016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788460013.139212:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788460013.139254:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3bd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875336022294016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460013.139400:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3bd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0cf73fe6-82e2-434e-b670-631647721b2c:3659:1875336022294144:0@lo:400:kworker.0 00000100:00100000:0.0:1788460013.139434:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460013.139471:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3bda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022294656:0@lo:400:kworker.0 00000100:00100000:0.0:1788460013.139494:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460013.139513:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3bd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022295168:0@lo:400:kworker.0 00000100:00100000:0.0:1788460013.139535:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460013.139555:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788460013.139576:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3bd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1875336022294272:0@lo:400:kworker.0 00000100:00100000:0.0:1788460013.139602:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460013.139619:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3bda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1875336022294784:0@lo:400:kworker.0 00000100:00100000:0.0:1788460013.139636:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460013.139668:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3bd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1875336022295296:0@lo:400:kworker.0 00000100:00100000:0.0:1788460013.139688:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460013.139715:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022294144 00000100:00100000:0.0:1788460013.139719:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022294144 00000100:00100000:0.0:1788460013.139746:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1788460013.139752:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+29:3659:x1875336022294144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460013.139785:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+29:3659:x1875336022294144:12345-0@lo:400:kworker.0 Request processed in 33us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460013.139792:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1788460013.139821:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022294656 00000100:00100000:0.0:1788460013.139825:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022294656 00000100:00100000:0.0:1788460013.139850:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788460013.139856:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3bd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022294656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460013.139887:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3bd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022294656:12345-0@lo:400:kworker.0 Request processed in 31us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460013.139893:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788460013.139910:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022295168 00000100:00100000:0.0:1788460013.139913:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022295168 00000100:00100000:0.0:1788460013.139976:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788460013.139983:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3bdb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022295168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460013.140024:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3bdb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022295168:12345-0@lo:400:kworker.0 Request processed in 42us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460013.140048:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788460013.140067:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022294272 00000100:00100000:0.0:1788460013.140071:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022294272 00000100:00100000:0.0:1788460013.140093:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022294784 00000100:00100000:0.0:1788460013.140095:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022294784 00000100:00100000:0.0:1788460013.140106:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022295296 00000100:00100000:0.0:1788460013.140108:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022295296 00000100:00100000:0.0:1788460013.140119:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788460013.140124:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3bd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1875336022294272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460013.140150:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3bd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1875336022294272:12345-0@lo:400:kworker.0 Request processed in 26us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460013.140156:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788460013.140166:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788460013.140170:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3bd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1875336022294784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460013.140190:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3bd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1875336022294784:12345-0@lo:400:kworker.0 Request processed in 20us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460013.140195:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788460013.140203:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788460013.140209:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3bdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1875336022295296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460013.140228:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3bdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1875336022295296:12345-0@lo:400:kworker.0 Request processed in 20us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460013.140233:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788460013.140267:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3bdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022294400:0@lo:400:kworker.0 00000100:00100000:0.0:1788460013.140293:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460013.140309:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3bdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1875336022294912:0@lo:400:kworker.0 00000100:00100000:0.0:1788460013.140327:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460013.140347:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3bd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1875336022295424:0@lo:400:kworker.0 00000100:00100000:0.0:1788460013.140366:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460013.140381:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788460013.140386:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3bd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875336022294528:0@lo:400:kworker.0 00000100:00100000:0.0:1788460013.140403:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460013.140416:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3bdad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022295040:0@lo:400:kworker.0 00000100:00100000:0.0:1788460013.140433:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460013.140456:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022294912 00000100:00100000:0.0:1788460013.140460:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022294912 00000100:00100000:0.0:1788460013.140475:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022295424 00000100:00100000:0.0:1788460013.140478:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022295424 00000100:00100000:0.0:1788460013.140487:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022294528 00000100:00100000:0.0:1788460013.140489:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022294528 00000100:00100000:0.0:1788460013.140499:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788460013.140505:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf75e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1875336022294912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460013.140537:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf75e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1875336022294912:12345-0@lo:400:kworker.0 Request processed in 33us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460013.140544:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788460013.140556:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788460013.140561:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf75e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1875336022295424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460013.140586:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf75e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1875336022295424:12345-0@lo:400:kworker.0 Request processed in 25us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460013.140592:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788460013.140601:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788460013.140607:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf75e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1875336022294528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460013.140629:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf75e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1875336022294528:12345-0@lo:400:kworker.0 Request processed in 23us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460013.140643:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00080000:0.0:1788460013.140662:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788460013.140665:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788460013.140668:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788460013.140676:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022294400 00000100:00100000:0.0:1788460013.140679:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022294400 00000100:00100000:0.0:1788460013.140699:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788460013.140705:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf75e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022294400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460013.140734:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf75e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022294400:12345-0@lo:400:kworker.0 Request processed in 29us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460013.140739:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788460013.140774:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3bd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875336022294528:0@lo:400:kworker.0 00000100:00100000:0.0:1788460013.140785:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3bdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022294400:0@lo:400:kworker.0 00010000:00080000:0.0:1788460013.140796:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3bdb480 x1875336022294912/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460029 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460013.140806:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3bdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1875336022294912:0@lo:400:kworker.0 00010000:00080000:0.0:1788460013.140815:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3bd8a80 x1875336022295424/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460029 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460013.140822:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3bd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1875336022295424:0@lo:400:kworker.0 00000100:00100000:0.0:1788460013.140853:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3bd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1875336022294272:0@lo:400:kworker.0 00000100:00100000:0.0:1788460013.140863:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3bda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1875336022294784:0@lo:400:kworker.0 00000100:00100000:0.0:1788460013.140872:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3bd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1875336022295296:0@lo:400:kworker.0 00000100:00100000:0.0:1788460013.140880:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3bd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0cf73fe6-82e2-434e-b670-631647721b2c:3659:1875336022294144:0@lo:400:kworker.0 00000100:00100000:0.0:1788460013.140899:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3bda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022294656:0@lo:400:kworker.0 00010000:00080000:0.0:1788460013.140908:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3bd9500 x1875336022295168/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788460029 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460013.140917:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3bd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022295168:0@lo:400:kworker.0 00010000:00080000:0.0:1788460013.141016:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bfa358e00 x1875336022294016/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460029 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460013.141033:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfa358e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022294016:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788460013.141077:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022295040 00000100:00100000:0.0:1788460013.141081:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022295040 00000100:00100000:0.0:1788460013.141110:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788460013.141117:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac366aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022295040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460013.141159:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac366aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022295040:12345-0@lo:400:kworker.0 Request processed in 43us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460013.141166:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:0.0:1788460013.141179:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788460013.141194:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3bdad80 x1875336022295040/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788460029 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460013.141202:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3bdad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022295040:0@lo:400:kworker.0 00000100:00100000:2.0:1788460013.141846:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00010000:0.0:1788460013.330147:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788460013.505333:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460013.505369:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460013.505396:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460013.505412:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460013.505429:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460013.505445:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460013.505462:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460013.505542:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003338752 00000100:00100000:1.0:1788460013.505550:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003338752 00000100:00100000:1.0:1788460013.505590:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003339008 00000100:00100000:1.0:1788460013.505592:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003339008 00000100:00100000:1.0:1788460013.505601:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003338880 00000100:00100000:1.0:1788460013.505603:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003338880 00000100:00100000:1.0:1788460013.505613:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003339136 00000100:00100000:1.0:1788460013.505614:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003339136 00000100:00100000:1.0:1788460013.505627:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 161 00000100:00100000:1.0:1788460013.505636:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac39d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:2393:x1875336003338752:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:1.0:1788460013.505703:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac39d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:2393:x1875336003338752:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 68us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460013.505711:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 161 00000100:00100000:1.0:1788460013.505725:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 162 00000100:00100000:1.0:1788460013.505731:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac39d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a5915a6d-4114-41fb-8d95-33add86e0720+5:2393:x1875336003339008:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:1.0:1788460013.505751:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac39d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a5915a6d-4114-41fb-8d95-33add86e0720+5:2393:x1875336003339008:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 20us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460013.505756:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 162 00000100:00100000:1.0:1788460013.505765:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 163 00000100:00100000:1.0:1788460013.505770:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac39d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2393:x1875336003338880:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:1.0:1788460013.505788:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac39d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2393:x1875336003338880:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 18us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460013.505793:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 163 00000100:00100000:1.0:1788460013.505802:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 164 00000100:00100000:1.0:1788460013.505807:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac39d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a5915a6d-4114-41fb-8d95-33add86e0720+5:2393:x1875336003339136:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:1.0:1788460013.505825:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac39d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a5915a6d-4114-41fb-8d95-33add86e0720+5:2393:x1875336003339136:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 18us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460013.505837:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 164 00000100:00100000:1.0:1788460013.505856:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003338624 00000100:00100000:1.0:1788460013.505859:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003338624 00000100:00100000:1.0:1788460013.505883:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 343 00000100:00100000:1.0:1788460013.505889:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bed032f6-c389-485e-b2f7-e2ea34763c65+14:2393:x1875336003338624:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:1.0:1788460013.505913:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bed032f6-c389-485e-b2f7-e2ea34763c65+14:2393:x1875336003338624:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 24us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460013.505919:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 343 00000100:00100000:1.0:1788460013.505968:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003339264 00000100:00100000:1.0:1788460013.505972:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003339264 00000100:00100000:1.0:1788460013.505998:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003339392 00000100:00100000:1.0:1788460013.506000:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003339392 00000100:00100000:1.0:1788460013.506019:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 22 00000100:00100000:1.0:1788460013.506024:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac39d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5915a6d-4114-41fb-8d95-33add86e0720+5:2392:x1875336003339264:12345-192.168.206.5@tcp:9:kworker.0 00000020:00000080:1.0:1788460013.506052:0:8449:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5dfa74784542af6a 00000100:00080000:1.0:1788460013.506059:0:8449:0:(import.c:65:import_set_state_nolock()) ffff8c4ac2be0000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788460013.506095:0:8449:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1788460013.506203:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac39d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5915a6d-4114-41fb-8d95-33add86e0720+2:2392:x1875336003339264:12345-192.168.206.5@tcp:9:kworker.0 Request processed in 177us (771us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460013.506209:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 22 00000100:00100000:1.0:1788460013.506222:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 23 00000100:00100000:1.0:1788460013.506228:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac39d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5915a6d-4114-41fb-8d95-33add86e0720+5:2392:x1875336003339392:12345-192.168.206.5@tcp:9:kworker.0 00000020:00000080:1.0:1788460013.506239:0:8449:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5dfa74784542af71 00000100:00080000:1.0:1788460013.506243:0:8449:0:(import.c:65:import_set_state_nolock()) ffff8c4ac2be6000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788460013.506265:0:8449:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1788460013.506339:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac39d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a5915a6d-4114-41fb-8d95-33add86e0720+2:2392:x1875336003339392:12345-192.168.206.5@tcp:9:kworker.0 Request processed in 110us (875us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460013.506346:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 23 00010000:00010000:1.0:1788460013.506376:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460013.506382:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788460013.508653:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788460013.508660:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788460013.508664:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788460013.508667:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788460014.362706:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788460015.031655:0:12810:0:(tgt_mount.c:2486:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788460015.031881:0:12810:0:(tgt_mount.c:2501:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788460015.377496:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788460016.210388:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfa358000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022295552:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788460016.210456:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460016.210541:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022295552 00000100:00100000:1.0:1788460016.210548:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022295552 00000100:00100000:1.0:1788460016.210611:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788460016.210620:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac366b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875336022295552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788460016.210649:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00080000:3.0:1788460016.210757:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788460016.211453:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac366b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875336022295552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 831us (993us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460016.211462:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00080000:0.0:1788460016.211530:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bfa358000 x1875336022295552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460032 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460016.211548:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfa358000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022295552:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788460016.402981:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460016.722172:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac36cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022295680:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788460016.722240:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460016.722311:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022295680 00000100:00100000:3.0:1788460016.722318:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022295680 00000100:00100000:3.0:1788460016.722368:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788460016.722376:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac36cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022295680:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788460016.722397:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788460016.722441:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac36cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022295680:12345-0@lo:13:osp-pre-0-1.0 Request processed in 66us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460016.722448:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:3.0:1788460016.722465:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788460016.722490:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac36cdf80 x1875336022295680/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460032 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460016.722506:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac36cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022295680:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788460016.723296:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac366bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022295808:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788460016.723345:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460016.723396:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022295808 00000100:00100000:3.0:1788460016.723401:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022295808 00000100:00100000:3.0:1788460016.723432:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788460016.723439:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac36cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022295808:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788460016.723465:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788460016.723503:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac36cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022295808:12345-0@lo:41:osp-pre-0-1.0 Request processed in 63us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460016.723521:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788460016.723558:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac366bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022295808:0@lo:41:osp-pre-0-1.0 00000020:00000004:3.0:1788460017.040534:0:12907:0:(tgt_mount.c:2486:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788460017.040717:0:12907:0:(tgt_mount.c:2501:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788460017.425309:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788460017.753884:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac39d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022295936:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788460017.753973:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460017.754759:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022295936 00000100:00100000:1.0:1788460017.754769:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022295936 00000100:00100000:1.0:1788460017.754828:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788460017.754838:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3669f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1875336022295936:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788460017.754871:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446453248 avail 1300213760 00000100:00100000:1.0:1788460017.754936:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3669f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1875336022295936:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (964us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460017.754966:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788460017.756589:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac39d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022295936:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788460018.257136:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3bd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875336022296448:0@lo:400:kworker.0 00000100:00100000:0.0:1788460018.257200:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460018.257239:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3bda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022296960:0@lo:400:kworker.0 00000100:00100000:0.0:1788460018.257261:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460018.257275:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3bdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022297472:0@lo:400:kworker.0 00000100:00100000:0.0:1788460018.257290:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460018.257314:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1788460018.257319:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3668e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0cf73fe6-82e2-434e-b670-631647721b2c:3661:1875336022296064:0@lo:400:kworker.0 00000100:00100000:0.0:1788460018.257342:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460018.257360:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3bda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022296576:0@lo:400:kworker.0 00000100:00100000:0.0:1788460018.257378:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460018.257391:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3bd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022297088:0@lo:400:kworker.0 00000100:00100000:0.0:1788460018.257406:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460018.257417:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3bd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022297600:0@lo:400:kworker.0 00000100:00100000:0.0:1788460018.257450:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460018.257476:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022296064 00000100:00100000:0.0:1788460018.257483:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022296064 00000100:00100000:0.0:1788460018.257524:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:0.0:1788460018.257532:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+29:3661:x1875336022296064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460018.257579:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+29:3661:x1875336022296064:12345-0@lo:400:kworker.0 Request processed in 47us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460018.257586:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:0.0:1788460018.257632:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3668e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0cf73fe6-82e2-434e-b670-631647721b2c:3661:1875336022296064:0@lo:400:kworker.0 00000100:00100000:1.0:1788460018.257872:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022296448 00000100:00100000:1.0:1788460018.257876:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022296448 00000100:00100000:1.0:1788460018.257907:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788460018.257913:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf2fe8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1875336022296448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460018.257976:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf2fe8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1875336022296448:12345-0@lo:400:kworker.0 Request processed in 63us (776us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460018.257983:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788460018.258001:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022296960 00000100:00100000:1.0:1788460018.258004:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022296960 00000100:00100000:1.0:1788460018.258050:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022297472 00000100:00100000:1.0:1788460018.258053:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022297472 00000100:00100000:1.0:1788460018.258065:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022297088 00000100:00100000:1.0:1788460018.258067:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022297088 00000100:00100000:1.0:1788460018.258076:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022297600 00000100:00100000:1.0:1788460018.258078:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022297600 00000100:00100000:1.0:1788460018.258089:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788460018.258094:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf2fe9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022296960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460018.258126:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf2fe9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022296960:12345-0@lo:400:kworker.0 Request processed in 32us (863us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460018.258131:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788460018.258141:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788460018.258146:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf2fe9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022297472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460018.258182:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf2fe9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022297472:12345-0@lo:400:kworker.0 Request processed in 36us (890us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460018.258188:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788460018.258197:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788460018.258202:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf2feb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1875336022297088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460018.258243:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf2feb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1875336022297088:12345-0@lo:400:kworker.0 Request processed in 41us (836us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460018.258248:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788460018.258257:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788460018.258268:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf2fead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1875336022297600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460018.258314:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf2fead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1875336022297600:12345-0@lo:400:kworker.0 Request processed in 47us (863us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460018.258320:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788460018.258339:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022296576 00000100:00100000:1.0:1788460018.258342:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022296576 00000100:00100000:1.0:1788460018.258366:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788460018.258371:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf2fe9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1875336022296576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460018.258420:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf2fe9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1875336022296576:12345-0@lo:400:kworker.0 Request processed in 49us (1041us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460018.258426:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788460018.258470:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3bda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022296576:0@lo:400:kworker.0 00010000:00080000:1.0:1788460018.258483:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3bd8e00 x1875336022297088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788460034 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460018.258493:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3bd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022297088:0@lo:400:kworker.0 00010000:00080000:1.0:1788460018.258503:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3bd8700 x1875336022297600/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788460034 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460018.258511:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3bd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022297600:0@lo:400:kworker.0 00000100:00100000:1.0:1788460018.258521:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3bd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875336022296448:0@lo:400:kworker.0 00010000:00080000:1.0:1788460018.258529:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3bda300 x1875336022296960/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788460034 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460018.258537:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3bda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022296960:0@lo:400:kworker.0 00010000:00080000:1.0:1788460018.258546:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3bdaa00 x1875336022297472/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788460034 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460018.258561:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3bdaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022297472:0@lo:400:kworker.0 00000100:00100000:3.0:1788460018.261827:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac366bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1875336022296192:0@lo:400:kworker.0 00000100:00100000:3.0:1788460018.261894:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460018.261930:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3bd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1875336022296704:0@lo:400:kworker.0 00000100:00100000:3.0:1788460018.261976:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460018.261995:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3bd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1875336022297216:0@lo:400:kworker.0 00000100:00100000:3.0:1788460018.262027:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460018.262046:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac39d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022297728:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788460018.262068:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460018.262091:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1788460018.262097:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3bdad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022296320:0@lo:400:kworker.0 00000100:00100000:3.0:1788460018.262118:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460018.262135:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3bd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1875336022296832:0@lo:400:kworker.0 00000100:00100000:3.0:1788460018.262151:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460018.262165:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3bdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1875336022297344:0@lo:400:kworker.0 00000100:00100000:3.0:1788460018.262182:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460018.262191:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfa35b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022297856:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788460018.262206:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788460018.262230:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788460018.262235:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788460018.262246:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022296192 00000100:00100000:3.0:1788460018.262260:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022296192 00000100:00100000:3.0:1788460018.262290:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022296704 00000100:00100000:3.0:1788460018.262292:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022296704 00000100:00100000:3.0:1788460018.262307:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022297216 00000100:00100000:3.0:1788460018.262309:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022297216 00000100:00100000:3.0:1788460018.262318:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022296832 00000100:00100000:3.0:1788460018.262320:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022296832 00000100:00100000:3.0:1788460018.262328:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022297344 00000100:00100000:3.0:1788460018.262329:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022297344 00000100:00100000:3.0:1788460018.262341:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788460018.262347:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac36cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1875336022296192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460018.262399:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac36cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1875336022296192:12345-0@lo:400:kworker.0 Request processed in 52us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460018.262407:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788460018.262422:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788460018.262427:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac36ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1875336022296704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460018.262470:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac36ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1875336022296704:12345-0@lo:400:kworker.0 Request processed in 43us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460018.262475:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788460018.262485:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788460018.262491:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac36cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1875336022297216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460018.262519:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac36cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1875336022297216:12345-0@lo:400:kworker.0 Request processed in 28us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460018.262525:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788460018.262533:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788460018.262538:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac36ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1875336022296832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460018.262574:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac36ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1875336022296832:12345-0@lo:400:kworker.0 Request processed in 36us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460018.262589:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788460018.262599:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788460018.262604:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac36cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1875336022297344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460018.262649:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac36cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1875336022297344:12345-0@lo:400:kworker.0 Request processed in 44us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460018.262654:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788460018.262672:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022297728 00000100:00100000:3.0:1788460018.262675:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022297728 00000100:00100000:3.0:1788460018.262690:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022297856 00000100:00100000:3.0:1788460018.262693:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022297856 00000100:00100000:3.0:1788460018.262703:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788460018.262709:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac36cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022297728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788460018.262729:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788460018.262758:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac36cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022297728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460018.262764:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788460018.262775:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788460018.262780:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc43faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022297856:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788460018.262789:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788460018.262811:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc43faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022297856:12345-0@lo:13:osp-pre-1-1.0 Request processed in 31us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460018.262817:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:3.0:1788460018.262834:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788460018.262837:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788460018.262861:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3bd9880 x1875336022296832/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460034 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460018.262886:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3bd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1875336022296832:0@lo:400:kworker.0 00010000:00080000:3.0:1788460018.262901:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3bdb480 x1875336022297344/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460034 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460018.262909:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3bdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1875336022297344:0@lo:400:kworker.0 00010000:00080000:3.0:1788460018.262919:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bfa35b480 x1875336022297856/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460034 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460018.262932:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfa35b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022297856:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788460018.262960:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac366bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1875336022296192:0@lo:400:kworker.0 00000100:00100000:3.0:1788460018.262970:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3bd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1875336022296704:0@lo:400:kworker.0 00000100:00100000:3.0:1788460018.262978:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3bd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1875336022297216:0@lo:400:kworker.0 00010000:00080000:3.0:1788460018.262987:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac39d1c00 x1875336022297728/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460034 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460018.262998:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac39d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022297728:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788460018.263051:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022296320 00000100:00100000:3.0:1788460018.263054:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022296320 00000100:00100000:3.0:1788460018.263080:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788460018.263086:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac36cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022296320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460018.263118:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac36cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022296320:12345-0@lo:400:kworker.0 Request processed in 33us (999us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460018.263124:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788460018.263149:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3bdad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022296320:0@lo:400:kworker.0 00010000:00010000:0.0:1788460018.449157:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788460018.624636:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460018.624739:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460018.624766:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460018.624797:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460018.624819:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460018.624893:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003339776 00000100:00100000:0.0:1788460018.624902:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003339776 00000100:00100000:0.0:1788460018.624987:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003340032 00000100:00100000:0.0:1788460018.624990:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003340032 00000100:00100000:0.0:1788460018.625003:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003339648 00000100:00100000:0.0:1788460018.625006:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003339648 00000100:00100000:0.0:1788460018.625029:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003339904 00000100:00100000:0.0:1788460018.625032:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003339904 00000100:00100000:0.0:1788460018.625047:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 171 00000100:00100000:0.0:1788460018.625056:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfa359500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2393:x1875336003339776:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:0.0:1788460018.625127:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfa359500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2393:x1875336003339776:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 72us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460018.625135:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 171 00000100:00100000:0.0:1788460018.625152:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 172 00000100:00100000:0.0:1788460018.625160:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfa35b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a5915a6d-4114-41fb-8d95-33add86e0720+5:2393:x1875336003340032:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:0.0:1788460018.625184:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfa35b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a5915a6d-4114-41fb-8d95-33add86e0720+5:2393:x1875336003340032:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 25us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460018.625203:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 172 00000100:00100000:0.0:1788460018.625218:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 173 00000100:00100000:0.0:1788460018.625224:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfa35b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:2393:x1875336003339648:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:0.0:1788460018.625247:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfa35b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:2393:x1875336003339648:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 23us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460018.625252:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 173 00000100:00100000:0.0:1788460018.625283:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 174 00000100:00100000:0.0:1788460018.625307:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfa358000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a5915a6d-4114-41fb-8d95-33add86e0720+5:2393:x1875336003339904:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:0.0:1788460018.625329:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfa358000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a5915a6d-4114-41fb-8d95-33add86e0720+5:2393:x1875336003339904:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 41us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460018.625334:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 174 00000100:00080000:2.0:1788460018.625805:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788460018.625809:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788460018.626977:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003339520 00000100:00100000:1.0:1788460018.626989:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003339520 00000100:00100000:1.0:1788460018.627100:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 345 00000100:00100000:1.0:1788460018.627109:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bed032f6-c389-485e-b2f7-e2ea34763c65+14:2393:x1875336003339520:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:1.0:1788460018.627174:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bed032f6-c389-485e-b2f7-e2ea34763c65+14:2393:x1875336003339520:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 66us (2547us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460018.627180:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 345 00000001:00100000:2.0:1788460018.772667:0:8443:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a5915a6d-4114-41fb-8d95-33add86e0720 00000020:00000080:2.0:1788460018.772676:0:8443:0:(genops.c:885:class_export_put()) final put ffff8c4ac2be7000/a5915a6d-4114-41fb-8d95-33add86e0720 00000020:00000080:3.0:1788460018.772757:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c4ac2be7000/a5915a6d-4114-41fb-8d95-33add86e0720 for lustre-OST0000 00000020:00000080:3.0:1788460018.772800:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c4ac2be0000 for lustre-OST0000 00000001:00100000:1.0:1788460018.774552:0:9527:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a5915a6d-4114-41fb-8d95-33add86e0720 00000020:00000080:1.0:1788460018.774561:0:9527:0:(genops.c:885:class_export_put()) final put ffff8c4ac2be6800/a5915a6d-4114-41fb-8d95-33add86e0720 00000020:00000080:0.0:1788460018.774630:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c4ac2be6800/a5915a6d-4114-41fb-8d95-33add86e0720 for lustre-OST0001 00000020:00000080:0.0:1788460018.774679:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c4ac2be6000 for lustre-OST0001 00010000:00010000:0.0:1788460019.473760:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460020.500848:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788460020.576351:0:13052:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1788460021.330935:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfa358e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022297984:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788460021.331034:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460021.331291:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022297984 00000100:00100000:0.0:1788460021.331300:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022297984 00000100:00100000:0.0:1788460021.331372:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788460021.331383:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac39d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1875336022297984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788460021.331410:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788460021.331468:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac39d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1875336022297984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460021.331475:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:2.0:1788460021.331670:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788460021.331868:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bfa358e00 x1875336022297984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460037 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460021.331889:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfa358e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022297984:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788460021.522774:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460021.842106:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc43f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022298112:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788460021.842170:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460021.843158:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022298112 00000100:00100000:2.0:1788460021.843169:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022298112 00000100:00100000:2.0:1788460021.843240:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788460021.843249:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc43f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022298112:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788460021.843272:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788460021.843330:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc43f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022298112:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (1160us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460021.843345:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:2.0:1788460021.843389:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bc43f9500 x1875336022298112/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460037 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460021.843405:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc43f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022298112:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788460021.843653:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788460021.843664:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf2fea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022298240:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788460021.843708:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460021.843751:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022298240 00000100:00100000:0.0:1788460021.843755:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022298240 00000100:00100000:0.0:1788460021.843787:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788460021.843794:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf2feb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022298240:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788460021.843820:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788460021.843857:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf2feb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022298240:12345-0@lo:41:osp-pre-0-1.0 Request processed in 64us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460021.843863:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788460021.843895:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf2fea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022298240:0@lo:41:osp-pre-0-1.0 00000100:00080000:3.0:1788460021.844339:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788460022.545882:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788460022.865436:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788460022.865459:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac39d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022298368:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788460022.865519:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460022.865579:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022298368 00000100:00100000:1.0:1788460022.865586:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022298368 00000100:00100000:1.0:1788460022.865635:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788460022.865643:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac39d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022298368:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788460022.865684:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446453248 avail 1300213760 00000100:00100000:1.0:1788460022.865738:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac39d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022298368:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460022.865823:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788460022.865938:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac39d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022298368:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788460023.377185:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788460023.377205:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfa358e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022298496:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788460023.377274:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460023.377327:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022298496 00000100:00100000:2.0:1788460023.377333:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022298496 00000100:00100000:2.0:1788460023.377385:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788460023.377394:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3af6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022298496:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788460023.377418:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788460023.377451:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3af6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022298496:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460023.377458:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:2.0:1788460023.377474:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788460023.377499:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bfa358e00 x1875336022298496/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460039 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460023.377515:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfa358e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022298496:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788460023.378048:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1875336022298752:0@lo:400:kworker.0 00000100:00100000:2.0:1788460023.378081:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460023.378176:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022298752 00000100:00100000:0.0:1788460023.378181:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022298752 00000100:00100000:0.0:1788460023.378212:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788460023.378218:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3af5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1875336022298752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460023.378344:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0cf73fe6-82e2-434e-b670-631647721b2c:3662:1875336022298624:0@lo:400:kworker.0 00000100:00100000:2.0:1788460023.378390:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1875336022299264:0@lo:400:kworker.0 00000100:00100000:0.0:1788460023.382210:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3af5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1875336022298752:12345-0@lo:400:kworker.0 Request processed in 3983us (4120us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460023.382224:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788460023.383128:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022298880:0@lo:400:kworker.0 00000100:00100000:0.0:1788460023.383181:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460023.383221:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3660:1875336022299392:0@lo:400:kworker.0 00000100:00100000:0.0:1788460023.383243:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460023.383265:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3660:1875336022299904:0@lo:400:kworker.0 00000100:00100000:0.0:1788460023.383285:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460023.383322:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022298880 00000100:00100000:0.0:1788460023.383336:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022298880 00000100:00100000:0.0:1788460023.383387:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788460023.383396:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf2fea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022298880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460023.383448:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf2fea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022298880:12345-0@lo:400:kworker.0 Request processed in 53us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460023.383454:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788460023.383485:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022299392 00000100:00100000:0.0:1788460023.383489:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022299392 00000100:00100000:0.0:1788460023.383519:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022299904 00000100:00100000:0.0:1788460023.383522:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022299904 00000100:00100000:0.0:1788460023.383540:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788460023.383547:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf2fe8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1875336022299392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460023.383576:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf2fe8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1875336022299392:12345-0@lo:400:kworker.0 Request processed in 31us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460023.383582:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788460023.383593:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788460023.383599:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf2febb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1875336022299904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460023.383625:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf2febb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1875336022299904:12345-0@lo:400:kworker.0 Request processed in 27us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460023.383643:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788460023.383672:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875336022299008:0@lo:400:kworker.0 00000100:00100000:0.0:1788460023.383696:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460023.383712:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022299520:0@lo:400:kworker.0 00000100:00100000:0.0:1788460023.383733:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460023.383750:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022300032:0@lo:400:kworker.0 00000100:00100000:0.0:1788460023.383770:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460023.383805:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022299520 00000100:00100000:0.0:1788460023.383809:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022299520 00000100:00100000:0.0:1788460023.383832:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022300032 00000100:00100000:0.0:1788460023.383835:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022300032 00000100:00100000:0.0:1788460023.383855:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788460023.383862:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf2fe8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022299520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460023.383898:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf2fe8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022299520:12345-0@lo:400:kworker.0 Request processed in 36us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460023.383904:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788460023.383915:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788460023.383921:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf2fe8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1875336022300032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460023.383970:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf2fe8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1875336022300032:12345-0@lo:400:kworker.0 Request processed in 49us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460023.383977:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788460023.384012:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022299008 00000100:00100000:0.0:1788460023.384015:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022299008 00000100:00100000:0.0:1788460023.384037:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788460023.384043:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf2fe8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1875336022299008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460023.384071:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf2fe8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1875336022299008:12345-0@lo:400:kworker.0 Request processed in 28us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460023.384078:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788460023.384116:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875336022299008:0@lo:400:kworker.0 00010000:00080000:0.0:1788460023.384130:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3af4000 x1875336022299520/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788460039 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460023.384139:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022299520:0@lo:400:kworker.0 00010000:00080000:0.0:1788460023.384148:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3af4a80 x1875336022300032/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788460039 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460023.384164:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022300032:0@lo:400:kworker.0 00000100:00100000:0.0:1788460023.384196:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022298880:0@lo:400:kworker.0 00010000:00080000:0.0:1788460023.384205:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3af6d80 x1875336022299392/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460039 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460023.384211:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3660:1875336022299392:0@lo:400:kworker.0 00010000:00080000:0.0:1788460023.384220:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3af4700 x1875336022299904/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460039 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460023.384227:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3660:1875336022299904:0@lo:400:kworker.0 00000100:00080000:0.0:1788460023.384284:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788460023.384289:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788460023.384291:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788460023.387074:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460023.387143:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022299136:0@lo:400:kworker.0 00000100:00100000:1.0:1788460023.387178:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460023.387216:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022299136 00000100:00100000:1.0:1788460023.387224:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022299136 00000100:00100000:1.0:1788460023.387278:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788460023.387287:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac39d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1875336022299136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460023.387379:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022298624 00000100:00100000:0.0:1788460023.387384:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022298624 00000100:00100000:0.0:1788460023.387416:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:0.0:1788460023.387423:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+29:3662:x1875336022298624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460023.387428:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460023.387451:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1875336022299776:0@lo:400:kworker.0 00000100:00100000:0.0:1788460023.387480:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+29:3662:x1875336022298624:12345-0@lo:400:kworker.0 Request processed in 47us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460023.387487:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460023.387488:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1788460023.387530:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1875336022298752:0@lo:400:kworker.0 00000100:00100000:0.0:1788460023.387537:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022299648:0@lo:400:kworker.0 00000100:00100000:2.0:1788460023.387553:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022299264 00000100:00100000:2.0:1788460023.387557:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022299264 00000100:00100000:0.0:1788460023.387561:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460023.387582:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022299648 00000100:00100000:0.0:1788460023.387585:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022299648 00000100:00100000:2.0:1788460023.387589:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022299776 00000100:00100000:2.0:1788460023.387592:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022299776 00000100:00100000:2.0:1788460023.387609:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788460023.387609:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788460023.387615:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3af4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1875336022299264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460023.387615:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac366bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1875336022299648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460023.387651:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3af4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1875336022299264:12345-0@lo:400:kworker.0 Request processed in 36us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460023.387658:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788460023.387670:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788460023.387676:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3af6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1875336022299776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460023.387701:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3af6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1875336022299776:12345-0@lo:400:kworker.0 Request processed in 26us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460023.387706:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00080000:2.0:1788460023.387722:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788460023.387726:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788460023.387751:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1875336022299264:0@lo:400:kworker.0 00000100:00100000:2.0:1788460023.387760:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1875336022299776:0@lo:400:kworker.0 00000100:00100000:0.0:1788460023.387802:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac366bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1875336022299648:12345-0@lo:400:kworker.0 Request processed in 186us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460023.387809:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:0.0:1788460023.387845:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3af7800 x1875336022299648/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788460039 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460023.387857:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022299648:0@lo:400:kworker.0 00000100:00100000:0.0:1788460023.387864:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac39d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022300160:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788460023.387887:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460023.387926:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0cf73fe6-82e2-434e-b670-631647721b2c:3662:1875336022298624:0@lo:400:kworker.0 00000100:00100000:2.0:1788460023.388103:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022300160 00000100:00100000:2.0:1788460023.388108:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022300160 00000100:00100000:2.0:1788460023.388142:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788460023.388150:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3668e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875336022300160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788460023.388166:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788460023.388199:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3668e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875336022300160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460023.388212:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:0.0:1788460023.388284:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac39d1500 x1875336022300160/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460039 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460023.388299:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac39d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022300160:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788460023.393807:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac39d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1875336022299136:12345-0@lo:400:kworker.0 Request processed in 6512us (6619us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460023.393822:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788460023.393845:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022299136:0@lo:400:kworker.0 00010000:00010000:0.0:1788460023.569671:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460023.750416:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460023.750459:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460023.750485:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460023.750505:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460023.750528:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460023.750539:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003340416 00000100:00100000:0.0:1788460023.750549:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003340416 00000100:00100000:3.0:1788460023.750555:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003340672 00000100:00100000:3.0:1788460023.750561:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003340672 00000100:00100000:3.0:1788460023.750605:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003340288 00000100:00100000:0.0:1788460023.750607:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003340544 00000100:00100000:3.0:1788460023.750609:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003340288 00000100:00100000:0.0:1788460023.750613:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003340544 00000100:00100000:3.0:1788460023.750636:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 181 00000100:00100000:3.0:1788460023.750645:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc43fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a5915a6d-4114-41fb-8d95-33add86e0720+5:2395:x1875336003340672:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:1.0:1788460023.750706:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003340160 00000100:00100000:1.0:1788460023.750712:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003340160 00000100:00100000:3.0:1788460023.750731:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc43fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a5915a6d-4114-41fb-8d95-33add86e0720+5:2395:x1875336003340672:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 85us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460023.750749:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 347 00000100:00100000:1.0:1788460023.750757:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bed032f6-c389-485e-b2f7-e2ea34763c65+14:2395:x1875336003340160:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:1.0:1788460023.750788:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bed032f6-c389-485e-b2f7-e2ea34763c65+14:2395:x1875336003340160:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 32us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460023.750795:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 347 00000100:00080000:1.0:1788460023.751240:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788460023.751245:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788460023.751780:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 182 00000100:00100000:0.0:1788460023.751793:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc43f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2395:x1875336003340416:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:0.0:1788460023.751859:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc43f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2395:x1875336003340416:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 70us (1399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460023.751867:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 182 00000100:00100000:0.0:1788460023.751884:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 183 00000100:00100000:0.0:1788460023.751900:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc43fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:2395:x1875336003340288:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:0.0:1788460023.751928:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc43fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:2395:x1875336003340288:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 30us (1422us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460023.751934:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 183 00000100:00100000:0.0:1788460023.751963:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 184 00000100:00100000:0.0:1788460023.751970:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc43f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a5915a6d-4114-41fb-8d95-33add86e0720+5:2395:x1875336003340544:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:0.0:1788460023.752004:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc43f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a5915a6d-4114-41fb-8d95-33add86e0720+5:2395:x1875336003340544:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 35us (1476us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460023.752009:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 184 00000100:00100000:3.0:1788460023.756695:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 181 00000020:00000080:1.0:1788460024.056698:0:13199:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe7fb102c0 20000000:00000080:1.0:1788460024.056714:0:13199:0:(mgs_handler.c:1172:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8c4ac2b3a000 uarg=0000000000000000 20000000:01000000:1.0:1788460024.056760:0:13199:0:(mgs_llog.c:6198:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788460024.056765:0:13199:0:(mgs_llog.c:4653:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788460024.056769:0:13199:0:(mgs_llog.c:1385:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788460024.057414:0:13200:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1788460024.057495:0:13199:0:(mgs_llog.c:1456:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788460024.063871:0:13199:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788460024.063899:0:13199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c4bfadc6400/0x5dfa74784542af78 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460024.064037:0:13199:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4ac395f600/0x5dfa74784542af08 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542af01 expref: 28 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460024.064044:0:13199:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4ac395f400/0x5dfa74784542af16 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542af0f expref: 28 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460024.064050:0:13199:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4bef208c00/0x5dfa74784542af24 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542af1d expref: 28 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460024.064056:0:13199:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4bef208400/0x5dfa74784542af32 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542af2b expref: 28 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460024.064064:0:13199:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4ac3677600/0x5dfa74784542af39 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a511 expref: 13 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460024.064070:0:13199:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4bef209800/0x5dfa74784542af55 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a557 expref: 13 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460024.064076:0:13199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c4bfadc6400/0x5dfa74784542af78 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460024.064118:0:13199:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4bef209800/0x5dfa74784542af55 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a557 expref: 13 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460024.064147:0:13199:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c4bef209800/0x5dfa74784542af55 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a557 expref: 13 pid: 6528 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460024.064162:0:13199:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13199:1875336022300288:192.168.206.5@tcp:104: 00010000:00010000:2.0:1788460024.064301:0:13199:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4ac3677600/0x5dfa74784542af39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a511 expref: 13 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460024.064309:0:13199:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c4ac3677600/0x5dfa74784542af39 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a511 expref: 13 pid: 6525 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460024.064318:0:13199:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13199:1875336022300416:192.168.206.5@tcp:104: 00010000:00010000:2.0:1788460024.064356:0:13199:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4bef208400/0x5dfa74784542af32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5dfa74784542af2b expref: 28 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460024.064364:0:13199:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c4bef208400/0x5dfa74784542af32 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5dfa74784542af2b expref: 28 pid: 6528 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460024.064373:0:13199:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13199:1875336022300544:0@lo:104: 00000100:00100000:2.0:1788460024.064406:0:13199:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788460024.064449:0:13199:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4bef208c00/0x5dfa74784542af24 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5dfa74784542af1d expref: 28 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460024.064457:0:13199:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c4bef208c00/0x5dfa74784542af24 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5dfa74784542af1d expref: 28 pid: 6525 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460024.064466:0:13199:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13199:1875336022300672:0@lo:104: 00000100:00100000:2.0:1788460024.064487:0:13199:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460024.064692:0:10353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022300544 00000100:00100000:1.0:1788460024.064699:0:10353:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022300544 00000100:00100000:2.0:1788460024.064733:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022300672 00000100:00100000:2.0:1788460024.064737:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022300672 00000100:00100000:1.0:1788460024.064782:0:10353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788460024.064791:0:10353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3af5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:0cf73fe6-82e2-434e-b670-631647721b2c+4:13199:x1875336022300544:12345-0@lo:104: 00010000:00010000:1.0:1788460024.064804:0:10353:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.206.105@tcp lock: ffff8c4bef208200/0x5dfa74784542af2b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542af32 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460024.064851:0:10353:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788460024.064856:0:10353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3af5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:0cf73fe6-82e2-434e-b670-631647721b2c+4:13199:x1875336022300544:12345-0@lo:104: Request processed in 68us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460024.064863:0:10353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788460024.064880:0:10353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788460024.064886:0:10353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3af4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:0cf73fe6-82e2-434e-b670-631647721b2c+3:13199:x1875336022300672:12345-0@lo:104: 00010000:00010000:1.0:1788460024.064893:0:10353:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.206.105@tcp lock: ffff8c4bef209e00/0x5dfa74784542af1d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542af24 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460024.064969:0:10353:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788460024.064975:0:10353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3af4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:0cf73fe6-82e2-434e-b670-631647721b2c+3:13199:x1875336022300672:12345-0@lo:104: Request processed in 90us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460024.064991:0:10353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00010000:0.0:1788460024.065042:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788460024.065049:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: ffff8c4bef208200/0x5dfa74784542af2b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542af32 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460024.065056:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bef208200 already unused, calling callback (ffffffffc125ae00) 10000000:00010000:0.0:1788460024.065060:0:6521:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: ffff8c4bef208200/0x5dfa74784542af2b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5dfa74784542af32 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460024.065068:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: ffff8c4bef208200/0x5dfa74784542af2b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5dfa74784542af32 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788460024.065076:0:6521:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: ffff8c4bef208200/0x5dfa74784542af2b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5dfa74784542af32 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788460024.065086:0:6521:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788460024.065119:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.206.105@tcp lock: ffff8c4bef208200/0x5dfa74784542af2b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542af32 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460024.065126:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788460024.065152:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: ffff8c4bef208200/0x5dfa74784542af2b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542af32 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460024.065159:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: ffff8c4bef208200/0x5dfa74784542af2b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542af32 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460024.065171:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788460024.065175:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: ffff8c4bef209e00/0x5dfa74784542af1d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542af24 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460024.065185:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bef209e00 already unused, calling callback (ffffffffc125ae00) 10000000:00010000:0.0:1788460024.065188:0:6521:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: ffff8c4bef209e00/0x5dfa74784542af1d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5dfa74784542af24 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460024.065194:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: ffff8c4bef209e00/0x5dfa74784542af1d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5dfa74784542af24 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788460024.065200:0:6521:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: ffff8c4bef209e00/0x5dfa74784542af1d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5dfa74784542af24 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788460024.065206:0:6521:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788460024.065219:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.206.105@tcp lock: ffff8c4bef209e00/0x5dfa74784542af1d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542af24 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460024.065226:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788460024.065242:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: ffff8c4bef209e00/0x5dfa74784542af1d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542af24 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460024.065247:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: ffff8c4bef209e00/0x5dfa74784542af1d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542af24 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460024.065256:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460024.065263:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460024.065265:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788460024.065284:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0cf73fe6-82e2-434e-b670-631647721b2c:3659:1875336022300800:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788460024.065315:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460024.065361:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788460024.065370:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0cf73fe6-82e2-434e-b670-631647721b2c:3659:1875336022300928:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788460024.065392:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460024.065427:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022300800 00000100:00100000:0.0:1788460024.065431:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022300800 00010000:00010000:0.0:1788460024.065452:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4bef208400/0x5dfa74784542af32 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542af2b expref: 29 pid: 6528 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460024.065473:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022300928 00000100:00100000:0.0:1788460024.065480:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022300928 00010000:00010000:0.0:1788460024.065493:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4bef208c00/0x5dfa74784542af24 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542af1d expref: 30 pid: 6525 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460024.065513:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788460024.065519:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3afaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0cf73fe6-82e2-434e-b670-631647721b2c+30:3659:x1875336022300800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788460024.065530:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788460024.065535:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4bef208400/0x5dfa74784542af32 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542af2b expref: 30 pid: 6528 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460024.065547:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4bef208400/0x5dfa74784542af32 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5dfa74784542af2b expref: 30 pid: 6528 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460024.065564:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788460024.065595:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3afaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0cf73fe6-82e2-434e-b670-631647721b2c+30:3659:x1875336022300800:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460024.065601:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788460024.065627:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788460024.065633:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3afad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0cf73fe6-82e2-434e-b670-631647721b2c+29:3659:x1875336022300928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788460024.065640:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788460024.065647:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4bef208c00/0x5dfa74784542af24 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542af1d expref: 29 pid: 6525 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460024.065655:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4bef208c00/0x5dfa74784542af24 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5dfa74784542af1d expref: 29 pid: 6525 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460024.065667:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788460024.065691:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3afad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0cf73fe6-82e2-434e-b670-631647721b2c+29:3659:x1875336022300928:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460024.065700:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788460024.065742:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0cf73fe6-82e2-434e-b670-631647721b2c:3659:1875336022300928:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788460024.065845:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0cf73fe6-82e2-434e-b670-631647721b2c:3659:1875336022300800:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788460024.066724:0:13199:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4ac395f400/0x5dfa74784542af16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5dfa74784542af0f expref: 28 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460024.066737:0:13199:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c4ac395f400/0x5dfa74784542af16 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5dfa74784542af0f expref: 28 pid: 6525 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460024.066750:0:13199:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13199:1875336022301056:0@lo:104: 00000100:00100000:2.0:1788460024.066788:0:13199:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460024.066817:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022301056 00000100:00100000:2.0:1788460024.066823:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022301056 00000100:00100000:2.0:1788460024.066851:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788460024.066858:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3af4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0cf73fe6-82e2-434e-b670-631647721b2c+3:13199:x1875336022301056:12345-0@lo:104: 00010000:00010000:2.0:1788460024.066868:0:6516:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.206.105@tcp lock: ffff8c4ac2840400/0x5dfa74784542af0f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542af16 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460024.066904:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788460024.066909:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3af4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0cf73fe6-82e2-434e-b670-631647721b2c+3:13199:x1875336022301056:12345-0@lo:104: Request processed in 53us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460024.066916:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00010000:2.0:1788460024.066974:0:13199:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4ac395f600/0x5dfa74784542af08 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5dfa74784542af01 expref: 28 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460024.066995:0:13199:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c4ac395f600/0x5dfa74784542af08 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5dfa74784542af01 expref: 28 pid: 6525 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460024.067003:0:13199:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13199:1875336022301184:0@lo:104: 00000100:00100000:2.0:1788460024.067029:0:13199:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460024.067057:0:6516:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788460024.067077:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022301184 00000100:00100000:2.0:1788460024.067080:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022301184 00000100:00100000:2.0:1788460024.067099:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788460024.067105:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf7797850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0cf73fe6-82e2-434e-b670-631647721b2c+3:13199:x1875336022301184:12345-0@lo:104: 00010000:00010000:2.0:1788460024.067113:0:6516:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.206.105@tcp lock: ffff8c4ac2841200/0x5dfa74784542af01 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542af08 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460024.067147:0:6516:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788460024.067152:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf7797850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0cf73fe6-82e2-434e-b670-631647721b2c+3:13199:x1875336022301184:12345-0@lo:104: Request processed in 48us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460024.067158:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788460024.067201:0:13199:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc4d56a80 going to sleep for 11 seconds 00010000:00010000:2.0:1788460024.067220:0:13199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4bef208400/0x5dfa74784542af32 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5dfa74784542af2b expref: 28 pid: 6528 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460024.067249:0:13199:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af5180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13199:1875336022300544:0@lo:104: 00010000:00010000:2.0:1788460024.067261:0:13199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4bef208c00/0x5dfa74784542af24 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5dfa74784542af1d expref: 27 pid: 6525 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460024.067269:0:13199:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13199:1875336022300672:0@lo:104: 00000100:00100000:2.0:1788460024.067276:0:13199:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13199:1875336022301056:0@lo:104: 00000100:00100000:2.0:1788460024.067283:0:13199:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13199:1875336022301184:0@lo:104: 00010000:00010000:0.0:1788460024.067813:0:9536:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788460024.067820:0:9536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: ffff8c4ac2840400/0x5dfa74784542af0f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542af16 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460024.067829:0:9536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac2840400 already unused, calling callback (ffffffffc125ae00) 10000000:00010000:0.0:1788460024.067833:0:9536:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: ffff8c4ac2840400/0x5dfa74784542af0f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5dfa74784542af16 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460024.067841:0:9536:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: ffff8c4ac2840400/0x5dfa74784542af0f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5dfa74784542af16 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788460024.067849:0:9536:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: ffff8c4ac2840400/0x5dfa74784542af0f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5dfa74784542af16 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788460024.067868:0:9536:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788460024.068055:0:9536:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.206.105@tcp lock: ffff8c4ac2840400/0x5dfa74784542af0f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542af16 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460024.068062:0:9536:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788460024.068464:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0cf73fe6-82e2-434e-b670-631647721b2c:3661:1875336022301312:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788460024.068510:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788460024.068563:0:9536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: ffff8c4ac2840400/0x5dfa74784542af0f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542af16 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460024.068571:0:9536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: ffff8c4ac2840400/0x5dfa74784542af0f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542af16 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460024.068585:0:9536:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788460024.068589:0:9536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: ffff8c4ac2841200/0x5dfa74784542af01 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542af08 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460024.068595:0:9536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac2841200 already unused, calling callback (ffffffffc125ae00) 10000000:00010000:0.0:1788460024.068598:0:9536:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: ffff8c4ac2841200/0x5dfa74784542af01 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5dfa74784542af08 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460024.068606:0:9536:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: ffff8c4ac2841200/0x5dfa74784542af01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5dfa74784542af08 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788460024.068613:0:9536:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: ffff8c4ac2841200/0x5dfa74784542af01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5dfa74784542af08 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788460024.068618:0:9536:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788460024.068640:0:9536:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.206.105@tcp lock: ffff8c4ac2841200/0x5dfa74784542af01 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542af08 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460024.068647:0:9536:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788460024.068688:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788460024.068694:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0cf73fe6-82e2-434e-b670-631647721b2c:3661:1875336022301440:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788460024.068716:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788460024.068815:0:9536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: ffff8c4ac2841200/0x5dfa74784542af01 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542af08 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460024.068823:0:9536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: ffff8c4ac2841200/0x5dfa74784542af01 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542af08 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460024.068838:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460024.068840:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460024.068842:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460024.068848:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788460024.068863:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022301312 00000100:00100000:0.0:1788460024.068868:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022301312 00010000:00010000:0.0:1788460024.068893:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4ac395f400/0x5dfa74784542af16 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542af0f expref: 27 pid: 6525 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460024.069043:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022301440 00000100:00100000:0.0:1788460024.069048:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022301440 00010000:00010000:0.0:1788460024.069061:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4ac395f600/0x5dfa74784542af08 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542af01 expref: 28 pid: 6525 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460024.069546:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788460024.069557:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3af5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0cf73fe6-82e2-434e-b670-631647721b2c+28:3661:x1875336022301312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788460024.069570:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460024.069576:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4ac395f400/0x5dfa74784542af16 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542af0f expref: 28 pid: 6525 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460024.069586:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4ac395f400/0x5dfa74784542af16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5dfa74784542af0f expref: 28 pid: 6525 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460024.069601:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4ac395f400/0x5dfa74784542af16 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5dfa74784542af0f expref: 28 pid: 6525 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460024.069613:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788460024.069654:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3af5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0cf73fe6-82e2-434e-b670-631647721b2c+27:3661:x1875336022301312:12345-0@lo:103:ldlm_bl.0 Request processed in 100us (1143us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460024.069660:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788460024.069678:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788460024.069683:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3af5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0cf73fe6-82e2-434e-b670-631647721b2c+26:3661:x1875336022301440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788460024.069690:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460024.069694:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4ac395f600/0x5dfa74784542af08 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542af01 expref: 26 pid: 6525 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460024.069701:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4ac395f600/0x5dfa74784542af08 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5dfa74784542af01 expref: 26 pid: 6525 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460024.069710:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4ac395f600/0x5dfa74784542af08 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5dfa74784542af01 expref: 26 pid: 6525 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460024.069717:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788460024.069747:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3af5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0cf73fe6-82e2-434e-b670-631647721b2c+25:3661:x1875336022301440:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (1031us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460024.069754:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788460024.069789:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0cf73fe6-82e2-434e-b670-631647721b2c:3661:1875336022301440:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788460024.069798:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0cf73fe6-82e2-434e-b670-631647721b2c:3661:1875336022301312:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788460024.069833:0:13199:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13199:1875336022300288:192.168.206.5@tcp:104: 00000100:00100000:2.0:1788460024.069843:0:13199:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13199:1875336022300416:192.168.206.5@tcp:104: 00000100:00100000:3.0:1788460024.069845:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00010000:00010000:2.0:1788460024.069875:0:13199:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c4bfadc6400/0x5dfa74784542af78 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460024.070513:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003340800 00000100:00100000:0.0:1788460024.070521:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003340800 00010000:00010000:0.0:1788460024.070543:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4bef209800/0x5dfa74784542af55 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a557 expref: 14 pid: 6528 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460024.070564:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 52 00000100:00100000:0.0:1788460024.070572:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3999f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bed032f6-c389-485e-b2f7-e2ea34763c65+14:2394:x1875336003340800:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788460024.070581:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788460024.070586:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4bef209800/0x5dfa74784542af55 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a557 expref: 14 pid: 6528 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460024.070610:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4bef209800/0x5dfa74784542af55 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a557 expref: 14 pid: 6528 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460024.070624:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4bef209800/0x5dfa74784542af55 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a557 expref: 14 pid: 6528 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460024.070635:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788460024.070677:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3999f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bed032f6-c389-485e-b2f7-e2ea34763c65+13:2394:x1875336003340800:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 106us (832us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460024.070684:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 52 00010000:00010000:1.0:1788460024.071216:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788460024.073738:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460024.073839:0:9538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003340928 00000100:00100000:2.0:1788460024.073849:0:9538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003340928 00010000:00010000:2.0:1788460024.073885:0:9538:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4ac3677600/0x5dfa74784542af39 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a511 expref: 13 pid: 6525 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460024.073929:0:9538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 53 00000100:00100000:2.0:1788460024.073939:0:9538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3afa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bed032f6-c389-485e-b2f7-e2ea34763c65+13:2393:x1875336003340928:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788460024.073973:0:9538:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460024.073980:0:9538:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4ac3677600/0x5dfa74784542af39 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a511 expref: 13 pid: 6525 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460024.074003:0:9538:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4ac3677600/0x5dfa74784542af39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a511 expref: 13 pid: 6525 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460024.074020:0:9538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4ac3677600/0x5dfa74784542af39 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a511 expref: 13 pid: 6525 timeout: 421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460024.074052:0:9538:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c4bfadc6400/0x5dfa74784542af78 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460024.074060:0:9538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bfadc6400/0x5dfa74784542af78 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460024.074074:0:9538:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c4bfadc6400/0x5dfa74784542af78 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460024.074082:0:9538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c4bfadc6400/0x5dfa74784542af78 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460024.074088:0:9538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c4bfadc6400/0x5dfa74784542af78 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460024.074095:0:9538:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c4bfadc6400/0x5dfa74784542af78 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460024.074101:0:9538:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bfadc6400 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:2.0:1788460024.074105:0:9538:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c4bfadc6400/0x5dfa74784542af78 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460024.074113:0:9538:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c4bfadc6400/0x5dfa74784542af78 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460024.074560:0:13199:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c4bfadc6400/0x5dfa74784542af78 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460024.074570:0:13199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c4bfadc6400/0x5dfa74784542af78 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460024.077865:0:9538:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c4bfadc6400/0x5dfa74784542af78 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460024.077881:0:9538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4bfadc6400/0x5dfa74784542af78 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460024.077921:0:9538:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788460024.078135:0:9538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3afa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bed032f6-c389-485e-b2f7-e2ea34763c65+12:2393:x1875336003340928:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 4194us (4401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460024.078145:0:9538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 53 00010000:00010000:0.0:1788460024.595490:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788460025.409924:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460025.412122:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003341056 00000100:00100000:2.0:1788460025.412141:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003341056 00000100:00100000:2.0:1788460025.412230:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 348 00000100:00100000:2.0:1788460025.412243:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bed032f6-c389-485e-b2f7-e2ea34763c65+12:6163:x1875336003341056:12345-192.168.206.5@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788460025.412268:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460025.412292:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4bfadc6a00/0x5dfa74784542af7f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a588 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460025.412327:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bfadc6a00/0x5dfa74784542af7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a588 expref: 13 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460025.412341:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4bfadc6a00/0x5dfa74784542af7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a588 expref: 13 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460025.412352:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bfadc6a00, rc 0) 00000100:00100000:2.0:1788460025.412434:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bed032f6-c389-485e-b2f7-e2ea34763c65+13:6163:x1875336003341056:12345-192.168.206.5@tcp:101:ll_cfg_requeue.0 Request processed in 193us (2524us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460025.412442:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 348 00000100:00100000:1.0:1788460025.419404:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460025.419503:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003341184 00000100:00100000:2.0:1788460025.419515:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003341184 00000100:00100000:2.0:1788460025.419588:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 349 00000100:00100000:2.0:1788460025.419599:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4c02042850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bed032f6-c389-485e-b2f7-e2ea34763c65+13:6163:x1875336003341184:12345-192.168.206.5@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788460025.419813:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4c02042850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bed032f6-c389-485e-b2f7-e2ea34763c65+13:6163:x1875336003341184:12345-192.168.206.5@tcp:501:ll_cfg_requeue.0 Request processed in 215us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460025.419822:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 349 10000000:01000000:1.0:1788460025.427040:0:6530:0:(mgc_request.c:715:do_requeue()) updating log params 10000000:01000000:1.0:1788460025.427051:0:6530:0:(mgc_request.c:2266:mgc_process_log()) Process log params-ffff8c4bfc4e5800 from 7 10000000:01000000:1.0:1788460025.427075:0:6530:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788460025.427140:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677a00/0x5dfa74784542af86 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460025.427156:0:6530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677a00/0x5dfa74784542af86 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460025.427674:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00010000:00010000:1.0:1788460025.428308:0:6530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677a00/0x5dfa74784542af86 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460025.428350:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac39d1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022301568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788460025.428416:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460025.428473:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac25b6a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788460025.428501:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003341312 00000100:00100000:1.0:1788460025.428510:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003341312 00000100:00100000:1.0:1788460025.428564:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022301568 00000100:00100000:1.0:1788460025.428568:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022301568 00000100:00100000:1.0:1788460025.428590:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 350 00000100:00100000:1.0:1788460025.428600:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc844a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bed032f6-c389-485e-b2f7-e2ea34763c65+13:6163:x1875336003341312:12345-192.168.206.5@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788460025.428766:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc844a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bed032f6-c389-485e-b2f7-e2ea34763c65+13:6163:x1875336003341312:12345-192.168.206.5@tcp:503:ll_cfg_requeue.0 Request processed in 166us (1099us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460025.428777:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 350 00000100:00100000:1.0:1788460025.428810:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1788460025.428819:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bca61bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+25:6530:x1875336022301568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788460025.428828:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460025.428847:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4ac3676200/0x5dfa74784542af8d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542af86 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460025.428875:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4ac3676200/0x5dfa74784542af8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542af86 expref: 26 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460025.428909:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4ac3676200/0x5dfa74784542af8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542af86 expref: 26 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460025.428921:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ac3676200, rc 0) 00000100:00100000:1.0:1788460025.428997:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bca61bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+26:6530:x1875336022301568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 180us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460025.429005:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1788460025.429197:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac39d1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022301568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788460025.429213:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677a00/0x5dfa74784542af86 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542af8d expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460025.429223:0:6530:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677a00/0x5dfa74784542af86 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542af8d expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788460025.429354:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 7 00000040:00080000:1.0:1788460025.429705:0:6530:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788460025.429932:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1788460025.430005:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 112 off8528 00000040:00080000:1.0:1788460025.430019:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 224 off8752 00000040:00080000:1.0:1788460025.430034:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8976 00000040:00080000:1.0:1788460025.430047:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 112 off9088 00000040:00080000:1.0:1788460025.430066:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 224 off9312 00000040:00080000:1.0:1788460025.430071:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 6 count 7 00000100:00100000:1.0:1788460025.430147:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac39d1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022301696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788460025.430200:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460025.430232:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac25b6a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788460025.431675:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022301696 00000100:00100000:3.0:1788460025.431696:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022301696 00000100:00100000:0.0:1788460025.434226:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1788460025.434248:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bca61a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+26:6530:x1875336022301696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788460025.434507:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bca61a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+26:6530:x1875336022301696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 267us (4305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460025.434516:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1788460025.434747:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac39d1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022301696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788460025.434797:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac399bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022301824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788460025.435149:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460025.435197:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bedec20c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788460025.435369:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022301824 00000100:00100000:0.0:1788460025.435376:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022301824 00000100:00100000:0.0:1788460025.435411:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1788460025.435420:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+26:6530:x1875336022301824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788460025.435522:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+26:6530:x1875336022301824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 102us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460025.435529:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1788460025.436363:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac399bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022301824:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788460025.436827:0:6530:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788460025.436914:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac399bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022301952:0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788460025.437004:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460025.437050:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bedec20c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788460025.437568:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022301952 00000100:00100000:1.0:1788460025.437583:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022301952 00000100:00100000:1.0:1788460025.437645:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:1.0:1788460025.437654:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+26:6530:x1875336022301952:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788460025.437769:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+26:6530:x1875336022301952:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 115us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460025.437776:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1788460025.438192:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac399bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022301952:0@lo:502:ll_cfg_requeue.0 00000040:00080000:3.0:1788460025.440358:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1788460025.440412:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 112 off8528 00000040:00080000:3.0:1788460025.440429:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 224 off8752 00000040:00080000:3.0:1788460025.440445:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8976 00000040:00080000:3.0:1788460025.440458:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 112 off9088 00000100:00100000:3.0:1788460025.440508:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac399bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022302080:0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788460025.440584:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460025.440634:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bedec20c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788460025.441378:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022302080 00000100:00100000:1.0:1788460025.441387:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022302080 00000100:00100000:1.0:1788460025.441450:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1788460025.441459:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+26:6530:x1875336022302080:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788460025.441579:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+26:6530:x1875336022302080:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 121us (994us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460025.441587:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1788460025.447073:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460025.447119:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003341440 00000100:00100000:2.0:1788460025.447128:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003341440 00000100:00100000:2.0:1788460025.447188:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 356 00000100:00100000:2.0:1788460025.447197:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bed032f6-c389-485e-b2f7-e2ea34763c65+13:6163:x1875336003341440:12345-192.168.206.5@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788460025.447213:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460025.447231:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4bfadc7c00/0x5dfa74784542af94 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a58f expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460025.447258:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bfadc7c00/0x5dfa74784542af94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a58f expref: 14 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460025.447270:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4bfadc7c00/0x5dfa74784542af94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a58f expref: 14 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460025.447291:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bfadc7c00, rc 0) 00000100:00100000:2.0:1788460025.447345:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bed032f6-c389-485e-b2f7-e2ea34763c65+14:6163:x1875336003341440:12345-192.168.206.5@tcp:101:ll_cfg_requeue.0 Request processed in 148us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460025.447352:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 356 00000100:00100000:3.0:1788460025.447573:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac399bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022302080:0@lo:502:ll_cfg_requeue.0 00000040:00080000:3.0:1788460025.448169:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 224 off9312 00000040:00080000:3.0:1788460025.448183:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 6 count 7 00000100:00100000:0.0:1788460025.450210:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460025.450432:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003341568 00000100:00100000:2.0:1788460025.450442:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003341568 00000100:00100000:2.0:1788460025.450499:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 357 00000100:00100000:2.0:1788460025.450509:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bed032f6-c389-485e-b2f7-e2ea34763c65+14:6163:x1875336003341568:12345-192.168.206.5@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788460025.451226:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bed032f6-c389-485e-b2f7-e2ea34763c65+14:6163:x1875336003341568:12345-192.168.206.5@tcp:501:ll_cfg_requeue.0 Request processed in 715us (1020us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460025.451419:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 357 00000100:00100000:3.0:1788460025.453816:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460025.453868:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003341696 00000100:00100000:3.0:1788460025.453883:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003341696 00000100:00100000:3.0:1788460025.454008:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 358 00000100:00100000:3.0:1788460025.454024:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bed032f6-c389-485e-b2f7-e2ea34763c65+14:6163:x1875336003341696:12345-192.168.206.5@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788460025.454217:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bed032f6-c389-485e-b2f7-e2ea34763c65+14:6163:x1875336003341696:12345-192.168.206.5@tcp:503:ll_cfg_requeue.0 Request processed in 197us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460025.454226:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 358 00000040:00080000:2.0:1788460025.455921:0:13243:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 64768 count 7 00000020:01000000:1.0:1788460025.456247:0:6530:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788460025.456263:0:6530:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788460025.456282:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677a00/0x5dfa74784542af86 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542af8d expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460025.456294:0:6530:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677a00/0x5dfa74784542af86 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542af8d expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788460025.456309:0:6530:0:(mgc_request.c:715:do_requeue()) updating log params 10000000:01000000:1.0:1788460025.456311:0:6530:0:(mgc_request.c:2266:mgc_process_log()) Process log params-ffff8c4bef21b800 from 7 10000000:01000000:1.0:1788460025.456314:0:6530:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788460025.456348:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac3676c00/0x5dfa74784542af9b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460025.456357:0:6530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4ac3676c00/0x5dfa74784542af9b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460025.456379:0:6530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4ac3676c00/0x5dfa74784542af9b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460025.456403:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac39d1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022302208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788460025.456463:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460025.456505:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac25b6000 going to sleep for 11 seconds 00000100:00100000:2.0:1788460025.456725:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022302208 00000100:00100000:2.0:1788460025.456732:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022302208 00000100:00100000:2.0:1788460025.456783:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:2.0:1788460025.456793:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+26:6530:x1875336022302208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788460025.456806:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460025.456817:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4bfadc7800/0x5dfa74784542afa2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542af9b expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460025.456839:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bfadc7800/0x5dfa74784542afa2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542af9b expref: 27 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460025.456850:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4bfadc7800/0x5dfa74784542afa2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542af9b expref: 27 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460025.456859:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bfadc7800, rc 0) 00000100:00100000:2.0:1788460025.456898:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+27:6530:x1875336022302208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460025.456904:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1788460025.457058:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac39d1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022302208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788460025.457072:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4ac3676c00/0x5dfa74784542af9b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542afa2 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460025.457720:0:6530:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4ac3676c00/0x5dfa74784542af9b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542afa2 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788460025.457839:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 7 count 7 00000040:00080000:1.0:1788460025.458137:0:6530:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788460025.458328:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:1.0:1788460025.458457:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:1.0:1788460025.458490:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:1.0:1788460025.458514:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:1.0:1788460025.458533:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:1.0:1788460025.458557:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:1.0:1788460025.458565:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 6 count 7 00000100:00100000:1.0:1788460025.458639:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac39d1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022302336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788460025.458693:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460025.458741:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac25b6000 going to sleep for 11 seconds 00000100:00100000:0.0:1788460025.458761:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022302336 00000100:00100000:0.0:1788460025.458768:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022302336 00000100:00100000:0.0:1788460025.458816:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:0.0:1788460025.458827:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+27:6530:x1875336022302336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788460025.459018:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+27:6530:x1875336022302336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 117us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460025.459027:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1788460025.459209:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac39d1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022302336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788460025.459251:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac39d1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022302464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788460025.459318:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460025.459843:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac25b6000 going to sleep for 11 seconds 00000100:00100000:0.0:1788460025.459886:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022302464 00000100:00100000:0.0:1788460025.459893:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022302464 00000100:00100000:0.0:1788460025.460023:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:0.0:1788460025.460035:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+27:6530:x1875336022302464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788460025.460164:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+27:6530:x1875336022302464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 132us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460025.460171:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1788460025.461214:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac39d1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022302464:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788460025.461884:0:6530:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788460025.462028:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022302592:0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788460025.462091:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460025.462128:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bd47b93c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788460025.462288:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022302592 00000100:00100000:1.0:1788460025.462296:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022302592 00000100:00100000:1.0:1788460025.462341:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1788460025.462351:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+27:6530:x1875336022302592:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788460025.462764:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+27:6530:x1875336022302592:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 413us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460025.462773:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:2.0:1788460025.463012:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022302592:0@lo:502:ll_cfg_requeue.0 00000040:00080000:2.0:1788460025.463236:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1788460025.463264:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:2.0:1788460025.463278:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:2.0:1788460025.463291:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:2.0:1788460025.463304:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000100:00100000:2.0:1788460025.463333:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022302720:0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788460025.465297:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460025.465381:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bd47b93c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788460025.467037:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022302720 00000100:00100000:2.0:1788460025.467054:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022302720 00000100:00100000:2.0:1788460025.467118:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:2.0:1788460025.467128:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+27:6530:x1875336022302720:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788460025.467301:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+27:6530:x1875336022302720:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 173us (2013us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460025.467310:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:3.0:1788460025.468192:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022302720:0@lo:502:ll_cfg_requeue.0 00000040:00080000:3.0:1788460025.468331:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:3.0:1788460025.468352:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 6 count 7 00000040:00080000:3.0:1788460025.472929:0:13245:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 64768 count 7 00000020:01000000:2.0:1788460025.478684:0:6530:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788460025.478706:0:6530:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788460025.478717:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac3676c00/0x5dfa74784542af9b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542afa2 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460025.478730:0:6530:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4ac3676c00/0x5dfa74784542af9b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542afa2 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788460025.478747:0:6530:0:(mgc_request.c:715:do_requeue()) updating log params 10000000:01000000:2.0:1788460025.478750:0:6530:0:(mgc_request.c:2266:mgc_process_log()) Process log params-ffff8c4bc438f000 from 7 10000000:01000000:2.0:1788460025.478752:0:6530:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788460025.478790:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7e00/0x5dfa74784542afa9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460025.478799:0:6530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7e00/0x5dfa74784542afa9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460025.478829:0:6530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7e00/0x5dfa74784542afa9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460025.478853:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022302848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788460025.478919:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460025.479004:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bd47b9780 going to sleep for 11 seconds 00000100:00100000:2.0:1788460025.479037:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022302848 00000100:00100000:2.0:1788460025.479044:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022302848 00000100:00100000:2.0:1788460025.479099:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:2.0:1788460025.479108:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+27:6530:x1875336022302848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788460025.479120:0:6525:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460025.479133:0:6525:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4bfadc7600/0x5dfa74784542afb0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542afa9 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460025.479159:0:6525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bfadc7600/0x5dfa74784542afb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542afa9 expref: 28 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460025.479169:0:6525:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4bfadc7600/0x5dfa74784542afb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542afa9 expref: 28 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460025.479177:0:6525:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bfadc7600, rc 0) 00000100:00100000:2.0:1788460025.479233:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+28:6530:x1875336022302848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460025.479242:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:0.0:1788460025.480916:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022302848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788460025.480965:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7e00/0x5dfa74784542afa9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542afb0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460025.480987:0:6530:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7e00/0x5dfa74784542afa9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542afb0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788460025.481137:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x16:0x0] index 7 count 7 00000040:00080000:0.0:1788460025.481734:0:6530:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788460025.481997:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].1, 224 off8416 00000040:00080000:0.0:1788460025.482024:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].2, 112 off8528 00000040:00080000:0.0:1788460025.482039:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].3, 224 off8752 00000040:00080000:0.0:1788460025.482058:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].4, 224 off8976 00000040:00080000:0.0:1788460025.482075:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].5, 112 off9088 00000040:00080000:0.0:1788460025.482113:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].6, 224 off9312 00000040:00080000:0.0:1788460025.482120:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x16:0x0] index 6 count 7 00000100:00100000:0.0:1788460025.482216:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3afbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022302976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788460025.482280:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460025.482328:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc65d7f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788460025.483308:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022302976 00000100:00100000:1.0:1788460025.483327:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022302976 00000100:00100000:1.0:1788460025.483399:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:1.0:1788460025.483412:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+28:6530:x1875336022302976:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788460025.483614:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+28:6530:x1875336022302976:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 205us (1334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460025.483623:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:0.0:1788460025.486716:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3afbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022302976:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788460025.486777:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3afbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022303104:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788460025.486851:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460025.486902:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc65d7f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788460025.487534:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022303104 00000100:00100000:3.0:1788460025.487542:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022303104 00000100:00100000:3.0:1788460025.487606:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:3.0:1788460025.487616:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+28:6530:x1875336022303104:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788460025.487737:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+28:6530:x1875336022303104:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 122us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460025.487745:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:0.0:1788460025.489291:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3afbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022303104:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788460025.492238:0:6530:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788460025.492326:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3afbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022303232:0@lo:502:ll_cfg_requeue.0 00000100:00100000:0.0:1788460025.493534:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460025.493689:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022303232 00000100:00100000:1.0:1788460025.493708:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022303232 00000100:00100000:0.0:1788460025.493715:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc65d7f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788460025.493846:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:1.0:1788460025.493859:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+28:6530:x1875336022303232:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788460025.494099:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+28:6530:x1875336022303232:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 242us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460025.494109:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:0.0:1788460025.494230:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3afbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022303232:0@lo:502:ll_cfg_requeue.0 00000040:00080000:0.0:1788460025.495259:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].1, 224 off8416 00000040:00080000:0.0:1788460025.495303:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].2, 112 off8528 00000040:00080000:0.0:1788460025.495317:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].3, 224 off8752 00000040:00080000:0.0:1788460025.495329:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].4, 224 off8976 00000040:00080000:0.0:1788460025.495347:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].5, 112 off9088 00000100:00100000:0.0:1788460025.495406:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3afbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022303360:0@lo:502:ll_cfg_requeue.0 00000100:00100000:0.0:1788460025.495482:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460025.495537:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc65d7f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788460025.495622:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022303360 00000100:00100000:3.0:1788460025.495636:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022303360 00000100:00100000:3.0:1788460025.495706:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:3.0:1788460025.495716:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+28:6530:x1875336022303360:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788460025.495877:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+28:6530:x1875336022303360:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 161us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460025.495896:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:0.0:1788460025.498656:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3afbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022303360:0@lo:502:ll_cfg_requeue.0 00000040:00080000:0.0:1788460025.498772:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].6, 224 off9312 00000040:00080000:0.0:1788460025.498818:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 6 count 7 00000040:00080000:2.0:1788460025.503753:0:13250:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x18:0x0] index 64768 count 7 00000020:01000000:0.0:1788460025.504092:0:6530:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788460025.504108:0:6530:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788460025.504118:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7e00/0x5dfa74784542afa9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542afb0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460025.504129:0:6530:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7e00/0x5dfa74784542afa9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542afb0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788460025.504140:0:6530:0:(mgc_request.c:715:do_requeue()) updating log params 10000000:01000000:0.0:1788460025.504142:0:6530:0:(mgc_request.c:2266:mgc_process_log()) Process log params-ffff8c4be2d81000 from 7 10000000:01000000:0.0:1788460025.504145:0:6530:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788460025.504180:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0c00/0x5dfa74784542afb7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460025.504188:0:6530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0c00/0x5dfa74784542afb7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460025.504198:0:6530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0c00/0x5dfa74784542afb7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460025.504220:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3afbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022303488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788460025.504292:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460025.504333:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc65d7f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788460025.504886:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022303488 00000100:00100000:1.0:1788460025.504904:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022303488 00000100:00100000:1.0:1788460025.505011:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:1.0:1788460025.505024:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf363f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+28:6530:x1875336022303488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788460025.505059:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460025.505081:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4ac3677600/0x5dfa74784542afbe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542afb7 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460025.505116:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4ac3677600/0x5dfa74784542afbe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542afb7 expref: 29 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460025.505130:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4ac3677600/0x5dfa74784542afbe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542afb7 expref: 29 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460025.505141:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ac3677600, rc 0) 00000100:00100000:1.0:1788460025.507048:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf363f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+29:6530:x1875336022303488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2014us (2743us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460025.507063:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:0.0:1788460025.508265:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3afbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022303488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788460025.508296:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0c00/0x5dfa74784542afb7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542afbe expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460025.508308:0:6530:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0c00/0x5dfa74784542afb7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542afbe expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460025.508387:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3afbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022303616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788460025.508443:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460025.508481:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc65d7f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788460025.508718:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022303616 00000100:00100000:1.0:1788460025.508733:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022303616 00000100:00100000:1.0:1788460025.508801:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1788460025.508812:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf363d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+29:6530:x1875336022303616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788460025.509030:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf363d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+29:6530:x1875336022303616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 218us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460025.509039:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:0.0:1788460025.510046:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3afbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022303616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788460025.510127:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3afbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022303744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788460025.510200:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460025.510252:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc65d7f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788460025.510997:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022303744 00000100:00100000:3.0:1788460025.511011:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022303744 00000100:00100000:3.0:1788460025.511073:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:3.0:1788460025.511082:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf363cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+29:6530:x1875336022303744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788460025.511351:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf363cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+29:6530:x1875336022303744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 269us (1150us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460025.511360:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:3.0:1788460025.511427:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3afbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022303744:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788460025.517446:0:13251:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788460025.518339:0:6530:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788460025.518356:0:6530:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788460025.518383:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0c00/0x5dfa74784542afb7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542afbe expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460025.518398:0:6530:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0c00/0x5dfa74784542afb7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542afbe expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460025.618306:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788460026.449770:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac39d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022303872:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788460026.449841:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460026.449913:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022303872 00000100:00100000:1.0:1788460026.449920:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022303872 00000100:00100000:1.0:1788460026.449998:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788460026.450006:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3bdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022303872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788460026.450039:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788460026.450081:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3bdad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022303872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460026.450088:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:1.0:1788460026.450105:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788460026.450127:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac39d1500 x1875336022303872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460042 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460026.450143:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac39d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022303872:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788460026.641255:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788460026.961542:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022304000:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788460026.961608:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460026.961681:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022304000 00000100:00100000:2.0:1788460026.961688:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022304000 00000100:00100000:2.0:1788460026.961743:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788460026.961752:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3af7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022304000:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788460026.961773:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788460026.961813:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3af7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022304000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 62us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460026.961820:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:2.0:1788460026.961839:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788460026.961883:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3af7100 x1875336022304000/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460042 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460026.961899:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022304000:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788460026.963983:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022304128:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788460026.964045:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460026.964146:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022304128 00000100:00100000:2.0:1788460026.964154:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022304128 00000100:00100000:2.0:1788460026.964208:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788460026.964217:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3afb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022304128:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788460026.964245:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788460026.964501:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3afb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022304128:12345-0@lo:41:osp-pre-0-1.0 Request processed in 285us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460026.964522:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788460026.964599:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022304128:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788460027.666665:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788460027.989413:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022304256:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788460027.989477:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460027.989543:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022304256 00000100:00100000:2.0:1788460027.989549:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022304256 00000100:00100000:2.0:1788460027.989591:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788460027.989600:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3af5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1875336022304256:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788460027.989634:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446453248 avail 1300213760 00000100:00100000:2.0:1788460027.989680:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3af5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1875336022304256:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460027.989688:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788460027.989736:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022304256:0@lo:41:osp-pre-1-0.0 00000001:02000400:1.0:1788460028.023441:0:13398:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1788460028.497656:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788460028.497679:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3bd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022304384:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788460028.497751:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460028.497983:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022304384 00000100:00100000:1.0:1788460028.497991:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022304384 00000100:00100000:1.0:1788460028.498054:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788460028.498063:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac399bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022304384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788460028.498090:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788460028.498131:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac399bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022304384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460028.498138:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:0.0:1788460028.498203:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788460028.498291:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3bd8a80 x1875336022304384/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460044 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460028.498310:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3bd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022304384:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788460028.498787:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3afa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875336022304640:0@lo:400:kworker.0 00000100:00100000:1.0:1788460028.498998:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1875336022304896:0@lo:400:kworker.0 00000100:00100000:1.0:1788460028.499036:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460028.499063:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3671c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022305408:0@lo:400:kworker.0 00000100:00100000:1.0:1788460028.499086:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460028.499110:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788460028.499116:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0cf73fe6-82e2-434e-b670-631647721b2c:3659:1875336022304512:0@lo:400:kworker.0 00000100:00100000:1.0:1788460028.499142:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460028.499179:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1875336022305024:0@lo:400:kworker.0 00000100:00100000:1.0:1788460028.499200:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460028.499215:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3671180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1875336022305536:0@lo:400:kworker.0 00000100:00100000:1.0:1788460028.499232:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460028.499256:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022304896 00000100:00100000:1.0:1788460028.499260:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022304896 00000100:00100000:1.0:1788460028.499291:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022305024 00000100:00100000:1.0:1788460028.499294:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022305024 00000100:00100000:1.0:1788460028.499313:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022305536 00000100:00100000:1.0:1788460028.499316:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022305536 00000100:00100000:1.0:1788460028.499330:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788460028.499337:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3bd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1875336022304896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460028.499380:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3bd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1875336022304896:12345-0@lo:400:kworker.0 Request processed in 43us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460028.499387:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788460028.499400:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1788460028.499406:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3bd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1875336022305024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460028.499432:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3bd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1875336022305024:12345-0@lo:400:kworker.0 Request processed in 27us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460028.499438:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1788460028.499449:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1788460028.499454:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3bdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1875336022305536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460028.499479:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3bdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1875336022305536:12345-0@lo:400:kworker.0 Request processed in 25us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460028.499485:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1788460028.499515:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1875336022305024:0@lo:400:kworker.0 00000100:00100000:1.0:1788460028.499535:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3671180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1875336022305536:0@lo:400:kworker.0 00000100:00100000:1.0:1788460028.499543:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1875336022304896:0@lo:400:kworker.0 00000100:00100000:1.0:1788460028.499584:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022305408 00000100:00100000:1.0:1788460028.499588:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022305408 00000100:00100000:1.0:1788460028.499614:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788460028.499620:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3bdb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022305408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460028.499656:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3bdb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022305408:12345-0@lo:400:kworker.0 Request processed in 37us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460028.499662:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788460028.499684:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3afbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022304768:0@lo:400:kworker.0 00000100:00100000:1.0:1788460028.499709:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460028.499728:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3afb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022305280:0@lo:400:kworker.0 00000100:00100000:1.0:1788460028.499746:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460028.499761:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3672d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022305792:0@lo:400:kworker.0 00000100:00100000:1.0:1788460028.499778:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788460028.500084:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3671c00 x1875336022305408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788460044 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460028.500097:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3671c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022305408:0@lo:400:kworker.0 00000100:00100000:1.0:1788460028.500127:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022304512 00000100:00100000:1.0:1788460028.500131:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022304512 00000100:00100000:1.0:1788460028.500159:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:1.0:1788460028.500166:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf363dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+29:3659:x1875336022304512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460028.500204:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf363dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+29:3659:x1875336022304512:12345-0@lo:400:kworker.0 Request processed in 39us (1061us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460028.500220:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00080000:1.0:1788460028.500247:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788460028.500252:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788460028.500267:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0cf73fe6-82e2-434e-b670-631647721b2c:3659:1875336022304512:0@lo:400:kworker.0 00000100:00100000:1.0:1788460028.500292:0:8832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022305280 00000100:00100000:1.0:1788460028.500296:0:8832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022305280 00000100:00100000:1.0:1788460028.500320:0:8832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022305792 00000100:00100000:1.0:1788460028.500323:0:8832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022305792 00000100:00100000:1.0:1788460028.500338:0:8832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788460028.500343:0:8832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3bd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022305280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460028.500378:0:8832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3bd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022305280:12345-0@lo:400:kworker.0 Request processed in 34us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460028.500384:0:8832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788460028.500394:0:8832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788460028.500400:0:8832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3bd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022305792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460028.500427:0:8832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3bd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022305792:12345-0@lo:400:kworker.0 Request processed in 28us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460028.500433:0:8832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:1.0:1788460028.500445:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788460028.500448:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788460028.500464:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3afb800 x1875336022305280/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788460044 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460028.500474:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3afb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022305280:0@lo:400:kworker.0 00010000:00080000:1.0:1788460028.500484:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3672d80 x1875336022305792/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788460044 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460028.500493:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3672d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022305792:0@lo:400:kworker.0 00000100:00100000:2.0:1788460028.500612:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022304768 00000100:00100000:2.0:1788460028.500616:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022304768 00000100:00100000:2.0:1788460028.500641:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788460028.500647:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3bda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022304768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460028.500688:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3bda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022304768:12345-0@lo:400:kworker.0 Request processed in 41us (978us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460028.500694:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788460028.500733:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3afbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022304768:0@lo:400:kworker.0 00000100:00100000:0.0:1788460028.500832:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460028.500862:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1875336022305152:0@lo:400:kworker.0 00000100:00100000:2.0:1788460028.501045:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022304640 00000100:00100000:2.0:1788460028.501049:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022304640 00000100:00100000:2.0:1788460028.501074:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1788460028.501080:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3670000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1875336022304640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460028.501112:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3670000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1875336022304640:12345-0@lo:400:kworker.0 Request processed in 31us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460028.501125:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788460028.501193:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460028.501215:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3670a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1875336022305664:0@lo:400:kworker.0 00000100:00100000:0.0:1788460028.501238:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460028.501263:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3afa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875336022304640:0@lo:400:kworker.0 00000100:00100000:0.0:1788460028.501283:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022305152 00000100:00100000:0.0:1788460028.501286:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022305152 00000100:00100000:0.0:1788460028.501311:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022305664 00000100:00100000:0.0:1788460028.501314:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022305664 00000100:00100000:0.0:1788460028.501339:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1788460028.501345:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3673800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1875336022305152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460028.501379:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3673800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1875336022305152:12345-0@lo:400:kworker.0 Request processed in 34us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460028.501384:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1788460028.501395:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1788460028.501401:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3671f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1875336022305664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460028.501424:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3671f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1875336022305664:12345-0@lo:400:kworker.0 Request processed in 24us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460028.501430:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00080000:0.0:1788460028.501443:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788460028.501459:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3af8000 x1875336022305152/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460044 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460028.501469:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1875336022305152:0@lo:400:kworker.0 00010000:00080000:0.0:1788460028.501479:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3670a80 x1875336022305664/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460044 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460028.501487:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3670a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1875336022305664:0@lo:400:kworker.0 00000100:00100000:2.0:1788460028.501685:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788460028.501694:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac399b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022305920:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788460028.501722:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460028.502276:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022305920 00000100:00100000:3.0:1788460028.502294:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022305920 00000100:00100000:3.0:1788460028.502335:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788460028.502344:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3af4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022305920:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788460028.502362:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788460028.502412:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3af4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022305920:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460028.502418:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:2.0:1788460028.502499:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac399b480 x1875336022305920/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460044 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460028.502514:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac399b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022305920:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788460028.689163:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460028.862779:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460028.862824:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460028.862857:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460028.862891:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460028.862897:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003341824 00000100:00100000:0.0:1788460028.862914:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003341824 00000100:00100000:3.0:1788460028.862924:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460028.863041:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003342080 00000100:00100000:3.0:1788460028.863050:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003342080 00000100:00100000:0.0:1788460028.863069:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 373 00000100:00100000:0.0:1788460028.863082:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf363f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bed032f6-c389-485e-b2f7-e2ea34763c65+14:2396:x1875336003341824:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:3.0:1788460028.863113:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003342336 00000100:00100000:3.0:1788460028.863118:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003342336 00000100:00100000:3.0:1788460028.863142:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003341952 00000100:00100000:3.0:1788460028.863146:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003341952 00000100:00100000:0.0:1788460028.863165:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf363f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bed032f6-c389-485e-b2f7-e2ea34763c65+14:2396:x1875336003341824:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 85us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460028.863177:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 373 00000100:00100000:3.0:1788460028.863181:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003342208 00000100:00100000:3.0:1788460028.863186:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003342208 00000100:00100000:3.0:1788460028.863212:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 191 00000100:00100000:3.0:1788460028.863224:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3999880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2396:x1875336003342080:12345-192.168.206.5@tcp:400:kworker.0 00000100:00080000:0.0:1788460028.863257:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788460028.863264:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788460028.863293:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3999880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2396:x1875336003342080:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 69us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460028.863301:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 191 00000100:00100000:3.0:1788460028.863323:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 192 00000100:00100000:3.0:1788460028.863333:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac399b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a5915a6d-4114-41fb-8d95-33add86e0720+5:2396:x1875336003342336:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:3.0:1788460028.863361:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac399b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a5915a6d-4114-41fb-8d95-33add86e0720+5:2396:x1875336003342336:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 31us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460028.863367:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 192 00000100:00100000:3.0:1788460028.863380:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 193 00000100:00100000:3.0:1788460028.863388:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac399b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:2396:x1875336003341952:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:2.0:1788460028.863403:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 194 00000100:00100000:3.0:1788460028.863416:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac399b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:2396:x1875336003341952:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 27us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460028.863423:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3b59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a5915a6d-4114-41fb-8d95-33add86e0720+5:2396:x1875336003342208:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:3.0:1788460028.863449:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 193 00000100:00100000:2.0:1788460028.863474:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3b59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a5915a6d-4114-41fb-8d95-33add86e0720+5:2396:x1875336003342208:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 59us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460028.863483:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 194 00010000:00010000:1.0:1788460029.716088:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460030.737156:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788460031.573208:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788460031.573229:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022306048:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788460031.573292:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460031.573352:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022306048 00000100:00100000:2.0:1788460031.573360:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022306048 00000100:00100000:2.0:1788460031.573414:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788460031.573424:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3af4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022306048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788460031.573451:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788460031.573493:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3af4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022306048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460031.573501:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:2.0:1788460031.573520:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788460031.573548:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3af4000 x1875336022306048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460047 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460031.573574:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022306048:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788460031.764175:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788460032.081176:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788460032.081198:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022306176:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788460032.081264:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460032.081440:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022306176 00000100:00100000:2.0:1788460032.081448:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022306176 00000100:00100000:2.0:1788460032.081519:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788460032.081530:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3bd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022306176:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788460032.081552:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788460032.081595:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3bd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022306176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460032.081603:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:3.0:1788460032.081728:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788460032.082328:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3af4000 x1875336022306176/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460048 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460032.082347:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022306176:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788460032.082596:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788460032.082608:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022306304:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788460032.082653:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460032.083069:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022306304 00000100:00100000:2.0:1788460032.083077:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022306304 00000100:00100000:2.0:1788460032.083121:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788460032.083130:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3670a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022306304:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788460032.083159:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788460032.083210:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3670a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022306304:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460032.083217:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788460032.083395:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022306304:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788460032.785143:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788460033.116614:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788460033.116636:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3bda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022306432:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788460033.116703:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460033.116765:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022306432 00000100:00100000:1.0:1788460033.116774:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022306432 00000100:00100000:1.0:1788460033.116814:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788460033.116821:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3bd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022306432:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788460033.116850:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446453248 avail 1300213760 00000100:00100000:1.0:1788460033.116890:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3bd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022306432:12345-0@lo:41:osp-pre-1-0.0 Request processed in 69us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460033.116897:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788460033.116979:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3bda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022306432:0@lo:41:osp-pre-1-0.0 00000001:02000400:1.0:1788460033.155391:0:13547:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 14:27:10 (1788460030) === 00000100:00100000:1.0:1788460033.437305:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460033.437459:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003342464 00000100:00100000:3.0:1788460033.437469:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003342464 00000100:00100000:3.0:1788460033.437543:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 22 00000100:00100000:3.0:1788460033.437554:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3bda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:2396:x1875336003342464:12345-192.168.206.5@tcp:41:mkdir.0 00000004:00000024:3.0:1788460033.437593:0:6533:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788460033.437755:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3bda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:2396:x1875336003342464:12345-192.168.206.5@tcp:41:mkdir.0 Request processed in 202us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460033.437763:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 22 00000100:00100000:3.0:1788460033.437864:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460033.438368:0:6543:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003342592 00000100:00100000:0.0:1788460033.438375:0:6543:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003342592 00000100:00100000:0.0:1788460033.438405:0:6543:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 2 00000100:00100000:0.0:1788460033.438413:0:6543:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3b5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:10475:x1875336003342592:12345-192.168.206.5@tcp:700:mkdir.0 00000100:00100000:0.0:1788460033.438454:0:6543:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3b5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:10475:x1875336003342592:12345-192.168.206.5@tcp:700:mkdir.0 Request processed in 43us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460033.438461:0:6543:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 2 00000100:00080000:2.0:1788460033.438698:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788460033.449999:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460033.450089:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003342848 00000100:00100000:3.0:1788460033.450099:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003342848 00000100:00100000:3.0:1788460033.450156:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 23 00000100:00100000:3.0:1788460033.450167:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3af8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:10475:x1875336003342848:12345-192.168.206.5@tcp:36:mkdir.0 00010000:00010000:3.0:1788460033.450222:0:6535:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788460033.450275:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840600/0x5dfa74784542ae36 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a4fc expref: 6 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460033.450296:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4bef1ff600) 00010000:00010000:3.0:1788460033.450307:0:6535:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788460033.450388:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841600/0x5dfa74784542afc5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460033.450402:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841600/0x5dfa74784542afc5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460033.450428:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841600/0x5dfa74784542afc5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460033.450479:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841400/0x5dfa74784542afcc lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460033.450488:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841400/0x5dfa74784542afcc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460033.450495:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841400/0x5dfa74784542afcc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460033.451009:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841800/0x5dfa74784542afd3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460033.451021:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841800/0x5dfa74784542afd3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460033.451028:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841800/0x5dfa74784542afd3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788460033.451042:0:6535:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000bcb57eb reply state 00000000bdff4ad5 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841800/0x5dfa74784542afd3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460033.451052:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841800/0x5dfa74784542afd3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460033.451059:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8c4bef200f00) 00010000:00010000:3.0:1788460033.451063:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788460033.451065:0:6535:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788460033.451070:0:6535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788460033.451077:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841600/0x5dfa74784542afc5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460033.451089:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841600/0x5dfa74784542afc5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460033.451096:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841600/0x5dfa74784542afc5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460033.451102:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac2841600 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:3.0:1788460033.451106:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841600/0x5dfa74784542afc5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460033.451113:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841600/0x5dfa74784542afc5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460033.451122:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4bef200700) 00010000:00010000:3.0:1788460033.451125:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460033.451128:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841600/0x5dfa74784542afc5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460033.451134:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841600/0x5dfa74784542afc5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788460033.451149:0:6535:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000bcb57eb reply state 00000000bdff4ad5 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841400/0x5dfa74784542afcc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460033.451158:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841400/0x5dfa74784542afcc lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460033.451163:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8c4bef200900) 00010000:00010000:3.0:1788460033.451165:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788460033.451167:0:6535:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1788460033.451243:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3af8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+7:10475:x1875336003342848:12345-192.168.206.5@tcp:36:mkdir.0 Request processed in 1076us (1252us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788460033.451256:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 23 00000100:00100000:3.0:1788460033.470223:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460033.470432:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003342976 00000100:00100000:0.0:1788460033.470443:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003342976 00000100:00100000:0.0:1788460033.470503:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 24 00000100:00100000:0.0:1788460033.470513:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3b58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+7:10476:x1875336003342976:12345-192.168.206.5@tcp:101:chmod.0 00010000:00010000:0.0:1788460033.470535:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460033.470557:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0000/0x5dfa74784542afda lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a596 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460033.470617:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d1200/0x5dfa74784542afe1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460033.470631:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d1200/0x5dfa74784542afe1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460033.470659:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d1200/0x5dfa74784542afe1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788460033.470703:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788460033.470707:0:6533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788460033.470741:0:6533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d1200/0x5dfa74784542afe1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460033.470765:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0000/0x5dfa74784542afda lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a596 expref: 9 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460033.470783:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d1200/0x5dfa74784542afe1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a596 expref: 8 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460033.470791:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4bc5dc1e00) 00010000:00010000:0.0:1788460033.470794:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788460033.470797:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc29d1200, rc 0) 00000100:00100000:0.0:1788460033.470923:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3b58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+8:10476:x1875336003342976:12345-192.168.206.5@tcp:101:chmod.0 Request processed in 411us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460033.471214:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 24 00000100:00100000:0.0:1788460033.480580:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460033.483236:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003343232 00000100:00100000:3.0:1788460033.483251:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003343232 00000100:00100000:3.0:1788460033.483305:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 25 00000100:00100000:3.0:1788460033.483314:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3672d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+8:10476:x1875336003343232:12345-192.168.206.5@tcp:36:chmod.0 00010000:00010000:3.0:1788460033.483360:0:6535:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788460033.483382:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d1200/0x5dfa74784542afe1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a596 expref: 8 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460033.483402:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4bc5dc1e00) 00010000:00010000:3.0:1788460033.483411:0:6535:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788460033.483433:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841600/0x5dfa74784542afe8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460033.483445:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841600/0x5dfa74784542afe8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460033.483454:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841600/0x5dfa74784542afe8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788460033.484555:0:6535:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000241605d reply state 000000005e555278 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841600/0x5dfa74784542afe8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460033.484575:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841600/0x5dfa74784542afe8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460033.484583:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4bef200700) 00010000:00010000:3.0:1788460033.484586:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788460033.484596:0:6535:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788460033.484604:0:6535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788460033.487160:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3672d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+9:10476:x1875336003343232:12345-192.168.206.5@tcp:36:chmod.0 Request processed in 3835us (6578us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788460033.487172:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 25 00000100:00100000:1.0:1788460033.508473:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460033.508681:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003343360 00000100:00100000:2.0:1788460033.508691:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003343360 00000100:00100000:2.0:1788460033.508752:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 26 00000100:00100000:2.0:1788460033.508762:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3afa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+9:10477:x1875336003343360:12345-192.168.206.5@tcp:101:chown.0 00010000:00010000:2.0:1788460033.508786:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460033.508809:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542afef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a59d expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.508891:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542aff6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.508906:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542aff6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.508917:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542aff6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788460033.509040:0:6534:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788460033.509044:0:6534:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788460033.509080:0:6534:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542aff6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.509105:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542afef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a59d expref: 11 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.509120:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542aff6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a59d expref: 10 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.509128:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4bef200700) 00010000:00010000:2.0:1788460033.509131:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788460033.509134:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bfadc7400, rc 0) 00000100:00100000:2.0:1788460033.509190:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3afa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+10:10477:x1875336003343360:12345-192.168.206.5@tcp:101:chown.0 Request processed in 430us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460033.509197:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 26 00000100:00100000:1.0:1788460033.516721:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460033.518764:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003343488 00000100:00100000:0.0:1788460033.518793:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003343488 00000100:00100000:0.0:1788460033.518921:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 27 00000100:00100000:0.0:1788460033.518941:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3afbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+10:10477:x1875336003343488:12345-192.168.206.5@tcp:101:chown.0 00010000:00010000:0.0:1788460033.519186:0:7760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460033.519206:0:7760:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0000/0x5dfa74784542affd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a5a4 expref: -99 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460033.519284:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0a00/0x5dfa74784542b004 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460033.519298:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0a00/0x5dfa74784542b004 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460033.519310:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0a00/0x5dfa74784542b004 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460033.519320:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0200/0x5dfa74784542b00b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460033.519328:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0200/0x5dfa74784542b00b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460033.519334:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0200/0x5dfa74784542b00b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460033.519407:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0800/0x5dfa74784542b012 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460033.519415:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0800/0x5dfa74784542b012 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460033.519422:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0800/0x5dfa74784542b012 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788460033.519461:0:7760:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788460033.519465:0:7760:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788460033.519497:0:7760:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0800/0x5dfa74784542b012 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460033.519521:0:7760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0a00/0x5dfa74784542b004 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460033.519527:0:7760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0a00/0x5dfa74784542b004 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460033.519533:0:7760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0a00/0x5dfa74784542b004 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460033.519538:0:7760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc29d0a00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460033.519542:0:7760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0a00/0x5dfa74784542b004 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460033.519549:0:7760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0a00/0x5dfa74784542b004 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460033.519560:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4bef200700) 00010000:00010000:0.0:1788460033.519564:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460033.519568:0:7760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0a00/0x5dfa74784542b004 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460033.519574:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0a00/0x5dfa74784542b004 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460033.519585:0:7760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0200/0x5dfa74784542b00b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460033.519590:0:7760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0200/0x5dfa74784542b00b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460033.519595:0:7760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0200/0x5dfa74784542b00b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460033.519605:0:7760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc29d0200 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460033.519608:0:7760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0200/0x5dfa74784542b00b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460033.519612:0:7760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0200/0x5dfa74784542b00b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460033.519620:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8c4bef200900) 00010000:00010000:0.0:1788460033.519622:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460033.519624:0:7760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0200/0x5dfa74784542b00b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460033.519629:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0200/0x5dfa74784542b00b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460033.519653:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0000/0x5dfa74784542affd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a5a4 expref: 12 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460033.519664:0:7760:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0800/0x5dfa74784542b012 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a5a4 expref: 11 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460033.519671:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8c4bef200f00) 00010000:00010000:0.0:1788460033.519673:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788460033.519675:0:7760:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc29d0800, rc 0) 00000100:00100000:0.0:1788460033.519743:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3afbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+11:10477:x1875336003343488:12345-192.168.206.5@tcp:101:chown.0 Request processed in 812us (3029us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460033.519751:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 27 00000100:00100000:1.0:1788460033.525195:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460033.525277:0:6544:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003343616 00000100:00100000:2.0:1788460033.525288:0:6544:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003343616 00000100:00100000:2.0:1788460033.525354:0:6544:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 6 00000100:00100000:2.0:1788460033.525364:0:6544:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3afb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+11:10477:x1875336003343616:12345-192.168.206.5@tcp:900:chown.0 00000100:00100000:2.0:1788460033.525491:0:6544:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3afb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+11:10477:x1875336003343616:12345-192.168.206.5@tcp:900:chown.0 Request processed in 127us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460033.525499:0:6544:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 6 00000100:00100000:1.0:1788460033.531155:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460033.531247:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003343872 00000100:00100000:0.0:1788460033.531276:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003343872 00000100:00100000:0.0:1788460033.531339:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 28 00000100:00100000:0.0:1788460033.531348:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3af9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+11:10477:x1875336003343872:12345-192.168.206.5@tcp:36:chown.0 00010000:00010000:0.0:1788460033.531400:0:6534:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788460033.531426:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0800/0x5dfa74784542b012 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a5a4 expref: 11 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460033.531442:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8c4bef200f00) 00010000:00010000:0.0:1788460033.531448:0:6534:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788460033.531467:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0000/0x5dfa74784542b019 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460033.531480:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0000/0x5dfa74784542b019 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460033.531490:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0000/0x5dfa74784542b019 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788460033.538626:0:6513:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00000004:00010000:2.0:1788460033.538804:0:6534:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000087b04b6c reply state 000000008b19be47 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0000/0x5dfa74784542b019 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.538827:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0000/0x5dfa74784542b019 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.538837:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8c4bef200f00) 00010000:00010000:0.0:1788460033.538839:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841400/0x5dfa74784542afcc lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.538840:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788460033.538846:0:6534:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788460033.538858:0:6534:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788460033.538866:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841400/0x5dfa74784542afcc lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460033.538876:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841400/0x5dfa74784542afcc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460033.538882:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac2841400 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460033.538887:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841400/0x5dfa74784542afcc lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460033.538912:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841400/0x5dfa74784542afcc lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460033.538926:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8c4bef200900) 00010000:00010000:0.0:1788460033.538929:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460033.538978:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841400/0x5dfa74784542afcc lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460033.538986:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841400/0x5dfa74784542afcc lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460033.539005:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841800/0x5dfa74784542afd3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460033.539011:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841800/0x5dfa74784542afd3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460033.539016:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841800/0x5dfa74784542afd3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460033.539021:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac2841800 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460033.539023:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841800/0x5dfa74784542afd3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460033.539029:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841800/0x5dfa74784542afd3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460033.539036:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8c4bef200f00) 00010000:00010000:0.0:1788460033.539039:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460033.539041:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841800/0x5dfa74784542afd3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460033.539061:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841800/0x5dfa74784542afd3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460033.539076:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841600/0x5dfa74784542afe8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460033.539083:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841600/0x5dfa74784542afe8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460033.539088:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841600/0x5dfa74784542afe8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460033.539093:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac2841600 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460033.539097:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841600/0x5dfa74784542afe8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460033.539103:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841600/0x5dfa74784542afe8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460033.539112:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4bef200700) 00010000:00010000:0.0:1788460033.539115:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788460033.539118:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841600/0x5dfa74784542afe8 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460033.539124:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841600/0x5dfa74784542afe8 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00080000:0.0:1788460033.539226:0:6534:0:(ldlm_lib.c:3499:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1788460033.539282:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3af9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+7:10477:x1875336003343872:12345-192.168.206.5@tcp:36:chown.0 Request processed in 7930us (8130us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788460033.539292:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 28 00010000:00010000:0.0:1788460033.542374:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0000/0x5dfa74784542b019 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460033.542393:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0000/0x5dfa74784542b019 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460033.542401:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0000/0x5dfa74784542b019 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460033.542407:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc29d0000 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460033.542412:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0000/0x5dfa74784542b019 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460033.542419:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0000/0x5dfa74784542b019 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460033.542435:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8c4bef200f00) 00010000:00010000:0.0:1788460033.542438:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788460033.542442:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0000/0x5dfa74784542b019 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460033.542448:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0000/0x5dfa74784542b019 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460033.565441:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460033.565604:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003344000 00000100:00100000:3.0:1788460033.565613:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003344000 00000100:00100000:3.0:1788460033.565680:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 29 00000100:00100000:3.0:1788460033.565690:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3af8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:10478:x1875336003344000:12345-192.168.206.5@tcp:101:touch.500 00010000:00010000:3.0:1788460033.565713:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460033.565732:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840600/0x5dfa74784542b020 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a5ab expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788460033.566987:0:6535:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1209us 00010000:00010000:2.0:1788460033.591047:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b027 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.591070:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b027 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.591083:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b027 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.592025:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6800/0x5dfa74784542b02e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.592036:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6800/0x5dfa74784542b02e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.592060:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6800/0x5dfa74784542b02e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.592160:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b035 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.592169:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b035 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.592175:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b035 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788460033.592209:0:6535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788460033.592213:0:6535:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788460033.592249:0:6535:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b035 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.592267:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b027 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.592273:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b027 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.592280:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b027 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.592286:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bfadc6400 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:2.0:1788460033.592290:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b027 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.592297:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b027 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.592318:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4bef200700) 00010000:00010000:2.0:1788460033.592321:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460033.592326:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b027 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.592332:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b027 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.592345:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6800/0x5dfa74784542b02e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.592351:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6800/0x5dfa74784542b02e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.592357:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6800/0x5dfa74784542b02e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.592362:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bfadc6800 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:2.0:1788460033.592364:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6800/0x5dfa74784542b02e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.592370:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6800/0x5dfa74784542b02e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.592377:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8c4bef1fc100) 00010000:00010000:2.0:1788460033.592380:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460033.592383:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6800/0x5dfa74784542b02e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.592388:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6800/0x5dfa74784542b02e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.592441:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840600/0x5dfa74784542b020 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a5ab expref: 8 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.592457:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b035 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a5ab expref: 7 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.592464:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8c4bef1fcd00) 00010000:00010000:2.0:1788460033.592466:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788460033.592469:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bfadc7200, rc 0) 00000100:00100000:2.0:1788460033.592540:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3af8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+7:10478:x1875336003344000:12345-192.168.206.5@tcp:101:touch.500 Request processed in 26850us (27106us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460033.592549:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 29 00000100:00100000:1.0:1788460033.595506:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460033.595658:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003344256 00000100:00100000:3.0:1788460033.595667:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003344256 00000100:00100000:3.0:1788460033.595821:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 30 00000100:00100000:3.0:1788460033.595831:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3af8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+7:10478:x1875336003344256:12345-192.168.206.5@tcp:101:touch.500 00010000:00010000:3.0:1788460033.595861:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460033.595881:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840a00/0x5dfa74784542b03c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a5b2 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460033.596383:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840000/0x5dfa74784542b043 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460033.596398:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840000/0x5dfa74784542b043 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460033.596409:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840000/0x5dfa74784542b043 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460033.596487:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841e00/0x5dfa74784542b04a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xe41446a2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460033.596497:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841e00/0x5dfa74784542b04a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xe41446a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460033.596504:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841e00/0x5dfa74784542b04a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xe41446a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788460033.598622:0:6533:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:2.0:1788460033.598823:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f600/0x5dfa74784542b051 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.598839:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f600/0x5dfa74784542b051 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.598852:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f600/0x5dfa74784542b051 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.598885:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840000/0x5dfa74784542b043 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.598892:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840000/0x5dfa74784542b043 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.598913:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840000/0x5dfa74784542b043 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.598938:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac2840000 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:2.0:1788460033.598959:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840000/0x5dfa74784542b043 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.598967:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840000/0x5dfa74784542b043 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.598980:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8c4bef1fcd00) 00010000:00010000:2.0:1788460033.598982:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460033.598987:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840000/0x5dfa74784542b043 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.598993:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840000/0x5dfa74784542b043 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788460033.599010:0:6533:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000003c16cfa reply state 0000000017e8bcf1 transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841e00/0x5dfa74784542b04a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xe41446a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.599021:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841e00/0x5dfa74784542b04a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xe41446a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.599026:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xe41446a2 (ffff8c4bef200400) 00010000:00010000:2.0:1788460033.599028:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788460033.599031:0:6533:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788460033.599067:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840a00/0x5dfa74784542b03c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a5b2 expref: 10 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.599082:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f600/0x5dfa74784542b051 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a5b2 expref: 9 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.599101:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8c4bef1fc300) 00010000:00010000:2.0:1788460033.599104:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788460033.599107:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ac395f600, rc 0) 00000100:00100000:2.0:1788460033.599179:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3af8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+10:10478:x1875336003344256:12345-192.168.206.5@tcp:101:touch.500 Request processed in 3349us (3680us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788460033.599188:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 30 00000100:00100000:1.0:1788460033.606754:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460033.607084:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003344512 00000100:00100000:0.0:1788460033.607094:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003344512 00000100:00100000:0.0:1788460033.607286:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 31 00000100:00100000:0.0:1788460033.607298:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac39d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+10:10478:x1875336003344512:12345-192.168.206.5@tcp:36:touch.500 00010000:00010000:0.0:1788460033.607348:0:7760:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788460033.607372:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f600/0x5dfa74784542b051 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a5b2 expref: 10 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460033.607405:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8c4bef1fc300) 00010000:00010000:0.0:1788460033.607415:0:7760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788460033.607469:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0000/0x5dfa74784542b05f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460033.607481:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0000/0x5dfa74784542b05f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460033.607491:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0000/0x5dfa74784542b05f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788460033.607594:0:7760:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000597cbbc9 reply state 000000009956b114 transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0000/0x5dfa74784542b05f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460033.607606:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0000/0x5dfa74784542b05f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460033.607611:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8c4bc5dc1b00) 00010000:00010000:0.0:1788460033.607614:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788460033.607616:0:7760:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788460033.607702:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac39d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+11:10478:x1875336003344512:12345-192.168.206.5@tcp:36:touch.500 Request processed in 406us (956us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1788460033.607709:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 31 00000100:00100000:1.0:1788460033.611504:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460033.611658:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003344640 00000100:00100000:0.0:1788460033.611668:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003344640 00000100:00100000:0.0:1788460033.611728:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 32 00000100:00100000:0.0:1788460033.611738:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3a31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+11:10478:x1875336003344640:12345-192.168.206.5@tcp:101:touch.500 00010000:00010000:0.0:1788460033.611760:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460033.611791:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0800/0x5dfa74784542b066 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a5b9 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460033.611843:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0800/0x5dfa74784542b066 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a5b9 expref: 12 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460033.612373:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0800/0x5dfa74784542b066 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a5b9 expref: 12 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460033.612445:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8c4bc5dc1b00) 00010000:00010000:1.0:1788460033.612449:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788460033.612453:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc29d0800, rc 0) 00000100:00100000:1.0:1788460033.612553:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3a31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+12:10478:x1875336003344640:12345-192.168.206.5@tcp:101:touch.500 Request processed in 816us (1057us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460033.612562:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 32 00000100:00100000:1.0:1788460033.615805:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460033.616078:0:8832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003344768 00000100:00100000:0.0:1788460033.616088:0:8832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003344768 00000100:00100000:1.0:1788460033.616206:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 24 00000100:00100000:1.0:1788460033.616214:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3a31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2392:x1875336003344768:12345-192.168.206.5@tcp:8:touch.500 00010000:00080000:1.0:1788460033.616246:0:8450:0:(ldlm_lib.c:1461:target_handle_connect()) lustre-OST0000: connection from f8767d3e-bfef-4d3d-8163-ef8ae18a3514@192.168.206.5@tcp t0 exp 0000000000000000 cur 330 last 0 00000020:00000080:1.0:1788460033.616276:0:8450:0:(genops.c:1385:class_connect()) connect: client f8767d3e-bfef-4d3d-8163-ef8ae18a3514, cookie 0x5dfa74784542b06d 00002000:00100000:1.0:1788460033.616287:0:8450:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f8767d3e-bfef-4d3d-8163-ef8ae18a3514/ffff8c4ac3843000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a07 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788460033.616303:0:8450:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788460033.616371:0:8450:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788460033.616397:0:8450:0:(import.c:65:import_set_state_nolock()) ffff8c4ac3840000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788460033.616469:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3a31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:2392:x1875336003344768:12345-192.168.206.5@tcp:8:touch.500 Request processed in 254us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460033.616477:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 24 00000100:00100000:1.0:1788460033.617770:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3a30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022306816:0@lo:400:kworker.0 00000100:00100000:0.0:1788460033.617801:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3a31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1875336022306944:0@lo:400:kworker.0 00000100:00100000:1.0:1788460033.617822:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460033.617828:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460033.617876:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3a33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022307456:0@lo:400:kworker.0 00000100:00100000:0.0:1788460033.617900:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460033.617921:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3a30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022307968:0@lo:400:kworker.0 00000100:00100000:0.0:1788460033.617999:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460033.618025:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788460033.618032:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3a33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0cf73fe6-82e2-434e-b670-631647721b2c:3659:1875336022306560:0@lo:400:kworker.0 00000100:00100000:0.0:1788460033.618058:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460033.618077:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3a33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1875336022307072:0@lo:400:kworker.0 00000100:00100000:0.0:1788460033.618097:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460033.618113:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3a32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1875336022307584:0@lo:400:kworker.0 00000100:00100000:1.0:1788460033.618248:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3a31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022307328:0@lo:400:kworker.0 00000100:00100000:1.0:1788460033.618273:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460033.618292:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3a30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022307840:0@lo:400:kworker.0 00000100:00100000:0.0:1788460033.618297:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460033.618311:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460033.618373:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3a31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875336022306688:0@lo:400:kworker.0 00000100:00100000:0.0:1788460033.618400:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460033.618426:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3a30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1875336022307200:0@lo:400:kworker.0 00000100:00100000:1.0:1788460033.618441:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022306816 00000100:00100000:1.0:1788460033.618447:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022306816 00000100:00100000:0.0:1788460033.618448:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460033.618457:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3a33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1875336022307712:0@lo:400:kworker.0 00000100:00100000:0.0:1788460033.618473:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460033.618482:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788460033.618489:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc471ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022306816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460033.618535:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc471ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022306816:12345-0@lo:400:kworker.0 Request processed in 46us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460033.618542:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788460033.618593:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3a30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022306816:0@lo:400:kworker.0 00000100:00100000:3.0:1788460033.618704:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022306560 00000100:00100000:3.0:1788460033.618711:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022306560 00000100:00100000:3.0:1788460033.618740:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:3.0:1788460033.618746:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf363d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+29:3659:x1875336022306560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460033.618775:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf363d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+29:3659:x1875336022306560:12345-0@lo:400:kworker.0 Request processed in 30us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460033.618780:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:3.0:1788460033.618893:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3b59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022308096:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788460033.618917:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460033.618986:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022308096 00000100:00100000:3.0:1788460033.618989:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022308096 00000100:00100000:3.0:1788460033.619023:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788460033.619029:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3b5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022308096:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788460033.619050:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788460033.619083:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3b5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022308096:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460033.619089:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:3.0:1788460033.619104:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788460033.619913:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3b59180 x1875336022308096/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460049 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460033.619963:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3b59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022308096:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788460033.620052:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3b58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022308224:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788460033.620091:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460033.620122:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022308224 00000100:00100000:3.0:1788460033.620185:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022308224 00000100:00100000:3.0:1788460033.620220:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788460033.620227:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3b59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1875336022308224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788460033.620242:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788460033.620467:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3b59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1875336022308224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 239us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460033.620471:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022307456 00000100:00100000:3.0:1788460033.620474:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788460033.620475:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022307456 00000100:00080000:3.0:1788460033.620493:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788460033.620496:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788460033.620499:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022307968 00000100:00100000:2.0:1788460033.620501:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022307968 00000100:00100000:2.0:1788460033.620510:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022307328 00010000:00080000:3.0:1788460033.620513:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3b58380 x1875336022308224/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460049 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460033.620513:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022307328 00000100:00100000:2.0:1788460033.620522:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022307840 00000100:00100000:2.0:1788460033.620523:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022307840 00000100:00100000:3.0:1788460033.620527:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3b58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022308224:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788460033.620534:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788460033.620540:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3671180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022307456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460033.620558:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3a33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0cf73fe6-82e2-434e-b670-631647721b2c:3659:1875336022306560:0@lo:400:kworker.0 00000100:00100000:2.0:1788460033.620575:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3671180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022307456:12345-0@lo:400:kworker.0 Request processed in 35us (2674us total) trans 0 rc 0/0 00010000:00080000:3.0:1788460033.620576:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3a33100 x1875336022307456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788460049 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460033.620581:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788460033.620585:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3a33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022307456:0@lo:400:kworker.0 00000100:00100000:2.0:1788460033.620592:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788460033.620598:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfaea9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022307968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460033.620618:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022306944 00000100:00100000:3.0:1788460033.620621:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022306944 00000100:00100000:3.0:1788460033.620640:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022307072 00000100:00100000:3.0:1788460033.620654:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022307072 00000100:00100000:3.0:1788460033.620676:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022307584 00000100:00100000:3.0:1788460033.620679:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022307584 00000100:00100000:3.0:1788460033.620690:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022306688 00000100:00100000:3.0:1788460033.620693:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022306688 00000100:00100000:3.0:1788460033.620702:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022307200 00000100:00100000:3.0:1788460033.620705:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022307200 00000100:00100000:2.0:1788460033.620710:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfaea9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022307968:12345-0@lo:400:kworker.0 Request processed in 112us (2710us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460033.620716:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022307712 00000100:00100000:2.0:1788460033.620716:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788460033.620718:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022307712 00000100:00100000:2.0:1788460033.620727:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788460033.620728:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1788460033.620733:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3671c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1875336022306944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460033.620733:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc4719180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022307328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460033.620764:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3671c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1875336022306944:12345-0@lo:400:kworker.0 Request processed in 31us (2934us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460033.620766:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc4719180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022307328:12345-0@lo:400:kworker.0 Request processed in 34us (2493us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460033.620770:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1788460033.620772:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788460033.620782:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1788460033.620782:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788460033.620789:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfaea9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1875336022307072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460033.620789:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc471bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022307840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460033.620813:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfaea9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1875336022307072:12345-0@lo:400:kworker.0 Request processed in 25us (2715us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460033.620813:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc471bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022307840:12345-0@lo:400:kworker.0 Request processed in 25us (2500us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460033.620819:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1788460033.620820:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788460033.620830:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1788460033.620836:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfaea8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1875336022307584:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1788460033.620845:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3a31c00 x1875336022307328/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788460049 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460033.620855:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3a31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022307328:0@lo:400:kworker.0 00010000:00080000:2.0:1788460033.620879:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3a30380 x1875336022307840/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788460049 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460033.621001:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1788460033.621010:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfaea9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1875336022306688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460033.621141:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3a30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022307840:0@lo:400:kworker.0 00000100:00100000:2.0:1788460033.621172:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3a33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1875336022307072:0@lo:400:kworker.0 00000100:00100000:2.0:1788460033.621182:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3a31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1875336022306944:0@lo:400:kworker.0 00010000:00080000:2.0:1788460033.621192:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3a30000 x1875336022307968/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788460049 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460033.621199:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3a30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022307968:0@lo:400:kworker.0 00000100:00100000:0.0:1788460033.621202:0:7760:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1788460033.621210:0:7760:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:1.0:1788460033.621276:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfaea9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1875336022306688:12345-0@lo:400:kworker.0 Request processed in 267us (2875us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460033.621283:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1788460033.621296:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1788460033.621302:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfaea8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1875336022307200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460033.621330:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfaea8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1875336022307200:12345-0@lo:400:kworker.0 Request processed in 29us (2881us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460033.621335:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1788460033.621345:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1788460033.621350:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfaeaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1875336022307712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460033.621375:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfaeaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1875336022307712:12345-0@lo:400:kworker.0 Request processed in 26us (2902us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460033.621404:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1788460033.621575:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfaea8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1875336022307584:12345-0@lo:400:kworker.0 Request processed in 739us (3277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460033.621577:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460033.621582:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1788460033.621596:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003344896 00000100:00080000:3.0:1788460033.621597:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788460033.621600:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788460033.621601:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003344896 00000100:00100000:3.0:1788460033.621617:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3a31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875336022306688:0@lo:400:kworker.0 00010000:00080000:3.0:1788460033.621628:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3a30a80 x1875336022307200/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460049 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460033.621643:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3a30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1875336022307200:0@lo:400:kworker.0 00010000:00080000:3.0:1788460033.621657:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3a33800 x1875336022307712/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460049 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460033.621665:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3a33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1875336022307712:0@lo:400:kworker.0 00000100:00080000:3.0:1788460033.621697:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788460033.621711:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 25 00000100:00100000:2.0:1788460033.621726:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3af7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:0:x1875336003344896:12345-192.168.206.5@tcp:2:touch.500 00000100:00100000:1.0:1788460033.621803:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3a32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1875336022307584:0@lo:400:kworker.0 00000001:00080000:0.0:1788460033.624625:0:8443:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00100000:0.0:1788460033.624640:0:8443:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f8767d3e-bfef-4d3d-8163-ef8ae18a3514 00000100:00100000:2.0:1788460033.624828:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3af7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:0:x1875336003344896:12345-192.168.206.5@tcp:2:touch.500 Request processed in 3099us (3246us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788460033.624840:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 25 00000100:00100000:3.0:1788460033.628769:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460033.628875:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003345152 00000100:00100000:2.0:1788460033.628884:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003345152 00000100:00100000:2.0:1788460033.629010:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 2 00000100:00100000:2.0:1788460033.629020:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3b58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+12:10478:x1875336003345152:12345-192.168.206.5@tcp:35:touch.500 00000100:00100000:2.0:1788460033.629269:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3b58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+13:10478:x1875336003345152:12345-192.168.206.5@tcp:35:touch.500 Request processed in 250us (508us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788460033.629277:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 2 00000100:00100000:1.0:1788460033.645980:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460033.646134:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003345280 00000100:00100000:2.0:1788460033.646144:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003345280 00000100:00100000:2.0:1788460033.646201:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 33 00000100:00100000:2.0:1788460033.646211:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc4719c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+13:10479:x1875336003345280:12345-192.168.206.5@tcp:101:rm.0 00010000:00010000:2.0:1788460033.646235:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460033.646255:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f400/0x5dfa74784542b074 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a5c0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.646319:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f600/0x5dfa74784542b07b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.646333:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f600/0x5dfa74784542b07b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.646344:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f600/0x5dfa74784542b07b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788460033.646399:0:6534:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788460033.646403:0:6534:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788460033.646566:0:6534:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f600/0x5dfa74784542b07b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.646595:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f400/0x5dfa74784542b074 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a5c0 expref: 15 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.646613:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f600/0x5dfa74784542b07b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a5c0 expref: 14 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.646621:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8c4bef1fcd00) 00010000:00010000:2.0:1788460033.646624:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788460033.646628:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ac395f600, rc 0) 00000100:00100000:2.0:1788460033.646689:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc4719c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+14:10479:x1875336003345280:12345-192.168.206.5@tcp:101:rm.0 Request processed in 480us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460033.646697:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 33 00000100:00100000:0.0:1788460033.654613:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460033.654759:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003345536 00000100:00100000:3.0:1788460033.654768:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003345536 00000100:00100000:3.0:1788460033.654826:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 34 00000100:00100000:3.0:1788460033.654843:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfaea8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+14:10479:x1875336003345536:12345-192.168.206.5@tcp:101:rm.0 00010000:00010000:3.0:1788460033.655525:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460033.655548:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841c00/0x5dfa74784542b082 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a5c7 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788460033.657597:0:6535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788460033.657724:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841c00/0x5dfa74784542b082 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a5c7 expref: 16 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.657741:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4bef200700) 00010000:00010000:2.0:1788460033.657744:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788460033.657749:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841c00/0x5dfa74784542b082 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a5c7 expref: 16 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.657765:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ac2841c00, rc 0) 00000100:00100000:2.0:1788460033.657882:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfaea8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+15:10479:x1875336003345536:12345-192.168.206.5@tcp:101:rm.0 Request processed in 3048us (3278us total) trans 4294967305 rc 301/301 00000100:00100000:2.0:1788460033.657892:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 34 00000100:00100000:3.0:1788460033.664289:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460033.664531:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003345664 00000100:00100000:0.0:1788460033.664541:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003345664 00000100:00100000:0.0:1788460033.664631:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 3 00000100:00100000:0.0:1788460033.664642:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3b5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+15:10479:x1875336003345664:12345-192.168.206.5@tcp:37:rm.0 00000100:00100000:0.0:1788460033.672368:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3b5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+15:10479:x1875336003345664:12345-192.168.206.5@tcp:37:rm.0 Request processed in 7718us (8076us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460033.672381:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 3 00000100:00100000:1.0:1788460033.677010:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460033.677557:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003345920 00000100:00100000:2.0:1788460033.677566:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003345920 00000100:00100000:2.0:1788460033.677624:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 4 00000100:00100000:2.0:1788460033.677633:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc6be1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+15:10479:x1875336003345920:12345-192.168.206.5@tcp:35:rm.0 00000100:00100000:2.0:1788460033.677841:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc6be1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+16:10479:x1875336003345920:12345-192.168.206.5@tcp:35:rm.0 Request processed in 209us (839us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788460033.677850:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 4 00000100:00100000:3.0:1788460033.682157:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460033.682815:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003346176 00000100:00100000:1.0:1788460033.682825:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003346176 00000100:00100000:1.0:1788460033.682902:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 35 00000100:00100000:1.0:1788460033.682913:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+16:10479:x1875336003346176:12345-192.168.206.5@tcp:101:rm.0 00010000:00010000:1.0:1788460033.682979:0:13560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460033.683001:0:13560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677200/0x5dfa74784542b090 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a5ce expref: -99 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460033.683116:0:13560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676600/0x5dfa74784542b097 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460033.683561:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676600/0x5dfa74784542b097 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460033.683576:0:13560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676600/0x5dfa74784542b097 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788460033.683589:0:13560:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788460033.683730:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677200/0x5dfa74784542b090 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a5ce expref: 19 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460033.683749:0:13560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676600/0x5dfa74784542b097 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a5ce expref: 18 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460033.683770:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8c4bef1fcd00) 00010000:00010000:1.0:1788460033.683773:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788460033.683776:0:13560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ac3676600, rc 0) 00000100:00100000:1.0:1788460033.683842:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3b5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+18:10479:x1875336003346176:12345-192.168.206.5@tcp:101:rm.0 Request processed in 931us (1692us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1788460033.683849:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 35 00000100:00100000:1.0:1788460033.687684:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460033.687792:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003346304 00000100:00100000:2.0:1788460033.687803:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003346304 00000100:00100000:2.0:1788460033.687966:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 36 00000100:00100000:2.0:1788460033.687976:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc471b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+18:10479:x1875336003346304:12345-192.168.206.5@tcp:41:rm.0 00000004:00000024:2.0:1788460033.688025:0:6534:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847026688 avail 7383982080 00000100:00100000:2.0:1788460033.689969:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc471b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+18:10479:x1875336003346304:12345-192.168.206.5@tcp:41:rm.0 Request processed in 1967us (2265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460033.689983:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 36 00000100:00100000:0.0:1788460033.696913:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460033.697158:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003346432 00000100:00100000:2.0:1788460033.697168:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003346432 00000100:00100000:2.0:1788460033.697241:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 37 00000100:00100000:2.0:1788460033.697250:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfaeaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+18:10479:x1875336003346432:12345-192.168.206.5@tcp:101:rm.0 00010000:00010000:2.0:1788460033.697270:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460033.697291:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f400/0x5dfa74784542b0a5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a5d5 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.697375:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6800/0x5dfa74784542b0ac lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.697390:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6800/0x5dfa74784542b0ac lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.697401:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6800/0x5dfa74784542b0ac lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.697413:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b0b3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0xe41446a2 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.697421:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b0b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xe41446a2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.697428:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b0b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xe41446a2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.697674:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f0800/0x5dfa74784542b0ba lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.697683:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f0800/0x5dfa74784542b0ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.697689:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f0800/0x5dfa74784542b0ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788460033.697718:0:6535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788460033.697722:0:6535:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788460033.697737:0:6535:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f0800/0x5dfa74784542b0ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.697757:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f0800/0x5dfa74784542b0ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.697764:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6800/0x5dfa74784542b0ac lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.697770:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6800/0x5dfa74784542b0ac lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.697777:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6800/0x5dfa74784542b0ac lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.697782:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bfadc6800 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:2.0:1788460033.697785:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6800/0x5dfa74784542b0ac lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.697791:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6800/0x5dfa74784542b0ac lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.697801:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8c4bef1fcd00) 00010000:00010000:2.0:1788460033.697804:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460033.697809:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6800/0x5dfa74784542b0ac lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.697814:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6800/0x5dfa74784542b0ac lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.697825:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b0b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xe41446a2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.697830:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b0b3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xe41446a2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.697840:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b0b3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xe41446a2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.697845:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bfadc6400 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:2.0:1788460033.697847:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b0b3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xe41446a2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.697852:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b0b3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0xe41446a2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.697859:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xe41446a2 (ffff8c4bef200400) 00010000:00010000:2.0:1788460033.697861:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460033.697863:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b0b3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xe41446a2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.697869:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b0b3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0xe41446a2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.697891:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f400/0x5dfa74784542b0a5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a5d5 expref: 20 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.697904:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f0800/0x5dfa74784542b0ba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a5d5 expref: 19 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.697911:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8c4bc5dc1b00) 00010000:00010000:2.0:1788460033.697913:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788460033.697915:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc14f0800, rc 0) 00000100:00100000:2.0:1788460033.698592:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfaeaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+19:10479:x1875336003346432:12345-192.168.206.5@tcp:101:rm.0 Request processed in 1340us (1686us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460033.698614:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 37 00000100:00100000:0.0:1788460033.705652:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460033.705730:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003346688 00000100:00100000:3.0:1788460033.705739:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003346688 00000100:00100000:3.0:1788460033.706437:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 38 00000100:00100000:3.0:1788460033.706451:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfaeabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+19:10479:x1875336003346688:12345-192.168.206.5@tcp:36:rm.0 00010000:00010000:3.0:1788460033.706599:0:6533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788460033.706627:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f0800/0x5dfa74784542b0ba lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a5d5 expref: 19 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460033.706650:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0800/0x5dfa74784542b066 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a5b9 expref: 18 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460033.706675:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8c4bc5dc1b00) 00010000:00010000:3.0:1788460033.706688:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f600/0x5dfa74784542b07b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a5c0 expref: 17 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460033.706696:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8c4bef1fcd00) 00010000:00010000:3.0:1788460033.706700:0:6533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788460033.706720:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841c00/0x5dfa74784542b0c1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460033.706732:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841c00/0x5dfa74784542b0c1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460033.706741:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841c00/0x5dfa74784542b0c1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460033.706750:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840a00/0x5dfa74784542b0c8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0xe41446a2 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460033.706757:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840a00/0x5dfa74784542b0c8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xe41446a2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460033.706762:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840a00/0x5dfa74784542b0c8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xe41446a2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.707605:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f1e00/0x5dfa74784542b0cf lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.707618:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f1e00/0x5dfa74784542b0cf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.707626:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f1e00/0x5dfa74784542b0cf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788460033.707848:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1788460033.708554:0:6533:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 330811609079ns, next at 331811604836ns, rc = 0 00010000:00010000:2.0:1788460033.708609:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f0200/0x5dfa74784542b0d6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.708621:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f0200/0x5dfa74784542b0d6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.708630:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f0200/0x5dfa74784542b0d6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.708638:0:6533:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f0200/0x5dfa74784542b0d6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.708645:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f0200/0x5dfa74784542b0d6 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.708651:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f0200/0x5dfa74784542b0d6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.708718:0:6533:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788460033.708737:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f1e00/0x5dfa74784542b0cf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.708755:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f1e00/0x5dfa74784542b0cf lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.708761:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f1e00/0x5dfa74784542b0cf lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.708767:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc14f1e00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:2.0:1788460033.708772:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f1e00/0x5dfa74784542b0cf lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.708779:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f1e00/0x5dfa74784542b0cf lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.708791:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8c4bc5dc1b00) 00010000:00010000:2.0:1788460033.708794:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788460033.708798:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f1e00/0x5dfa74784542b0cf lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.708804:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f1e00/0x5dfa74784542b0cf lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.708822:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841c00/0x5dfa74784542b0c1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.708827:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841c00/0x5dfa74784542b0c1 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.708833:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841c00/0x5dfa74784542b0c1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.708838:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac2841c00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:2.0:1788460033.708845:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841c00/0x5dfa74784542b0c1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.708861:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841c00/0x5dfa74784542b0c1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.708869:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8c4bef1fcd00) 00010000:00010000:2.0:1788460033.708872:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460033.708875:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841c00/0x5dfa74784542b0c1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.708881:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841c00/0x5dfa74784542b0c1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788460033.708891:0:6533:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000286737eb reply state 000000008396c84e transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840a00/0x5dfa74784542b0c8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0xe41446a2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.708901:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840a00/0x5dfa74784542b0c8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xe41446a2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.708907:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xe41446a2 (ffff8c4bef200400) 00010000:00010000:2.0:1788460033.708909:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788460033.708912:0:6533:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788460033.709024:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfaeabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+18:10479:x1875336003346688:12345-192.168.206.5@tcp:36:rm.0 Request processed in 2575us (3377us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788460033.709033:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 38 00010000:00010000:1.0:1788460033.709453:0:9536:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788460033.709461:0:9536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f0200/0x5dfa74784542b0d6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460033.709469:0:9536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc14f0200 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:1.0:1788460033.709473:0:9536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f0200/0x5dfa74784542b0d6 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460033.709480:0:9536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f0200/0x5dfa74784542b0d6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460033.709492:0:9536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8c4bc5dc1b00) 00010000:00010000:1.0:1788460033.709495:0:9536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788460033.709498:0:9536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f0200/0x5dfa74784542b0d6 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460033.709503:0:9536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f0200/0x5dfa74784542b0d6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460033.709515:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460033.709517:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460033.709518:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788460033.718721:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460033.719888:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003346944 00000100:00100000:2.0:1788460033.719899:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003346944 00000100:00100000:2.0:1788460033.720152:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 5 00000100:00100000:2.0:1788460033.720163:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc471b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+18:10479:x1875336003346944:12345-192.168.206.5@tcp:35:rm.0 00000100:00100000:2.0:1788460033.721252:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc471b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+19:10479:x1875336003346944:12345-192.168.206.5@tcp:35:rm.0 Request processed in 1085us (2533us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788460033.722317:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 5 00000100:00100000:0.0:1788460033.726171:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460033.726628:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003347200 00000100:00100000:2.0:1788460033.726638:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003347200 00000100:00100000:2.0:1788460033.727062:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 39 00000100:00100000:2.0:1788460033.727075:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfaeab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+19:10479:x1875336003347200:12345-192.168.206.5@tcp:36:rm.0 00010000:00010000:2.0:1788460033.727132:0:6534:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788460033.727156:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676600/0x5dfa74784542b097 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a5ce expref: 19 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.727176:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b035 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a5ab expref: 18 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.727185:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8c4bef1fcd00) 00010000:00010000:2.0:1788460033.727199:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542aff6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a59d expref: 17 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.727207:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4bef200700) 00010000:00010000:2.0:1788460033.727213:0:6534:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788460033.727235:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f1e00/0x5dfa74784542b0dd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.727248:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f1e00/0x5dfa74784542b0dd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.727259:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f1e00/0x5dfa74784542b0dd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.727271:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f0400/0x5dfa74784542b0e4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.727291:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f0400/0x5dfa74784542b0e4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.727298:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f0400/0x5dfa74784542b0e4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.727386:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f0800/0x5dfa74784542b0eb lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.727394:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f0800/0x5dfa74784542b0eb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.727401:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f0800/0x5dfa74784542b0eb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788460033.728848:0:6534:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788460033.728867:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f0800/0x5dfa74784542b0eb lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.728875:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f0800/0x5dfa74784542b0eb lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.728881:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f0800/0x5dfa74784542b0eb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.728886:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc14f0800 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:2.0:1788460033.728890:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f0800/0x5dfa74784542b0eb lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.728898:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f0800/0x5dfa74784542b0eb lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.728923:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8c4bef1fcc00) 00010000:00010000:2.0:1788460033.728926:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788460033.729103:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f0800/0x5dfa74784542b0eb lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.729110:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f0800/0x5dfa74784542b0eb lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.729304:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f1e00/0x5dfa74784542b0dd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.729520:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f1e00/0x5dfa74784542b0dd lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.729526:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f1e00/0x5dfa74784542b0dd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.729531:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc14f1e00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:2.0:1788460033.729534:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f1e00/0x5dfa74784542b0dd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.729540:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f1e00/0x5dfa74784542b0dd lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.729548:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4bef1fc100) 00010000:00010000:2.0:1788460033.729550:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460033.729553:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f1e00/0x5dfa74784542b0dd lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.729558:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f1e00/0x5dfa74784542b0dd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788460033.729587:0:6534:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000097112939 reply state 000000007c914926 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f0400/0x5dfa74784542b0e4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.729598:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f0400/0x5dfa74784542b0e4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460033.729605:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8c4bef1fca00) 00010000:00010000:2.0:1788460033.729607:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788460033.729611:0:6534:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788460033.729896:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfaeab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+18:10479:x1875336003347200:12345-192.168.206.5@tcp:36:rm.0 Request processed in 2821us (3729us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788460033.729905:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 39 00010000:00010000:1.0:1788460033.814344:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788460033.994155:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460033.994199:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460033.994293:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460033.994349:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003347328 00000100:00100000:1.0:1788460033.994359:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003347328 00000100:00100000:1.0:1788460033.994411:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 375 00000100:00100000:1.0:1788460033.994420:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf363f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bed032f6-c389-485e-b2f7-e2ea34763c65+14:2393:x1875336003347328:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:1.0:1788460033.994491:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf363f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bed032f6-c389-485e-b2f7-e2ea34763c65+14:2393:x1875336003347328:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 71us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460033.994500:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 375 00000100:00100000:0.0:1788460033.998693:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460034.002418:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003347584 00000100:00100000:2.0:1788460034.002432:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003347584 00000100:00100000:2.0:1788460034.002584:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003347456 00000100:00100000:2.0:1788460034.002588:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003347456 00000100:00100000:0.0:1788460034.003315:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003347712 00000100:00100000:0.0:1788460034.003325:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003347712 00000100:00100000:1.0:1788460034.003579:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 201 00000100:00100000:1.0:1788460034.003601:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfae8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a5915a6d-4114-41fb-8d95-33add86e0720+5:2393:x1875336003347584:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:1.0:1788460034.003678:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfae8d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a5915a6d-4114-41fb-8d95-33add86e0720+5:2393:x1875336003347584:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 89us (9478us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460034.003686:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 201 00000100:00080000:3.0:1788460034.004152:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788460034.004158:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788460034.012572:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 202 00000100:00100000:2.0:1788460034.012591:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfae8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2393:x1875336003347456:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:2.0:1788460034.012685:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfae8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2393:x1875336003347456:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 100us (18390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460034.012693:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 202 00000100:00100000:1.0:1788460034.013047:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 203 00000100:00100000:1.0:1788460034.013056:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfae8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a5915a6d-4114-41fb-8d95-33add86e0720+5:2393:x1875336003347712:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:1.0:1788460034.013088:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfae8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a5915a6d-4114-41fb-8d95-33add86e0720+5:2393:x1875336003347712:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 33us (14404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460034.013094:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 203 00010000:00010000:1.0:1788460034.833316:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460035.857124:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788460036.690148:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4718a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022308352:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788460036.690232:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460036.690420:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022308352 00000100:00100000:3.0:1788460036.690428:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022308352 00000100:00080000:0.0:1788460036.690479:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788460036.690490:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788460036.690499:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3af4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875336022308352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788460036.690540:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000004:00080000:1.0:1788460036.690555:0:8829:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 333793610368ns, next at 334793607728ns, rc = 0 00000100:00100000:3.0:1788460036.694643:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3af4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875336022308352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4136us (4401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460036.695049:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00010000:00080000:2.0:1788460036.698253:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bc4718a80 x1875336022308352/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460052 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460036.698286:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4718a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022308352:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788460036.881289:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788460037.201356:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022308480:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788460037.201459:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460037.201986:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022308480 00000100:00100000:0.0:1788460037.202012:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022308480 00000100:00100000:0.0:1788460037.202093:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788460037.202104:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc471aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022308480:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788460037.202132:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788460037.202202:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc471aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022308480:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460037.202211:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00080000:0.0:1788460037.202273:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3af7100 x1875336022308480/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460053 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460037.202296:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022308480:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788460037.202331:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788460037.202434:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788460037.202445:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022308608:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788460037.202485:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460037.202526:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022308608 00000100:00100000:2.0:1788460037.202530:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022308608 00000100:00100000:2.0:1788460037.202573:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788460037.202581:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3af7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022308608:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788460037.203006:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788460037.203070:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3af7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022308608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 490us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460037.203078:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788460037.203461:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022308608:0@lo:41:osp-pre-0-1.0 00000001:02000400:2.0:1788460037.667374:0:13695:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:1.0:1788460037.907087:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788460038.226528:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788460038.226567:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4719f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022308736:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788460038.226639:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460038.226707:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022308736 00000100:00100000:3.0:1788460038.226717:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022308736 00000100:00100000:3.0:1788460038.226790:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788460038.226799:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3af4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1875336022308736:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788460038.226841:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446453248 avail 1300213760 00000100:00100000:3.0:1788460038.226902:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3af4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1875336022308736:12345-0@lo:41:osp-pre-1-0.0 Request processed in 104us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460038.226922:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788460038.227023:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4719f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022308736:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788460038.737386:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788460038.737407:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3b5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022308864:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788460038.737487:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460038.737548:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022308864 00000100:00100000:3.0:1788460038.737554:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022308864 00000100:00100000:0.0:1788460038.737595:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfae8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022308992:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788460038.737613:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788460038.737622:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460038.737627:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3b58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1875336022308864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788460038.737654:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788460038.737707:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3b58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1875336022308864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460038.737731:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788460038.737746:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022308992 00000100:00100000:3.0:1788460038.737749:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022308992 00000100:00100000:3.0:1788460038.737766:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788460038.737773:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfae8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022308992:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788460038.737785:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788460038.737822:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfae8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022308992:12345-0@lo:13:osp-pre-1-1.0 Request processed in 49us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460038.737830:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:3.0:1788460038.737852:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788460038.737867:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4719f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0cf73fe6-82e2-434e-b670-631647721b2c:3660:1875336022309120:0@lo:400:kworker.0 00000100:00100000:1.0:1788460038.737928:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4719500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022309376:0@lo:400:kworker.0 00000100:00100000:0.0:1788460038.738400:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc471b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875336022309248:0@lo:400:kworker.0 00000100:00100000:3.0:1788460038.739212:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460038.739253:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460038.739268:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3a32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3660:1875336022309632:0@lo:400:kworker.0 00000100:00100000:1.0:1788460038.739287:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3a30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022309888:0@lo:400:kworker.0 00000100:00100000:3.0:1788460038.739304:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460038.739330:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3a30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3660:1875336022310144:0@lo:400:kworker.0 00000100:00100000:1.0:1788460038.739335:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460038.739359:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460038.739376:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788460038.739382:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4718a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3660:1875336022309504:0@lo:400:kworker.0 00000100:00100000:3.0:1788460038.739402:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460038.739432:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3a31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022310016:0@lo:400:kworker.0 00000100:00100000:3.0:1788460038.739466:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022309120 00000100:00100000:3.0:1788460038.739474:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022309120 00000100:00100000:3.0:1788460038.739515:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:1.0:1788460038.739523:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022309376 00000100:00100000:3.0:1788460038.739525:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf363fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+29:3660:x1875336022309120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460038.739530:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022309376 00000100:00100000:1.0:1788460038.739573:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788460038.739579:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf363fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+29:3660:x1875336022309120:12345-0@lo:400:kworker.0 Request processed in 56us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460038.739584:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3a33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022309376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460038.739599:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:1.0:1788460038.739635:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3a33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022309376:12345-0@lo:400:kworker.0 Request processed in 53us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460038.739638:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022309632 00000100:00100000:3.0:1788460038.739644:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022309632 00000100:00100000:1.0:1788460038.739647:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788460038.739675:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022310144 00000100:00100000:1.0:1788460038.739680:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022310144 00000100:00100000:3.0:1788460038.739684:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022309504 00000100:00100000:3.0:1788460038.739690:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022309504 00000100:00100000:3.0:1788460038.739713:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1788460038.739720:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1788460038.739723:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3b5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1875336022309632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460038.739734:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3b6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1875336022310144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460038.739758:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460038.739759:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3b5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1875336022309632:12345-0@lo:400:kworker.0 Request processed in 40us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460038.739766:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1788460038.739779:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3a33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1875336022309760:0@lo:400:kworker.0 00000100:00100000:3.0:1788460038.739781:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022309248 00000100:00100000:3.0:1788460038.739784:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022309248 00000100:00100000:1.0:1788460038.739785:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3b6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1875336022310144:12345-0@lo:400:kworker.0 Request processed in 55us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460038.739795:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1788460038.739805:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460038.739809:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1788460038.739816:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1788460038.739819:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3b6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1875336022309504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460038.739830:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfae8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1875336022309248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460038.739841:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3a31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1875336022310272:0@lo:400:kworker.0 00000100:00100000:3.0:1788460038.739851:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3b6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1875336022309504:12345-0@lo:400:kworker.0 Request processed in 36us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460038.739857:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1788460038.739871:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022309760 00000100:00100000:3.0:1788460038.739874:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022309760 00000100:00100000:1.0:1788460038.739879:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfae8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1875336022309248:12345-0@lo:400:kworker.0 Request processed in 52us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460038.740282:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1788460038.740295:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460038.740301:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022310272 00000100:00100000:1.0:1788460038.740307:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022310272 00010000:00080000:0.0:1788460038.740333:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3b5bb80 x1875336022308864/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460054 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460038.740352:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3b5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022308864:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788460038.740375:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc471b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875336022309248:0@lo:400:kworker.0 00000100:00100000:0.0:1788460038.740631:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022309888 00000100:00100000:0.0:1788460038.740636:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022309888 00000100:00100000:0.0:1788460038.740675:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788460038.740682:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3a30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022309888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460038.740717:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3a30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022309888:12345-0@lo:400:kworker.0 Request processed in 37us (1386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460038.740724:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788460038.742801:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1788460038.742826:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfae8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1875336022309760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460038.742921:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfae8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1875336022309760:12345-0@lo:400:kworker.0 Request processed in 108us (3117us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460038.742930:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00080000:3.0:1788460038.742986:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788460038.742991:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788460038.743026:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00010000:00080000:3.0:1788460038.743028:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bfae8c000 x1875336022308992/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460054 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460038.743064:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfae8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022308992:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788460038.743214:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfa1e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1875336022310272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460038.743270:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfa1e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1875336022310272:12345-0@lo:400:kworker.0 Request processed in 234us (3379us total) trans 0 rc 0/0 00010000:00080000:3.0:1788460038.743272:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3a33800 x1875336022309760/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460054 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460038.743286:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1788460038.743291:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3a33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1875336022309760:0@lo:400:kworker.0 00010000:00080000:3.0:1788460038.743307:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3a31180 x1875336022310272/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460054 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460038.743316:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3a31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1875336022310272:0@lo:400:kworker.0 00000100:00100000:1.0:1788460038.744004:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4719500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022309376:0@lo:400:kworker.0 00010000:00080000:1.0:1788460038.744025:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3a30a80 x1875336022309888/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788460054 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460038.744036:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3a30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022309888:0@lo:400:kworker.0 00000100:00100000:0.0:1788460038.744649:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460038.744703:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3a32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3660:1875336022309632:0@lo:400:kworker.0 00000100:00100000:0.0:1788460038.744717:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3a30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3660:1875336022310144:0@lo:400:kworker.0 00000100:00100000:0.0:1788460038.744729:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4719f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0cf73fe6-82e2-434e-b670-631647721b2c:3660:1875336022309120:0@lo:400:kworker.0 00000100:00100000:0.0:1788460038.744758:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4718a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3660:1875336022309504:0@lo:400:kworker.0 00000100:00100000:3.0:1788460038.744786:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022310016 00000100:00100000:3.0:1788460038.744793:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022310016 00000100:00100000:3.0:1788460038.744982:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788460038.744992:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfa1e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022310016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460038.745050:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfa1e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022310016:12345-0@lo:400:kworker.0 Request processed in 60us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460038.745057:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:0.0:1788460038.745187:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788460038.745337:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3a31f80 x1875336022310016/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788460054 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460038.745348:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3a31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022310016:0@lo:400:kworker.0 00010000:00010000:1.0:1788460038.930310:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788460039.004320:0:13744:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc88045040 20000000:00000080:2.0:1788460039.004337:0:13744:0:(mgs_handler.c:1172:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8c4bf75ed400 uarg=0000000000000000 20000000:01000000:2.0:1788460039.004376:0:13744:0:(mgs_llog.c:6198:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1788460039.004382:0:13744:0:(mgs_llog.c:4653:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1788460039.004386:0:13744:0:(mgs_llog.c:1385:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:0.0:1788460039.005273:0:13745:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1788460039.005425:0:13744:0:(mgs_llog.c:4126:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1788460039.013146:0:13744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1788460039.013188:0:13744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1788460039.013207:0:13744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1788460039.013224:0:13744:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788460039.013242:0:13744:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c4bc14f0800/0x5dfa74784542b0f2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460039.013259:0:13744:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4bfadc6a00/0x5dfa74784542af7f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a588 expref: 13 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460039.013281:0:13744:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4ac3676200/0x5dfa74784542af8d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542af86 expref: 28 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460039.013288:0:13744:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4bfadc7c00/0x5dfa74784542af94 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a58f expref: 13 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460039.013295:0:13744:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4bfadc7800/0x5dfa74784542afa2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542af9b expref: 28 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460039.013302:0:13744:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4bfadc7600/0x5dfa74784542afb0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542afa9 expref: 28 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460039.013308:0:13744:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4ac3677600/0x5dfa74784542afbe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542afb7 expref: 28 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460039.013314:0:13744:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c4bc14f0800/0x5dfa74784542b0f2 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460039.013349:0:13744:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4ac3677600/0x5dfa74784542afbe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5dfa74784542afb7 expref: 28 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460039.013364:0:13744:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c4ac3677600/0x5dfa74784542afbe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5dfa74784542afb7 expref: 28 pid: 6528 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460039.013378:0:13744:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13744:1875336022310400:0@lo:104: 00000100:00100000:2.0:1788460039.013436:0:13744:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788460039.013504:0:13744:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4bfadc7600/0x5dfa74784542afb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5dfa74784542afa9 expref: 28 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460039.013522:0:13744:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c4bfadc7600/0x5dfa74784542afb0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5dfa74784542afa9 expref: 28 pid: 6525 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460039.013530:0:13744:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfa358e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13744:1875336022310528:0@lo:104: 00000100:00100000:2.0:1788460039.013560:0:13744:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788460039.013593:0:13744:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4bfadc7800/0x5dfa74784542afa2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5dfa74784542af9b expref: 28 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460039.013601:0:13744:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c4bfadc7800/0x5dfa74784542afa2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5dfa74784542af9b expref: 28 pid: 6525 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460039.013608:0:13744:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf7710000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13744:1875336022310656:0@lo:104: 00000100:00100000:2.0:1788460039.013625:0:13744:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788460039.013642:0:13744:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4bfadc7c00/0x5dfa74784542af94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a58f expref: 13 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460039.013652:0:13744:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c4bfadc7c00/0x5dfa74784542af94 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a58f expref: 13 pid: 6526 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460039.013660:0:13744:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf7710380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13744:1875336022310784:192.168.206.5@tcp:104: 00000100:00100000:3.0:1788460039.013682:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022310400 00000100:00100000:3.0:1788460039.013690:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022310400 00010000:00010000:2.0:1788460039.013708:0:13744:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4ac3676200/0x5dfa74784542af8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5dfa74784542af86 expref: 28 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460039.013717:0:13744:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8c4ac3676200/0x5dfa74784542af8d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5dfa74784542af86 expref: 28 pid: 6525 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460039.013726:0:13744:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf7710a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13744:1875336022310912:0@lo:104: 00000100:00100000:3.0:1788460039.013728:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022310528 00000100:00100000:3.0:1788460039.013733:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022310528 00000100:00100000:3.0:1788460039.013747:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022310656 00000100:00100000:2.0:1788460039.013752:0:13744:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460039.013753:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022310656 00000100:00100000:3.0:1788460039.013767:0:6517:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022310912 00000100:00100000:3.0:1788460039.013779:0:6517:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022310912 00010000:00010000:2.0:1788460039.013783:0:13744:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4bfadc6a00/0x5dfa74784542af7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a588 expref: 13 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460039.013794:0:13744:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c4bfadc6a00/0x5dfa74784542af7f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a588 expref: 13 pid: 6528 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460039.013803:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788460039.013804:0:13744:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf7711c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13744:1875336022311040:192.168.206.5@tcp:104: 00000100:00100000:3.0:1788460039.013814:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3672300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0cf73fe6-82e2-434e-b670-631647721b2c+6:13744:x1875336022310400:12345-0@lo:104: 00010000:00010000:3.0:1788460039.013828:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0c00/0x5dfa74784542afb7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542afbe expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460039.013830:0:13744:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bfac3fa80 going to sleep for 11 seconds 00010000:00010000:3.0:1788460039.014150:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788460039.014157:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3672300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0cf73fe6-82e2-434e-b670-631647721b2c+6:13744:x1875336022310400:12345-0@lo:104: Request processed in 345us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460039.014166:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788460039.014182:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788460039.014188:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf7712d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0cf73fe6-82e2-434e-b670-631647721b2c+5:13744:x1875336022310528:12345-0@lo:104: 00010000:00010000:3.0:1788460039.014195:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7e00/0x5dfa74784542afa9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542afb0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460039.014228:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788460039.014233:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf7712d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0cf73fe6-82e2-434e-b670-631647721b2c+5:13744:x1875336022310528:12345-0@lo:104: Request processed in 46us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460039.014240:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788460039.014250:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788460039.014256:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf7712a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0cf73fe6-82e2-434e-b670-631647721b2c+4:13744:x1875336022310656:12345-0@lo:104: 00010000:00010000:3.0:1788460039.014263:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.206.105@tcp lock: ffff8c4ac3676c00/0x5dfa74784542af9b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542afa2 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460039.014291:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788460039.014296:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf7712a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0cf73fe6-82e2-434e-b670-631647721b2c+4:13744:x1875336022310656:12345-0@lo:104: Request processed in 41us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460039.014302:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788460039.014322:0:6517:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788460039.014328:0:6517:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf7712680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0cf73fe6-82e2-434e-b670-631647721b2c+3:13744:x1875336022310912:12345-0@lo:104: 00010000:00010000:3.0:1788460039.014336:0:6517:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677a00/0x5dfa74784542af86 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542af8d expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460039.014364:0:6517:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1788460039.014369:0:6517:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf7712680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0cf73fe6-82e2-434e-b670-631647721b2c+3:13744:x1875336022310912:12345-0@lo:104: Request processed in 42us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460039.014375:0:6517:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788460039.016661:0:13744:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13744:1875336022310400:0@lo:104: 00000100:00100000:2.0:1788460039.016676:0:13744:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfa358e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13744:1875336022310528:0@lo:104: 00000100:00100000:2.0:1788460039.016685:0:13744:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf7710000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13744:1875336022310656:0@lo:104: 00000100:00100000:2.0:1788460039.016692:0:13744:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf7710a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13744:1875336022310912:0@lo:104: 00000100:00100000:2.0:1788460039.017008:0:13744:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf7710380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13744:1875336022310784:192.168.206.5@tcp:104: 00000100:00100000:2.0:1788460039.017017:0:13744:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf7711c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13744:1875336022311040:192.168.206.5@tcp:104: 00010000:00010000:2.0:1788460039.017047:0:13744:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c4bc14f0800/0x5dfa74784542b0f2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460039.017556:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788460039.017565:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0c00/0x5dfa74784542afb7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542afbe expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460039.017574:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc29d0c00 already unused, calling callback (ffffffffc125ae00) 10000000:00010000:1.0:1788460039.017579:0:6521:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0c00/0x5dfa74784542afb7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5dfa74784542afbe expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460039.017597:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0c00/0x5dfa74784542afb7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5dfa74784542afbe expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788460039.017604:0:6521:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0c00/0x5dfa74784542afb7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5dfa74784542afbe expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788460039.017609:0:6521:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788460039.017659:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0c00/0x5dfa74784542afb7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542afbe expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460039.017682:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788460039.017708:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0c00/0x5dfa74784542afb7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542afbe expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460039.017715:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d0c00/0x5dfa74784542afb7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542afbe expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460039.017728:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788460039.017732:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7e00/0x5dfa74784542afa9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542afb0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460039.017737:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bfadc7e00 already unused, calling callback (ffffffffc125ae00) 10000000:00010000:1.0:1788460039.017740:0:6521:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7e00/0x5dfa74784542afa9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5dfa74784542afb0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460039.017746:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7e00/0x5dfa74784542afa9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5dfa74784542afb0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788460039.017753:0:6521:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7e00/0x5dfa74784542afa9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5dfa74784542afb0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788460039.017758:0:6521:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788460039.017773:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7e00/0x5dfa74784542afa9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542afb0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460039.017784:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788460039.017799:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7e00/0x5dfa74784542afa9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542afb0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460039.017806:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7e00/0x5dfa74784542afa9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542afb0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460039.017826:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788460039.017829:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: ffff8c4ac3676c00/0x5dfa74784542af9b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542afa2 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460039.017835:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac3676c00 already unused, calling callback (ffffffffc125ae00) 10000000:00010000:1.0:1788460039.017838:0:6521:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: ffff8c4ac3676c00/0x5dfa74784542af9b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5dfa74784542afa2 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460039.017845:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: ffff8c4ac3676c00/0x5dfa74784542af9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5dfa74784542afa2 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788460039.017851:0:6521:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: ffff8c4ac3676c00/0x5dfa74784542af9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5dfa74784542afa2 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788460039.017856:0:6521:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788460039.017869:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.206.105@tcp lock: ffff8c4ac3676c00/0x5dfa74784542af9b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542afa2 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460039.017875:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788460039.017881:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: ffff8c4ac3676c00/0x5dfa74784542af9b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542afa2 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460039.017888:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: ffff8c4ac3676c00/0x5dfa74784542af9b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542afa2 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460039.017897:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788460039.017910:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677a00/0x5dfa74784542af86 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542af8d expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460039.017927:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac3677a00 already unused, calling callback (ffffffffc125ae00) 10000000:00010000:1.0:1788460039.017930:0:6521:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677a00/0x5dfa74784542af86 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5dfa74784542af8d expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460039.017936:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677a00/0x5dfa74784542af86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5dfa74784542af8d expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788460039.017996:0:6521:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677a00/0x5dfa74784542af86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5dfa74784542af8d expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788460039.018003:0:6521:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788460039.018019:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677a00/0x5dfa74784542af86 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542af8d expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460039.018025:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788460039.018032:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677a00/0x5dfa74784542af86 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542af8d expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460039.018037:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677a00/0x5dfa74784542af86 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542af8d expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460039.018050:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460039.018052:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460039.018054:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460039.018062:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460039.018067:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460039.018072:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788460039.018085:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3a30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0cf73fe6-82e2-434e-b670-631647721b2c:3662:1875336022311168:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788460039.018217:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460039.018278:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788460039.018285:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3a33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0cf73fe6-82e2-434e-b670-631647721b2c:3662:1875336022311552:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788460039.018439:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460039.018466:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3a31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0cf73fe6-82e2-434e-b670-631647721b2c:3659:1875336022311296:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788460039.018467:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022311168 00000100:00100000:3.0:1788460039.018473:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022311168 00000100:00100000:1.0:1788460039.018486:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788460039.018499:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4ac3677600/0x5dfa74784542afbe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542afb7 expref: 29 pid: 6528 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460039.018503:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788460039.018508:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3a33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0cf73fe6-82e2-434e-b670-631647721b2c:3659:1875336022311424:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788460039.018523:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022311552 00000100:00100000:1.0:1788460039.018525:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460039.018526:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022311552 00010000:00010000:3.0:1788460039.018537:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4ac3676200/0x5dfa74784542af8d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542af86 expref: 30 pid: 6525 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460039.018548:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022311296 00000100:00100000:1.0:1788460039.018549:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022311424 00000100:00100000:3.0:1788460039.018550:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022311296 00000100:00100000:1.0:1788460039.018551:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022311424 00010000:00010000:3.0:1788460039.018559:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4bfadc7600/0x5dfa74784542afb0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542afa9 expref: 32 pid: 6525 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460039.018564:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4bfadc7800/0x5dfa74784542afa2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542af9b expref: 32 pid: 6525 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460039.018571:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788460039.018627:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bedf6e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0cf73fe6-82e2-434e-b670-631647721b2c+32:3662:x1875336022311168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788460039.018641:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788460039.018646:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4ac3677600/0x5dfa74784542afbe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542afb7 expref: 32 pid: 6528 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460039.018668:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4ac3677600/0x5dfa74784542afbe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5dfa74784542afb7 expref: 32 pid: 6528 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460039.018681:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4ac3677600/0x5dfa74784542afbe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5dfa74784542afb7 expref: 32 pid: 6528 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460039.018693:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788460039.018711:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788460039.018718:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3a30e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0cf73fe6-82e2-434e-b670-631647721b2c+31:3662:x1875336022311552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788460039.018726:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1788460039.018727:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bedf6e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0cf73fe6-82e2-434e-b670-631647721b2c+31:3662:x1875336022311168:12345-0@lo:103:ldlm_bl.0 Request processed in 150us (510us total) trans 0 rc 0/0 00010000:00010000:1.0:1788460039.018730:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4ac3676200/0x5dfa74784542af8d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542af86 expref: 31 pid: 6525 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460039.018734:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00010000:1.0:1788460039.018738:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4ac3676200/0x5dfa74784542af8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5dfa74784542af86 expref: 31 pid: 6525 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460039.018747:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4ac3676200/0x5dfa74784542af8d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5dfa74784542af86 expref: 30 pid: 6525 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460039.018755:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788460039.018772:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788460039.018776:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3a30e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0cf73fe6-82e2-434e-b670-631647721b2c+29:3662:x1875336022311552:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460039.018777:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3a31f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0cf73fe6-82e2-434e-b670-631647721b2c+29:3659:x1875336022311296:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788460039.018782:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00010000:3.0:1788460039.018784:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788460039.018788:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4bfadc7600/0x5dfa74784542afb0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542afa9 expref: 29 pid: 6525 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460039.018796:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4bfadc7600/0x5dfa74784542afb0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5dfa74784542afa9 expref: 28 pid: 6525 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460039.018799:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788460039.018804:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3a30000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0cf73fe6-82e2-434e-b670-631647721b2c+28:3659:x1875336022311424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788460039.018806:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4bfadc7600/0x5dfa74784542afb0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5dfa74784542afa9 expref: 28 pid: 6525 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460039.018810:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788460039.018813:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788460039.018814:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4bfadc7800/0x5dfa74784542afa2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542af9b expref: 27 pid: 6525 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460039.018822:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4bfadc7800/0x5dfa74784542afa2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5dfa74784542af9b expref: 27 pid: 6525 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460039.018832:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4bfadc7800/0x5dfa74784542afa2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5dfa74784542af9b expref: 27 pid: 6525 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460039.018836:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3a31f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0cf73fe6-82e2-434e-b670-631647721b2c+27:3659:x1875336022311296:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (349us total) trans 0 rc 0/0 00010000:00010000:1.0:1788460039.018839:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788460039.018842:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788460039.018858:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3a30000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0cf73fe6-82e2-434e-b670-631647721b2c+25:3659:x1875336022311424:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460039.018863:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788460039.018893:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3a33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0cf73fe6-82e2-434e-b670-631647721b2c:3659:1875336022311424:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788460039.018916:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3a31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0cf73fe6-82e2-434e-b670-631647721b2c:3659:1875336022311296:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788460039.018940:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3a33480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0cf73fe6-82e2-434e-b670-631647721b2c:3662:1875336022311552:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788460039.018972:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3a30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0cf73fe6-82e2-434e-b670-631647721b2c:3662:1875336022311168:0@lo:103:ldlm_bl.0 00000004:00080000:2.0:1788460039.022247:0:6513:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:2.0:1788460039.022287:0:6513:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:2.0:1788460039.022299:0:6513:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:3.0:1788460039.022363:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841e00/0x5dfa74784542b04a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xe41446a2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460039.022394:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841e00/0x5dfa74784542b04a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xe41446a2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460039.022402:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841e00/0x5dfa74784542b04a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xe41446a2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460039.022408:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac2841e00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:3.0:1788460039.022413:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841e00/0x5dfa74784542b04a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xe41446a2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460039.022420:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841e00/0x5dfa74784542b04a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xe41446a2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460039.022435:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xe41446a2 (ffff8c4bef200400) 00010000:00010000:3.0:1788460039.022439:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460039.022444:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841e00/0x5dfa74784542b04a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xe41446a2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460039.022451:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841e00/0x5dfa74784542b04a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xe41446a2 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460039.022470:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0000/0x5dfa74784542b05f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460039.022476:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0000/0x5dfa74784542b05f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460039.022482:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0000/0x5dfa74784542b05f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460039.022487:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc29d0000 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:3.0:1788460039.022496:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0000/0x5dfa74784542b05f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460039.022503:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0000/0x5dfa74784542b05f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460039.022511:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8c4bc5dc1b00) 00010000:00010000:3.0:1788460039.022513:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460039.022516:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0000/0x5dfa74784542b05f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460039.022523:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0000/0x5dfa74784542b05f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460039.022541:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840a00/0x5dfa74784542b0c8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xe41446a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460039.022547:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840a00/0x5dfa74784542b0c8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xe41446a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460039.022553:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840a00/0x5dfa74784542b0c8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xe41446a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460039.022558:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac2840a00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:3.0:1788460039.022561:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840a00/0x5dfa74784542b0c8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xe41446a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460039.022566:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840a00/0x5dfa74784542b0c8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0xe41446a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460039.022574:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0xe41446a2 (ffff8c4bef200400) 00010000:00010000:3.0:1788460039.022576:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460039.022585:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840a00/0x5dfa74784542b0c8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xe41446a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460039.022708:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460039.022818:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003347840 00000100:00100000:2.0:1788460039.022827:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003347840 00010000:00010000:2.0:1788460039.022858:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4bfadc7c00/0x5dfa74784542af94 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a58f expref: 14 pid: 6526 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460039.022877:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788460039.022885:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 58 00000100:00100000:0.0:1788460039.022890:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfa1e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022311680:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788460039.022893:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3a30a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bed032f6-c389-485e-b2f7-e2ea34763c65+14:2393:x1875336003347840:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788460039.022928:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460039.022933:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4bfadc7c00/0x5dfa74784542af94 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a58f expref: 14 pid: 6526 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460039.022965:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4bfadc7c00/0x5dfa74784542af94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a58f expref: 14 pid: 6526 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460039.022979:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4bfadc7c00/0x5dfa74784542af94 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a58f expref: 14 pid: 6526 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460039.022991:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788460039.023032:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3a30a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bed032f6-c389-485e-b2f7-e2ea34763c65+13:2393:x1875336003347840:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 139us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460039.023040:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 58 00010000:00010000:3.0:1788460039.023121:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840a00/0x5dfa74784542b0c8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0xe41446a2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460039.023140:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f0400/0x5dfa74784542b0e4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460039.023147:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f0400/0x5dfa74784542b0e4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460039.023153:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f0400/0x5dfa74784542b0e4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460039.023158:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc14f0400 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:3.0:1788460039.023162:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f0400/0x5dfa74784542b0e4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460039.023168:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f0400/0x5dfa74784542b0e4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460039.023177:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8c4bef1fca00) 00010000:00010000:3.0:1788460039.023179:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460039.023182:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f0400/0x5dfa74784542b0e4 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460039.023188:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f0400/0x5dfa74784542b0e4 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460039.023276:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460039.023432:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022311680 00000100:00100000:1.0:1788460039.023438:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022311680 00000100:00100000:1.0:1788460039.023472:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788460039.023479:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfa1e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1875336022311680:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788460039.023499:0:8450:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:1.0:1788460039.023533:0:8450:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x6a99bc00, atime: 0x6a99bc00, ctime: 0x6a99bc00, blocks: 0x0 00010000:00010000:1.0:1788460039.023539:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070289e7b/0x5dfa74784542b0f9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460039.023551:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=336s v=(0 0) 00010000:00010000:1.0:1788460039.023555:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460039.023560:0:8450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070289e7b/0x5dfa74784542b0f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460039.023574:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000070289e7b/0x5dfa74784542b0f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460039.023581:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000070289e7b/0x5dfa74784542b0f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460039.023588:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000070289e7b/0x5dfa74784542b0f9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460039.023741:0:8450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788460039.023911:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfa1e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3661:x1875336022311680:12345-0@lo:6:osp-syn-0-0.0 Request processed in 420us (623us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788460039.023919:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:0.0:1788460039.024033:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788460039.024039:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000070289e7b/0x5dfa74784542b0f9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460039.024048:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac3677c00 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:0.0:1788460039.024051:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000070289e7b/0x5dfa74784542b0f9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460039.024060:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000070289e7b/0x5dfa74784542b0f9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460039.024091:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000070289e7b/0x5dfa74784542b0f9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460039.024099:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000070289e7b/0x5dfa74784542b0f9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460039.024124:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460039.024126:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460039.024128:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788460039.024201:0:3661:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8c4bfa1e2d80/2, rc 0, transno 4294967301 00000100:00100000:2.0:1788460039.024207:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfa1e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022311680:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788460039.026213:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460039.026280:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003347968 00000100:00100000:1.0:1788460039.026289:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003347968 00010000:00010000:1.0:1788460039.026324:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4bfadc6a00/0x5dfa74784542af7f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a588 expref: 13 pid: 6528 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460039.026422:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 59 00000100:00100000:1.0:1788460039.026444:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfa1e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bed032f6-c389-485e-b2f7-e2ea34763c65+13:2394:x1875336003347968:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788460039.026459:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788460039.026464:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4bfadc6a00/0x5dfa74784542af7f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a588 expref: 13 pid: 6528 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460039.026476:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4bfadc6a00/0x5dfa74784542af7f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a588 expref: 13 pid: 6528 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460039.026492:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4bfadc6a00/0x5dfa74784542af7f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a588 expref: 13 pid: 6528 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460039.026505:0:6519:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c4bc14f0800/0x5dfa74784542b0f2 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460039.026514:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bc14f0800/0x5dfa74784542b0f2 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460039.026530:0:6519:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c4bc14f0800/0x5dfa74784542b0f2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460039.026536:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c4bc14f0800/0x5dfa74784542b0f2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460039.026542:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c4bc14f0800/0x5dfa74784542b0f2 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460039.026548:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c4bc14f0800/0x5dfa74784542b0f2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460039.026554:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc14f0800 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:1.0:1788460039.026558:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c4bc14f0800/0x5dfa74784542b0f2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460039.026572:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c4bc14f0800/0x5dfa74784542b0f2 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460039.026593:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c4bc14f0800/0x5dfa74784542b0f2 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460039.026605:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788460039.026657:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfa1e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bed032f6-c389-485e-b2f7-e2ea34763c65+12:2394:x1875336003347968:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 214us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460039.026664:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 59 00010000:00010000:3.0:1788460039.026722:0:13744:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c4bc14f0800/0x5dfa74784542b0f2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460039.026741:0:13744:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c4bc14f0800/0x5dfa74784542b0f2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460039.026748:0:13744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4bc14f0800/0x5dfa74784542b0f2 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460039.123234:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460039.123265:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460039.123287:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460039.123315:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460039.123347:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460039.123373:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003348352 00000100:00100000:0.0:1788460039.123380:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003348352 00000100:00100000:0.0:1788460039.123427:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 85 00000100:00100000:0.0:1788460039.123435:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfa1e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2393:x1875336003348352:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:0.0:1788460039.123488:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfa1e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2393:x1875336003348352:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 55us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460039.123494:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 85 00000100:00100000:0.0:1788460039.123513:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003348096 00000100:00100000:0.0:1788460039.123516:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003348096 00000100:00100000:0.0:1788460039.123534:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003348608 00000100:00100000:0.0:1788460039.123536:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003348608 00000100:00100000:0.0:1788460039.123552:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003348224 00000100:00100000:0.0:1788460039.123554:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003348224 00000100:00100000:0.0:1788460039.123562:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003348480 00000100:00100000:0.0:1788460039.123564:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003348480 00000100:00100000:0.0:1788460039.123574:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 210 00000100:00100000:0.0:1788460039.123578:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfa1e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2393:x1875336003348096:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:0.0:1788460039.123606:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfa1e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2393:x1875336003348096:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 27us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460039.123611:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 210 00000100:00100000:0.0:1788460039.123620:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 211 00000100:00100000:0.0:1788460039.123625:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfa1e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a5915a6d-4114-41fb-8d95-33add86e0720+5:2393:x1875336003348608:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:0.0:1788460039.123640:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfa1e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a5915a6d-4114-41fb-8d95-33add86e0720+5:2393:x1875336003348608:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 15us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460039.123644:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 211 00000100:00100000:0.0:1788460039.123651:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 212 00000100:00100000:0.0:1788460039.123656:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfa1e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2393:x1875336003348224:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:0.0:1788460039.123670:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfa1e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2393:x1875336003348224:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 14us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460039.123674:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 212 00000100:00100000:0.0:1788460039.123681:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 213 00000100:00100000:0.0:1788460039.123685:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfa1e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a5915a6d-4114-41fb-8d95-33add86e0720+5:2393:x1875336003348480:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:0.0:1788460039.123698:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfa1e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a5915a6d-4114-41fb-8d95-33add86e0720+5:2393:x1875336003348480:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 13us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460039.123703:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 213 00000100:00080000:0.0:1788460039.123717:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788460039.123724:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788460039.123726:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:2.0:1788460039.788431:0:13794:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffeb674fcc0 20000000:00000080:2.0:1788460039.788447:0:13794:0:(mgs_handler.c:1172:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8c4bf75efc00 uarg=0000000000000000 20000000:01000000:2.0:1788460039.788493:0:13794:0:(mgs_llog.c:6198:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:2.0:1788460039.788499:0:13794:0:(mgs_llog.c:4653:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:2.0:1788460039.788504:0:13794:0:(mgs_llog.c:1385:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:1.0:1788460039.802872:0:13795:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:0.0:1788460039.807635:0:13794:0:(mgs_llog.c:4126:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:2.0:1788460039.809721:0:13794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:2.0:1788460039.809761:0:13794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:2.0:1788460039.809779:0:13794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:2.0:1788460039.809793:0:13794:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788460039.809814:0:13794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c4bc14f0200/0x5dfa74784542b100 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460039.809830:0:13794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bc14f0200/0x5dfa74784542b100 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460039.809853:0:13794:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c4bc14f0200/0x5dfa74784542b100 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460039.809860:0:13794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c4bc14f0200/0x5dfa74784542b100 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460039.809868:0:13794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c4bc14f0200/0x5dfa74784542b100 lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460039.809875:0:13794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c4bc14f0200/0x5dfa74784542b100 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460039.809882:0:13794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc14f0200 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:2.0:1788460039.809887:0:13794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c4bc14f0200/0x5dfa74784542b100 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460039.809895:0:13794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c4bc14f0200/0x5dfa74784542b100 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460039.809920:0:13794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c4bc14f0200/0x5dfa74784542b100 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460039.809928:0:13794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c4bc14f0200/0x5dfa74784542b100 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460039.809935:0:13794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4bc14f0200/0x5dfa74784542b100 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460039.953916:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788460040.081108:0:6530:0:(mgc_request.c:715:do_requeue()) updating log params 10000000:01000000:2.0:1788460040.081115:0:6530:0:(mgc_request.c:2266:mgc_process_log()) Process log params-ffff8c4bfc4e5800 from 7 10000000:01000000:2.0:1788460040.081120:0:6530:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788460040.081178:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0200/0x5dfa74784542b107 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460040.081190:0:6530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0200/0x5dfa74784542b107 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460040.081201:0:6530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0200/0x5dfa74784542b107 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460040.081224:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf7711c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022311808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788460040.081284:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460040.081352:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bfac3fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1788460040.081432:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022311808 00000100:00100000:3.0:1788460040.081440:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022311808 00000100:00100000:3.0:1788460040.081487:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:3.0:1788460040.081496:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf363e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+25:6530:x1875336022311808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788460040.081508:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460040.081521:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4ac2840a00/0x5dfa74784542b10e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542b107 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460040.081543:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4ac2840a00/0x5dfa74784542b10e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542b107 expref: 26 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460040.081553:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4ac2840a00/0x5dfa74784542b10e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542b107 expref: 26 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460040.081562:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ac2840a00, rc 0) 00000100:00100000:3.0:1788460040.081608:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf363e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+26:6530:x1875336022311808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460040.081615:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:2.0:1788460040.082242:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf7711c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022311808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788460040.082260:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0200/0x5dfa74784542b107 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542b10e expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460040.082269:0:6530:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0200/0x5dfa74784542b107 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542b10e expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788460040.082382:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 7 count 7 00000040:00080000:2.0:1788460040.082650:0:6530:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788460040.082822:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1788460040.082857:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:2.0:1788460040.082872:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:2.0:1788460040.082888:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:2.0:1788460040.082916:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:2.0:1788460040.082933:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:2.0:1788460040.082938:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 6 count 7 00000100:00100000:2.0:1788460040.083032:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf7711c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022311936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788460040.083076:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460040.083123:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bfac3fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788460040.083159:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022311936 00000100:00100000:1.0:1788460040.083166:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022311936 00000100:00100000:1.0:1788460040.083211:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:1.0:1788460040.083219:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf363e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+26:6530:x1875336022311936:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788460040.083326:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf363e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+26:6530:x1875336022311936:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 108us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460040.083334:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:2.0:1788460040.083457:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf7711c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022311936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788460040.083483:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf7711c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022312064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788460040.083520:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460040.083541:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bfac3fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788460040.083703:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022312064 00000100:00100000:0.0:1788460040.083708:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022312064 00000100:00100000:0.0:1788460040.083780:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:0.0:1788460040.083788:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf363c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+26:6530:x1875336022312064:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788460040.083887:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf363c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+26:6530:x1875336022312064:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 99us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460040.083893:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:2.0:1788460040.083979:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf7711c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022312064:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788460040.084302:0:6530:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788460040.084355:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf7711c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022312192:0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788460040.084393:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460040.091293:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bfac3fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788460040.092224:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022312192 00000100:00100000:1.0:1788460040.092234:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022312192 00000100:00100000:1.0:1788460040.092295:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:1.0:1788460040.092304:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf363d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+26:6530:x1875336022312192:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788460040.092465:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf363d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+26:6530:x1875336022312192:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 161us (8070us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460040.092473:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:2.0:1788460040.092658:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf7711c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022312192:0@lo:502:ll_cfg_requeue.0 00000040:00080000:2.0:1788460040.092915:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1788460040.092978:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:2.0:1788460040.092996:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:2.0:1788460040.093008:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:2.0:1788460040.093018:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:2.0:1788460040.093145:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:2.0:1788460040.093161:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:2.0:1788460040.093172:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:2.0:1788460040.093183:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:2.0:1788460040.093193:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:2.0:1788460040.093203:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:2.0:1788460040.093233:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf7711c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022312320:0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788460040.093276:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460040.093298:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bfac3fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788460040.093418:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022312320 00000100:00100000:1.0:1788460040.093428:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022312320 00000100:00100000:1.0:1788460040.093450:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:1.0:1788460040.093457:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf363e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+26:6530:x1875336022312320:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788460040.093533:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf363e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+26:6530:x1875336022312320:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 75us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460040.093540:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:2.0:1788460040.093744:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf7711c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022312320:0@lo:502:ll_cfg_requeue.0 00000040:00080000:2.0:1788460040.093783:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:2.0:1788460040.093795:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1788460040.096726:0:13807:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788460040.096737:0:13807:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788460040.096740:0:13807:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788460040.096746:0:13807:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8c4bfc4e5800 00000020:00000080:1.0:1788460040.096749:0:13807:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788460040.096893:0:13807:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788460040.096907:0:13807:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788460040.096909:0:13807:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788460040.096911:0:13807:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788460040.096914:0:13807:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788460040.096916:0:13807:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788460040.096919:0:13807:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8c4bfc4e5800 00000020:00000080:1.0:1788460040.096921:0:13807:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788460040.104338:0:13807:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788460040.104351:0:13807:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788460040.104353:0:13807:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788460040.104357:0:13807:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:2.0:1788460040.105495:0:6530:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1788460040.105513:0:6530:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788460040.105524:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0200/0x5dfa74784542b107 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542b10e expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460040.105536:0:6530:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0200/0x5dfa74784542b107 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542b10e expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788460040.105551:0:6530:0:(mgc_request.c:715:do_requeue()) updating log params 10000000:01000000:2.0:1788460040.105553:0:6530:0:(mgc_request.c:2266:mgc_process_log()) Process log params-ffff8c4bef21b800 from 7 10000000:01000000:2.0:1788460040.105555:0:6530:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788460040.105602:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0400/0x5dfa74784542b115 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460040.105611:0:6530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0400/0x5dfa74784542b115 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460040.105620:0:6530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0400/0x5dfa74784542b115 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460040.105646:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf7711c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022312448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788460040.105707:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460040.105741:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bfac3fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788460040.105812:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022312448 00000100:00100000:1.0:1788460040.106170:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022312448 00000100:00100000:1.0:1788460040.106219:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:1.0:1788460040.106229:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf363c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+26:6530:x1875336022312448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788460040.106242:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460040.106255:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4ac3676400/0x5dfa74784542b11c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542b115 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460040.106920:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4ac3676400/0x5dfa74784542b11c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542b115 expref: 27 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460040.106932:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4ac3676400/0x5dfa74784542b11c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542b115 expref: 27 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460040.106940:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ac3676400, rc 0) 00000100:00100000:1.0:1788460040.107202:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf363c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+27:6530:x1875336022312448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 974us (1494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460040.107210:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:2.0:1788460040.107519:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf7711c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022312448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788460040.107534:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0400/0x5dfa74784542b115 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542b11c expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460040.107542:0:6530:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0400/0x5dfa74784542b115 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542b11c expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788460040.108195:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 7 count 7 00000040:00080000:2.0:1788460040.109646:0:6530:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788460040.110249:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:2.0:1788460040.110295:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 112 off8528 00000040:00080000:2.0:1788460040.110311:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 224 off8752 00000040:00080000:2.0:1788460040.110325:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8976 00000040:00080000:2.0:1788460040.110339:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 112 off9088 00000040:00080000:2.0:1788460040.110357:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 224 off9312 00000040:00080000:2.0:1788460040.110362:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 6 count 7 00000100:00100000:2.0:1788460040.110456:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf7711c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022312576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788460040.110515:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460040.110575:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bfac3fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788460040.111376:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022312576 00000100:00100000:0.0:1788460040.111385:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022312576 00000100:00100000:0.0:1788460040.111446:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:0.0:1788460040.111455:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf363c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+27:6530:x1875336022312576:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788460040.111596:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf363c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+27:6530:x1875336022312576:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 141us (1081us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460040.111603:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:3.0:1788460040.111687:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf7711c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022312576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788460040.111726:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3b6dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022312704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788460040.111778:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460040.111813:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc2ab3600 going to sleep for 11 seconds 00000100:00100000:2.0:1788460040.111988:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022312704 00000100:00100000:2.0:1788460040.111995:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022312704 00000100:00100000:2.0:1788460040.112036:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:2.0:1788460040.112044:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd0a6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+27:6530:x1875336022312704:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788460040.112119:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd0a6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+27:6530:x1875336022312704:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 76us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460040.112126:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:3.0:1788460040.112388:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3b6dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022312704:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788460040.112764:0:6530:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788460040.113145:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3b6dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022312832:0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788460040.113197:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460040.113231:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac2558900 going to sleep for 11 seconds 00000100:00100000:2.0:1788460040.113304:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022312832 00000100:00100000:2.0:1788460040.113310:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022312832 00000100:00100000:2.0:1788460040.113346:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:2.0:1788460040.113354:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd0a6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+27:6530:x1875336022312832:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788460040.113453:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd0a6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+27:6530:x1875336022312832:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 100us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460040.113462:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:2.0:1788460040.119137:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3b6dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022312832:0@lo:502:ll_cfg_requeue.0 00000040:00080000:2.0:1788460040.119399:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:2.0:1788460040.119433:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 112 off8528 00000040:00080000:2.0:1788460040.119448:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 224 off8752 00000040:00080000:2.0:1788460040.119463:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8976 00000040:00080000:2.0:1788460040.119476:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 112 off9088 00000040:00080000:2.0:1788460040.119490:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 224 off9312 00000040:00080000:2.0:1788460040.119503:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 224 off9536 00000040:00080000:2.0:1788460040.119517:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 128 off9664 00000040:00080000:2.0:1788460040.119530:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:2.0:1788460040.119543:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 224 off10112 00000040:00080000:2.0:1788460040.119556:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 128 off10240 00000100:00100000:2.0:1788460040.119594:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf7710380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022312960:0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788460040.119661:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460040.119712:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bfac3ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1788460040.120206:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022312960 00000100:00100000:1.0:1788460040.120214:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022312960 00000100:00100000:1.0:1788460040.120261:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:1.0:1788460040.120270:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd0a6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+27:6530:x1875336022312960:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788460040.120385:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd0a6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+27:6530:x1875336022312960:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 116us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460040.120392:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:2.0:1788460040.120690:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf7710380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022312960:0@lo:502:ll_cfg_requeue.0 00000040:00080000:2.0:1788460040.120747:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10464 00000040:00080000:2.0:1788460040.120758:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1788460040.123205:0:13810:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788460040.123216:0:13810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788460040.123219:0:13810:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788460040.123228:0:13810:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8c4bef21b800 00000020:00000080:2.0:1788460040.123231:0:13810:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788460040.123434:0:13810:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788460040.123438:0:13810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788460040.123439:0:13810:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788460040.123442:0:13810:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788460040.123445:0:13810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788460040.123446:0:13810:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788460040.123450:0:13810:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8c4bef21b800 00000020:00000080:2.0:1788460040.123459:0:13810:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788460040.123486:0:13810:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788460040.123489:0:13810:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788460040.123490:0:13810:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788460040.123493:0:13810:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 13 count 13 00000020:01000000:1.0:1788460040.124253:0:6530:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1788460040.124280:0:6530:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788460040.124290:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0400/0x5dfa74784542b115 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542b11c expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460040.124302:0:6530:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0400/0x5dfa74784542b115 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542b11c expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788460040.124318:0:6530:0:(mgc_request.c:715:do_requeue()) updating log params 10000000:01000000:1.0:1788460040.124320:0:6530:0:(mgc_request.c:2266:mgc_process_log()) Process log params-ffff8c4bc438f000 from 7 10000000:01000000:1.0:1788460040.124331:0:6530:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788460040.124364:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677200/0x5dfa74784542b123 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460040.124373:0:6530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677200/0x5dfa74784542b123 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460040.124383:0:6530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677200/0x5dfa74784542b123 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460040.124406:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3a33480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022313088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788460040.124463:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460040.124506:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac28b40c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788460040.124721:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022313088 00000100:00100000:2.0:1788460040.124729:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022313088 00000100:00100000:2.0:1788460040.124777:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:2.0:1788460040.124787:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd0a6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+27:6530:x1875336022313088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788460040.124800:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460040.124812:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4bc14f0800/0x5dfa74784542b12a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542b123 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460040.126174:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bc14f0800/0x5dfa74784542b12a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542b123 expref: 28 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460040.126188:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4bc14f0800/0x5dfa74784542b12a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542b123 expref: 28 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460040.126197:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc14f0800, rc 0) 00000100:00100000:2.0:1788460040.126273:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd0a6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+28:6530:x1875336022313088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1488us (1809us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460040.126280:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:0.0:1788460040.126693:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3a33480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022313088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788460040.126712:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677200/0x5dfa74784542b123 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542b12a expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460040.126723:0:6530:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677200/0x5dfa74784542b123 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542b12a expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788460040.128935:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x18:0x0] index 7 count 7 00000040:00080000:0.0:1788460040.129532:0:6530:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788460040.129715:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].1, 224 off8416 00000040:00080000:0.0:1788460040.129742:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].2, 112 off8528 00000040:00080000:0.0:1788460040.129769:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].3, 224 off8752 00000040:00080000:0.0:1788460040.129783:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].4, 224 off8976 00000040:00080000:0.0:1788460040.129795:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].5, 112 off9088 00000040:00080000:0.0:1788460040.129812:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].6, 224 off9312 00000040:00080000:0.0:1788460040.130633:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x18:0x0] index 6 count 7 00000100:00100000:0.0:1788460040.130720:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4718a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022313216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788460040.130780:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460040.131846:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc4e73b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788460040.135412:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022313216 00000100:00100000:2.0:1788460040.135430:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022313216 00000100:00100000:2.0:1788460040.135540:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:2.0:1788460040.135551:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd0a6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+28:6530:x1875336022313216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788460040.135722:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd0a6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+28:6530:x1875336022313216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 173us (4940us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460040.135740:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:1.0:1788460040.135830:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4718a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022313216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788460040.135880:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3a31c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022313344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788460040.135982:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460040.137087:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac28b4480 going to sleep for 11 seconds 00000100:00100000:0.0:1788460040.137202:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022313344 00000100:00100000:0.0:1788460040.137210:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022313344 00000100:00100000:0.0:1788460040.137245:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:0.0:1788460040.137252:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd0a6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+28:6530:x1875336022313344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788460040.137484:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd0a6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+28:6530:x1875336022313344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 231us (1501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460040.137493:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000040:00080000:0.0:1788460040.138584:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788460040.141609:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3a31c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022313344:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788460040.143377:0:6530:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788460040.143468:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3a31c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022313472:0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788460040.143543:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460040.143810:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac28b4480 going to sleep for 11 seconds 00000100:00100000:3.0:1788460040.147378:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022313472 00000100:00100000:3.0:1788460040.147392:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022313472 00000100:00100000:3.0:1788460040.147450:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:3.0:1788460040.147459:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd0a6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+28:6530:x1875336022313472:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788460040.147619:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd0a6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+28:6530:x1875336022313472:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 161us (4076us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460040.147628:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:1.0:1788460040.147768:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3a31c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022313472:0@lo:502:ll_cfg_requeue.0 00000040:00080000:1.0:1788460040.149285:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].1, 224 off8416 00000040:00080000:1.0:1788460040.149326:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].2, 112 off8528 00000040:00080000:1.0:1788460040.149343:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].3, 224 off8752 00000040:00080000:1.0:1788460040.149358:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].4, 224 off8976 00000040:00080000:1.0:1788460040.149383:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].5, 112 off9088 00000040:00080000:1.0:1788460040.149398:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].6, 224 off9312 00000040:00080000:1.0:1788460040.149411:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].7, 224 off9536 00000040:00080000:1.0:1788460040.149425:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].8, 128 off9664 00000040:00080000:1.0:1788460040.149438:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].9, 224 off9888 00000040:00080000:1.0:1788460040.149450:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].10, 224 off10112 00000040:00080000:1.0:1788460040.149463:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].11, 128 off10240 00000100:00100000:1.0:1788460040.149502:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3a31c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022313600:0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788460040.149565:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460040.149603:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac28b4480 going to sleep for 11 seconds 00000100:00100000:3.0:1788460040.149788:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022313600 00000100:00100000:3.0:1788460040.149795:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022313600 00000100:00100000:3.0:1788460040.149848:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:3.0:1788460040.149856:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd0a6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+28:6530:x1875336022313600:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788460040.150190:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd0a6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+28:6530:x1875336022313600:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 334us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460040.150198:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:1.0:1788460040.151290:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3a31c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022313600:0@lo:502:ll_cfg_requeue.0 00000040:00080000:1.0:1788460040.151367:0:6530:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].12, 224 off10464 00000040:00080000:1.0:1788460040.151378:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1788460040.153337:0:13813:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788460040.153348:0:13813:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788460040.153350:0:13813:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788460040.153358:0:13813:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8c4bc438f000 00000020:00000080:3.0:1788460040.153360:0:13813:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788460040.153425:0:13813:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788460040.153428:0:13813:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788460040.153430:0:13813:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788460040.153432:0:13813:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788460040.153435:0:13813:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788460040.153436:0:13813:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788460040.153439:0:13813:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8c4bc438f000 00000020:00000080:3.0:1788460040.153441:0:13813:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788460040.153464:0:13813:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788460040.153468:0:13813:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788460040.153469:0:13813:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788460040.153472:0:13813:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1a:0x0] index 13 count 13 00000020:01000000:1.0:1788460040.154225:0:6530:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1788460040.154240:0:6530:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788460040.154250:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677200/0x5dfa74784542b123 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542b12a expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460040.154262:0:6530:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677200/0x5dfa74784542b123 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542b12a expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788460040.154274:0:6530:0:(mgc_request.c:715:do_requeue()) updating log params 10000000:01000000:1.0:1788460040.154276:0:6530:0:(mgc_request.c:2266:mgc_process_log()) Process log params-ffff8c4be2d81000 from 7 10000000:01000000:1.0:1788460040.154278:0:6530:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788460040.154312:0:6530:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac3676600/0x5dfa74784542b131 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460040.154321:0:6530:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4ac3676600/0x5dfa74784542b131 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460040.154332:0:6530:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4ac3676600/0x5dfa74784542b131 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460040.154363:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3a31c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022313728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788460040.154422:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460040.154464:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac28b4480 going to sleep for 11 seconds 00000100:00100000:3.0:1788460040.154528:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022313728 00000100:00100000:3.0:1788460040.154537:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022313728 00000100:00100000:3.0:1788460040.154584:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1788460040.154594:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd0a6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+28:6530:x1875336022313728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788460040.154606:0:6528:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460040.154619:0:6528:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4ac2841e00/0x5dfa74784542b138 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542b131 expref: -99 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460040.154641:0:6528:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4ac2841e00/0x5dfa74784542b138 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542b131 expref: 29 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460040.154652:0:6528:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4ac2841e00/0x5dfa74784542b138 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542b131 expref: 29 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460040.154659:0:6528:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ac2841e00, rc 0) 00000100:00100000:3.0:1788460040.154699:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd0a6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+29:6530:x1875336022313728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460040.154706:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:1.0:1788460040.154937:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3a31c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022313728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788460040.155128:0:6530:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4ac3676600/0x5dfa74784542b131 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542b138 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460040.155139:0:6530:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4ac3676600/0x5dfa74784542b131 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542b138 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460040.155178:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3a31c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022313856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788460040.155208:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460040.155227:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac28b4480 going to sleep for 11 seconds 00000100:00100000:0.0:1788460040.156349:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022313856 00000100:00100000:0.0:1788460040.156358:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022313856 00000100:00100000:0.0:1788460040.156404:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:0.0:1788460040.156415:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd0a6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+29:6530:x1875336022313856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788460040.156545:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd0a6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+29:6530:x1875336022313856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 132us (1336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460040.156552:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:1.0:1788460040.156644:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3a31c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022313856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788460040.156681:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3a31c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022313984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788460040.156724:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460040.156758:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac28b4480 going to sleep for 11 seconds 00000100:00100000:3.0:1788460040.156795:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022313984 00000100:00100000:3.0:1788460040.156806:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022313984 00000100:00100000:3.0:1788460040.156848:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:3.0:1788460040.156855:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd0a6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+29:6530:x1875336022313984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788460040.156938:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd0a6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+29:6530:x1875336022313984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 84us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460040.157159:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3a31c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0cf73fe6-82e2-434e-b670-631647721b2c:6530:1875336022313984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788460040.157341:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:1.0:1788460040.160491:0:13814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3a31c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0cf73fe6-82e2-434e-b670-631647721b2c:13814:1875336022314112:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788460040.160563:0:13814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460040.160609:0:13814:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac28b49c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788460040.160658:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022314112 00000100:00100000:2.0:1788460040.160665:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022314112 00000100:00100000:2.0:1788460040.160744:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:2.0:1788460040.160754:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd0a6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+29:13814:x1875336022314112:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788460040.160884:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd0a6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+29:13814:x1875336022314112:12345-0@lo:502:llog_process_th.0 Request processed in 132us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460040.160892:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000040:00080000:3.0:1788460040.163451:0:13815:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788460040.163748:0:13814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3a31c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0cf73fe6-82e2-434e-b670-631647721b2c:13814:1875336022314112:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788460040.163792:0:13814:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788460040.163811:0:13814:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788460040.163814:0:13814:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788460040.163833:0:13814:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8c4be2d81000 00000020:00000080:1.0:1788460040.163836:0:13814:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788460040.163907:0:13814:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788460040.163911:0:13814:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788460040.163913:0:13814:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788460040.163915:0:13814:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788460040.163918:0:13814:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788460040.163919:0:13814:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788460040.163923:0:13814:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8c4be2d81000 00000020:00000080:1.0:1788460040.163925:0:13814:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788460040.163993:0:13814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3a31c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0cf73fe6-82e2-434e-b670-631647721b2c:13814:1875336022314240:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788460040.164071:0:13814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460040.171570:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022314240 00000100:00100000:0.0:1788460040.171581:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022314240 00000100:00100000:0.0:1788460040.171626:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:0.0:1788460040.171634:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+29:13814:x1875336022314240:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788460040.171769:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+29:13814:x1875336022314240:12345-0@lo:502:llog_process_th.0 Request processed in 135us (7697us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460040.171783:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:1.0:1788460040.175939:0:13814:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac28b49c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788460040.176785:0:13814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3a31c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0cf73fe6-82e2-434e-b670-631647721b2c:13814:1875336022314240:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788460040.176837:0:13814:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788460040.176845:0:13814:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788460040.176847:0:13814:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788460040.176852:0:13814:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1788460040.178990:0:6530:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1788460040.179008:0:6530:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788460040.179020:0:6530:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac3676600/0x5dfa74784542b131 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542b138 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460040.179168:0:6530:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4ac3676600/0x5dfa74784542b131 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542b138 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460040.584251:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460040.584342:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003348736 00000100:00100000:3.0:1788460040.584351:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003348736 00000100:00100000:3.0:1788460040.584455:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 397 00000100:00100000:3.0:1788460040.584464:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bed032f6-c389-485e-b2f7-e2ea34763c65+12:6163:x1875336003348736:12345-192.168.206.5@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788460040.584480:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460040.584497:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4ac2840600/0x5dfa74784542b13f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a5dc expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460040.584525:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4ac2840600/0x5dfa74784542b13f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a5dc expref: 13 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460040.584536:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4ac2840600/0x5dfa74784542b13f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a5dc expref: 13 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460040.584544:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ac2840600, rc 0) 00000100:00100000:3.0:1788460040.584598:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bed032f6-c389-485e-b2f7-e2ea34763c65+13:6163:x1875336003348736:12345-192.168.206.5@tcp:101:ll_cfg_requeue.0 Request processed in 135us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460040.584605:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 397 00000100:00100000:0.0:1788460040.590753:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460040.590862:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003348864 00000100:00100000:2.0:1788460040.590872:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003348864 00000100:00100000:2.0:1788460040.590936:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 398 00000100:00100000:2.0:1788460040.590966:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd0a6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bed032f6-c389-485e-b2f7-e2ea34763c65+13:6163:x1875336003348864:12345-192.168.206.5@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788460040.591529:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd0a6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bed032f6-c389-485e-b2f7-e2ea34763c65+13:6163:x1875336003348864:12345-192.168.206.5@tcp:501:ll_cfg_requeue.0 Request processed in 583us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460040.591538:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 398 00000100:00100000:0.0:1788460040.600416:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460040.600685:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003348992 00000100:00100000:3.0:1788460040.600696:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003348992 00000100:00100000:3.0:1788460040.600739:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 399 00000100:00100000:3.0:1788460040.600761:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bed032f6-c389-485e-b2f7-e2ea34763c65+13:6163:x1875336003348992:12345-192.168.206.5@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788460040.600911:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bed032f6-c389-485e-b2f7-e2ea34763c65+13:6163:x1875336003348992:12345-192.168.206.5@tcp:503:ll_cfg_requeue.0 Request processed in 151us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460040.600918:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 399 00000100:00100000:2.0:1788460040.606431:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460040.606547:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003349120 00000100:00100000:3.0:1788460040.606563:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003349120 00000100:00100000:3.0:1788460040.606620:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 400 00000100:00100000:3.0:1788460040.606630:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bed032f6-c389-485e-b2f7-e2ea34763c65+13:10764:x1875336003349120:12345-192.168.206.5@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788460040.606774:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bed032f6-c389-485e-b2f7-e2ea34763c65+13:10764:x1875336003349120:12345-192.168.206.5@tcp:502:llog_process_th.0 Request processed in 144us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460040.606782:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 400 00000100:00100000:0.0:1788460040.616997:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460040.617079:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003349248 00000100:00100000:1.0:1788460040.617099:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003349248 00000100:00100000:1.0:1788460040.617159:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 401 00000100:00100000:1.0:1788460040.617169:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bed032f6-c389-485e-b2f7-e2ea34763c65+13:10764:x1875336003349248:12345-192.168.206.5@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788460040.617323:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bed032f6-c389-485e-b2f7-e2ea34763c65+13:10764:x1875336003349248:12345-192.168.206.5@tcp:502:llog_process_th.0 Request processed in 155us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460040.617331:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 401 00000100:00100000:1.0:1788460040.623577:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460040.623828:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003349376 00000100:00100000:0.0:1788460040.623844:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003349376 00000100:00100000:0.0:1788460040.623913:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 402 00000100:00100000:0.0:1788460040.623924:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bed032f6-c389-485e-b2f7-e2ea34763c65+13:6163:x1875336003349376:12345-192.168.206.5@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788460040.623939:0:6526:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460040.623994:0:6526:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4bc29d0200/0x5dfa74784542b146 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a5e3 expref: -99 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460040.624019:0:6526:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bc29d0200/0x5dfa74784542b146 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a5e3 expref: 14 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460040.624030:0:6526:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4bc29d0200/0x5dfa74784542b146 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a5e3 expref: 14 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460040.624038:0:6526:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc29d0200, rc 0) 00000100:00100000:0.0:1788460040.624098:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bed032f6-c389-485e-b2f7-e2ea34763c65+14:6163:x1875336003349376:12345-192.168.206.5@tcp:101:ll_cfg_requeue.0 Request processed in 176us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460040.624105:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 402 00000100:00100000:2.0:1788460040.629675:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460040.629865:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003349504 00000100:00100000:3.0:1788460040.629885:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003349504 00000100:00100000:3.0:1788460040.629981:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 403 00000100:00100000:3.0:1788460040.629991:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bed032f6-c389-485e-b2f7-e2ea34763c65+14:6163:x1875336003349504:12345-192.168.206.5@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788460040.630138:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bed032f6-c389-485e-b2f7-e2ea34763c65+14:6163:x1875336003349504:12345-192.168.206.5@tcp:501:ll_cfg_requeue.0 Request processed in 148us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460040.630145:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 403 00000100:00100000:2.0:1788460040.635076:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460040.635226:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003349632 00000100:00100000:0.0:1788460040.635236:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003349632 00000100:00100000:0.0:1788460040.635290:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 404 00000100:00100000:0.0:1788460040.635299:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bed032f6-c389-485e-b2f7-e2ea34763c65+14:6163:x1875336003349632:12345-192.168.206.5@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788460040.635434:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bed032f6-c389-485e-b2f7-e2ea34763c65+14:6163:x1875336003349632:12345-192.168.206.5@tcp:503:ll_cfg_requeue.0 Request processed in 135us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460040.635451:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 404 00000100:00100000:0.0:1788460040.647395:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460040.647742:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003349760 00000100:00100000:1.0:1788460040.647768:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003349760 00000100:00100000:1.0:1788460040.647832:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 405 00000100:00100000:1.0:1788460040.647842:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bed032f6-c389-485e-b2f7-e2ea34763c65+14:10767:x1875336003349760:12345-192.168.206.5@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788460040.648031:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bed032f6-c389-485e-b2f7-e2ea34763c65+14:10767:x1875336003349760:12345-192.168.206.5@tcp:502:llog_process_th.0 Request processed in 189us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460040.648040:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 405 00000100:00100000:2.0:1788460040.653857:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460040.654038:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003349888 00000100:00100000:3.0:1788460040.654049:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003349888 00000100:00100000:3.0:1788460040.654103:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 406 00000100:00100000:3.0:1788460040.654112:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bed032f6-c389-485e-b2f7-e2ea34763c65+14:10767:x1875336003349888:12345-192.168.206.5@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788460040.654253:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bed032f6-c389-485e-b2f7-e2ea34763c65+14:10767:x1875336003349888:12345-192.168.206.5@tcp:502:llog_process_th.0 Request processed in 141us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460040.654272:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 406 00010000:00010000:1.0:1788460040.977129:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788460041.169765:0:13815:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1788460041.169880:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788460041.810397:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788460041.810427:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3a31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022314368:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788460041.810499:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460041.810582:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022314368 00000100:00100000:1.0:1788460041.810590:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022314368 00000100:00100000:1.0:1788460041.810647:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788460041.810661:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3b6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3660:x1875336022314368:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788460041.810688:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1788460041.810689:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788460041.810745:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3b6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3660:x1875336022314368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460041.810752:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788460041.810783:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3a31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022314368:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788460042.003396:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788460042.322810:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788460042.322832:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4719f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022314624:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788460042.322919:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460042.323201:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022314624 00000100:00100000:1.0:1788460042.323209:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022314624 00000100:00100000:1.0:1788460042.323262:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788460042.323285:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc4719500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022314624:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788460042.323316:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788460042.323363:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc4719500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022314624:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460042.323370:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788460042.323391:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788460042.323619:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf7710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022314496:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788460042.323651:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460042.323698:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022314496 00000100:00100000:1.0:1788460042.323702:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022314496 00000100:00100000:1.0:1788460042.323737:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788460042.323744:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3a33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022314496:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788460042.323759:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788460042.323792:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3a33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022314496:12345-0@lo:13:osp-pre-0-1.0 Request processed in 49us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460042.323798:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788460042.323835:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf7710380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022314496:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788460042.326657:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788460042.326717:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4719f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022314624:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788460043.025514:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788460043.345301:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3a32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022314752:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788460043.345370:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460043.345561:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022314752 00000100:00100000:1.0:1788460043.345569:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022314752 00000100:00100000:1.0:1788460043.345620:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788460043.345629:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc4719f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1875336022314752:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788460043.345659:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446453248 avail 1300213760 00000100:00100000:1.0:1788460043.345716:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc4719f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1875336022314752:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460043.345723:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788460043.345814:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3a32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022314752:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788460043.858143:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3b5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022315136:0@lo:400:kworker.0 00000100:00100000:0.0:1788460043.858222:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460043.858486:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022315136 00000100:00100000:2.0:1788460043.858494:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022315136 00000100:00100000:2.0:1788460043.858538:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788460043.858546:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3839880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022315136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460043.858596:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3839880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022315136:12345-0@lo:400:kworker.0 Request processed in 50us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460043.858603:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788460043.858861:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc471b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0cf73fe6-82e2-434e-b670-631647721b2c:3659:1875336022314880:0@lo:400:kworker.0 00000100:00100000:1.0:1788460043.858908:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460043.858965:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf76ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1875336022315392:0@lo:400:kworker.0 00000100:00100000:1.0:1788460043.859003:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460043.859021:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac383ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1875336022315904:0@lo:400:kworker.0 00000100:00100000:1.0:1788460043.859039:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460043.859058:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788460043.859063:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4718a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1875336022315008:0@lo:400:kworker.0 00000100:00100000:1.0:1788460043.859090:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460043.859105:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf76eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1875336022315520:0@lo:400:kworker.0 00000100:00100000:1.0:1788460043.859121:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460043.859134:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3839180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1875336022316032:0@lo:400:kworker.0 00000100:00100000:1.0:1788460043.859149:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460043.859173:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022315392 00000100:00100000:1.0:1788460043.859176:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022315392 00000100:00100000:1.0:1788460043.859227:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022315904 00000100:00100000:1.0:1788460043.859231:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022315904 00000100:00100000:1.0:1788460043.859243:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022315008 00000100:00100000:1.0:1788460043.859245:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022315008 00000100:00100000:1.0:1788460043.859254:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022315520 00000100:00100000:1.0:1788460043.859256:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022315520 00000100:00100000:1.0:1788460043.859264:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022316032 00000100:00100000:1.0:1788460043.859266:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022316032 00000100:00100000:1.0:1788460043.859499:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1788460043.859507:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3a31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1875336022315392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460043.859549:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3a31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1875336022315392:12345-0@lo:400:kworker.0 Request processed in 43us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460043.859555:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1788460043.859569:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1788460043.859574:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3a33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1875336022315904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460043.859599:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3a33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1875336022315904:12345-0@lo:400:kworker.0 Request processed in 25us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460043.859604:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1788460043.859615:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1788460043.859619:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3a32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1875336022315008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460043.859655:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3a32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1875336022315008:12345-0@lo:400:kworker.0 Request processed in 35us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460043.859661:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1788460043.859673:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1788460043.859678:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3a31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1875336022315520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460043.859702:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3a31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1875336022315520:12345-0@lo:400:kworker.0 Request processed in 24us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460043.859708:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1788460043.859718:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1788460043.859723:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3a33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1875336022316032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460043.859747:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3a33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1875336022316032:12345-0@lo:400:kworker.0 Request processed in 24us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460043.859753:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00080000:1.0:1788460043.859779:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788460043.859783:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788460043.859810:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4718a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1875336022315008:0@lo:400:kworker.0 00010000:00080000:1.0:1788460043.859825:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bf76eca80 x1875336022315520/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460059 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460043.859835:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf76eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1875336022315520:0@lo:400:kworker.0 00010000:00080000:1.0:1788460043.859844:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3839180 x1875336022316032/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460059 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460043.859853:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3839180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1875336022316032:0@lo:400:kworker.0 00000100:00100000:1.0:1788460043.859862:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf76ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1875336022315392:0@lo:400:kworker.0 00000100:00100000:1.0:1788460043.859894:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac383ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1875336022315904:0@lo:400:kworker.0 00000100:00100000:0.0:1788460043.860091:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf76ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022315648:0@lo:400:kworker.0 00000100:00100000:0.0:1788460043.860123:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460043.860153:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac383b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022316160:0@lo:400:kworker.0 00000100:00100000:0.0:1788460043.860174:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460043.860527:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022315648 00000100:00100000:1.0:1788460043.860532:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022315648 00000100:00100000:1.0:1788460043.860562:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022316160 00000100:00100000:1.0:1788460043.860565:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022316160 00000100:00100000:1.0:1788460043.860591:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788460043.860596:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3838700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022315648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460043.860634:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3838700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022315648:12345-0@lo:400:kworker.0 Request processed in 38us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460043.860640:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788460043.860651:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788460043.860657:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac383aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022316160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460043.860700:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac383aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022316160:12345-0@lo:400:kworker.0 Request processed in 43us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460043.860706:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:1.0:1788460043.860725:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788460043.860970:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac383b800 x1875336022316160/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788460059 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460043.860992:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac383b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022316160:0@lo:400:kworker.0 00000100:00100000:0.0:1788460043.861015:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3b5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022315136:0@lo:400:kworker.0 00000100:00100000:0.0:1788460043.861023:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf76ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022315648:0@lo:400:kworker.0 00000100:00100000:0.0:1788460043.861034:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788460043.861040:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf76ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875336022315264:0@lo:400:kworker.0 00000100:00100000:0.0:1788460043.861064:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460043.861080:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf76edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022315776:0@lo:400:kworker.0 00000100:00100000:0.0:1788460043.861101:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460043.861119:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3838380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022316288:0@lo:400:kworker.0 00000100:00100000:0.0:1788460043.861137:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460043.861160:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022315776 00000100:00100000:0.0:1788460043.861163:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022315776 00000100:00100000:2.0:1788460043.861338:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022316288 00000100:00100000:2.0:1788460043.861343:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022316288 00000100:00100000:2.0:1788460043.861369:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788460043.861375:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3838e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1875336022316288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460043.861415:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3838e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1875336022316288:12345-0@lo:400:kworker.0 Request processed in 40us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460043.861421:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788460043.861440:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022314880 00000100:00100000:2.0:1788460043.861444:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022314880 00000100:00100000:2.0:1788460043.861465:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 407 00000100:00100000:2.0:1788460043.861470:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+29:3659:x1875336022314880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460043.861501:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+29:3659:x1875336022314880:12345-0@lo:400:kworker.0 Request processed in 31us (2592us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460043.861507:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 407 00000100:00100000:2.0:1788460043.861544:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc471b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0cf73fe6-82e2-434e-b670-631647721b2c:3659:1875336022314880:0@lo:400:kworker.0 00000100:00080000:2.0:1788460043.861566:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788460043.861568:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788460043.862125:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788460043.862136:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfaf6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3661:x1875336022315776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460043.862175:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfaf6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3661:x1875336022315776:12345-0@lo:400:kworker.0 Request processed in 43us (1073us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460043.862359:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788460043.862528:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf76edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022315776:0@lo:400:kworker.0 00010000:00080000:0.0:1788460043.862541:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3838380 x1875336022316288/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788460059 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460043.862568:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3838380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022316288:0@lo:400:kworker.0 00000100:00100000:1.0:1788460043.862637:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022315264 00000100:00100000:1.0:1788460043.862642:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022315264 00000100:00100000:1.0:1788460043.862678:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1788460043.862685:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac383b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1875336022315264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460043.862739:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac383b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1875336022315264:12345-0@lo:400:kworker.0 Request processed in 55us (1674us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460043.862746:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1788460043.863154:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788460043.863166:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3b6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022316416:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788460043.863223:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460043.863311:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022316416 00000100:00100000:3.0:1788460043.863316:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022316416 00000100:00100000:3.0:1788460043.863344:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788460043.863351:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3b6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022316416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788460043.863372:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788460043.863409:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3b6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022316416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460043.863416:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00010000:00080000:3.0:1788460043.863444:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3b6c700 x1875336022316416/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460059 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460043.863459:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3b6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022316416:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788460043.864399:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf76ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875336022315264:0@lo:400:kworker.0 00000100:00100000:3.0:1788460043.866778:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788460043.866800:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3a30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022316544:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788460043.866864:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460043.869134:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022316544 00000100:00100000:1.0:1788460043.869146:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022316544 00000100:00100000:1.0:1788460043.869226:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788460043.869236:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3b6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022316544:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788460043.869274:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788460043.869356:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3b6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022316544:12345-0@lo:13:osp-pre-1-1.0 Request processed in 122us (2491us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460043.869363:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00080000:0.0:1788460043.869468:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3a30700 x1875336022316544/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460059 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460043.869487:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3a30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022316544:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788460044.051463:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788460044.229057:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460044.229165:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003350016 00000100:00100000:1.0:1788460044.229176:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003350016 00000100:00100000:1.0:1788460044.229238:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 408 00000100:00100000:1.0:1788460044.229248:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bed032f6-c389-485e-b2f7-e2ea34763c65+14:2394:x1875336003350016:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:1.0:1788460044.229335:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bed032f6-c389-485e-b2f7-e2ea34763c65+14:2394:x1875336003350016:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 88us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460044.229343:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 408 00000100:00100000:0.0:1788460044.231679:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460044.231768:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003350144 00000100:00100000:1.0:1788460044.231778:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003350144 00000100:00100000:1.0:1788460044.231866:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 220 00000100:00100000:1.0:1788460044.232349:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3838380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2394:x1875336003350144:12345-192.168.206.5@tcp:400:kworker.0 00000100:00080000:2.0:1788460044.232542:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788460044.232858:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3838380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2394:x1875336003350144:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 512us (1184us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460044.234352:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 220 00000100:00100000:3.0:1788460044.236439:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460044.236547:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003350400 00000100:00100000:2.0:1788460044.236556:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003350400 00000100:00100000:2.0:1788460044.236630:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 90 00000100:00100000:2.0:1788460044.236643:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3b6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2393:x1875336003350400:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:2.0:1788460044.236717:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3b6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2393:x1875336003350400:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 78us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460044.236733:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 90 00000100:00080000:1.0:1788460044.238063:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788460044.243660:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460044.243691:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460044.243719:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460044.243782:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003350656 00000100:00100000:3.0:1788460044.243790:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003350656 00000100:00100000:3.0:1788460044.243850:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003350272 00000100:00100000:3.0:1788460044.243853:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003350272 00000100:00100000:3.0:1788460044.243887:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003350528 00000100:00100000:3.0:1788460044.243890:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003350528 00000100:00100000:3.0:1788460044.243906:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 221 00000100:00100000:3.0:1788460044.243914:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf7710a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a5915a6d-4114-41fb-8d95-33add86e0720+5:2393:x1875336003350656:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:3.0:1788460044.243997:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf7710a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a5915a6d-4114-41fb-8d95-33add86e0720+5:2393:x1875336003350656:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 84us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460044.244013:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 221 00000100:00100000:3.0:1788460044.244028:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 222 00000100:00100000:3.0:1788460044.244034:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf7710000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2394:x1875336003350272:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:3.0:1788460044.244054:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf7710000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2394:x1875336003350272:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 20us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460044.244059:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 222 00000100:00100000:3.0:1788460044.244068:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 223 00000100:00100000:3.0:1788460044.244073:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf7713b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a5915a6d-4114-41fb-8d95-33add86e0720+5:2394:x1875336003350528:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:3.0:1788460044.244089:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf7713b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a5915a6d-4114-41fb-8d95-33add86e0720+5:2394:x1875336003350528:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 16us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460044.244095:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 223 00000100:00080000:2.0:1788460044.244768:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788460044.244773:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00080000:0.0:1788460044.900384:0:8443:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00010000:00010000:1.0:1788460045.073262:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460046.098454:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788460046.929343:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3a32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022316672:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788460046.929412:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460046.930271:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022316672 00000100:00100000:3.0:1788460046.930280:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022316672 00000100:00100000:3.0:1788460046.930346:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788460046.930356:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf7713800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1875336022316672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788460046.930384:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00080000:1.0:1788460046.930480:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788460046.932555:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf7713800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1875336022316672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2193us (3134us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460046.932569:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788460046.936114:0:3661:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:2.0:1788460046.936126:0:3661:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8c4bfa1e2d80, transno 4294967301 00000100:00100000:2.0:1788460046.936161:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3a32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022316672:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788460047.121234:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460047.441198:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3839f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022316800:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788460047.441276:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460047.441459:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022316800 00000100:00100000:1.0:1788460047.441466:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022316800 00000100:00100000:1.0:1788460047.441517:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788460047.441525:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3b6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022316800:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788460047.441567:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788460047.441619:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3b6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022316800:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460047.441626:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788460047.441911:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3b6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022316928:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788460047.441973:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460047.442055:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022316928 00000100:00100000:3.0:1788460047.442060:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022316928 00000100:00100000:3.0:1788460047.442109:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788460047.442118:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3838700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022316928:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788460047.442134:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788460047.442183:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3838700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022316928:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460047.442190:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:0.0:1788460047.442251:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788460047.442412:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3839f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022316800:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788460047.442561:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3b6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022316928:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788460048.145160:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788460048.466293:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3a31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022317056:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788460048.466370:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460048.466549:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022317056 00000100:00100000:1.0:1788460048.466557:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022317056 00000100:00100000:1.0:1788460048.466613:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788460048.466622:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac383aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022317056:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788460048.466652:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446453248 avail 1300213760 00000100:00100000:1.0:1788460048.466707:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac383aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022317056:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460048.466714:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788460048.466809:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3a31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022317056:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788460048.977923:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788460048.977961:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3b6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022317184:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788460048.978032:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460048.978427:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3b6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0cf73fe6-82e2-434e-b670-631647721b2c:3659:1875336022317440:0@lo:400:kworker.0 00000100:00100000:1.0:1788460048.978477:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460048.978509:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022317952:0@lo:400:kworker.0 00000100:00100000:1.0:1788460048.978537:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460048.978557:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfae8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022318464:0@lo:400:kworker.0 00000100:00100000:1.0:1788460048.978600:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460048.978620:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788460048.978627:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3999f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1875336022317568:0@lo:400:kworker.0 00000100:00100000:1.0:1788460048.978652:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460048.978667:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3afaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1875336022318080:0@lo:400:kworker.0 00000100:00100000:1.0:1788460048.978694:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460048.978719:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfae8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1875336022318592:0@lo:400:kworker.0 00000100:00100000:1.0:1788460048.978742:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460048.979032:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022317696:0@lo:400:kworker.0 00000100:00100000:2.0:1788460048.979064:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460048.979111:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3a30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022317312:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788460048.979136:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460048.979157:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3afb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3662:1875336022317824:0@lo:400:kworker.0 00000100:00100000:0.0:1788460048.979178:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460048.979195:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3afa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022318336:0@lo:400:kworker.0 00000100:00100000:0.0:1788460048.979216:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460048.979233:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4138000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022318848:0@lo:400:kworker.0 00000100:00100000:0.0:1788460048.979251:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460048.979359:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022317952 00000100:00100000:1.0:1788460048.979367:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022317952 00000100:00100000:1.0:1788460048.979414:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788460048.979423:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3a31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022317952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460048.979475:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3a31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022317952:12345-0@lo:400:kworker.0 Request processed in 54us (937us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460048.979481:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788460048.979533:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022317184 00000100:00100000:0.0:1788460048.979545:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022317184 00000100:00100000:0.0:1788460048.979576:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022317312 00000100:00100000:0.0:1788460048.979595:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022317312 00000100:00100000:0.0:1788460048.979612:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788460048.979618:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3839f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875336022317184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788460048.979638:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788460048.979675:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3839f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875336022317184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 57us (1644us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460048.979680:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788460048.979693:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788460048.979698:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac383ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022317312:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788460048.979707:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788460048.979731:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac383ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022317312:12345-0@lo:13:osp-pre-1-1.0 Request processed in 33us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460048.979736:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788460048.979753:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022317568 00000100:00100000:0.0:1788460048.979756:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022317568 00000100:00100000:0.0:1788460048.980753:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022318080 00000100:00100000:0.0:1788460048.980763:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022318080 00000100:00100000:0.0:1788460048.980800:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022318592 00000100:00100000:0.0:1788460048.980803:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022318592 00000100:00100000:0.0:1788460048.980817:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022317824 00000100:00100000:0.0:1788460048.980820:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022317824 00000100:00100000:0.0:1788460048.980835:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1788460048.980842:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3a30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1875336022317568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460048.980911:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3a30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1875336022317568:12345-0@lo:400:kworker.0 Request processed in 69us (2258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460048.980918:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1788460048.980959:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1788460048.980966:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf76ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1875336022318080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460048.980997:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf76ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1875336022318080:12345-0@lo:400:kworker.0 Request processed in 33us (2302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460048.981004:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1788460048.981016:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1788460048.981021:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf76edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1875336022318592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460048.981049:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf76edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1875336022318592:12345-0@lo:400:kworker.0 Request processed in 28us (2307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460048.981054:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1788460048.981064:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1788460048.981070:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3839180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1875336022317824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460048.981097:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3839180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1875336022317824:12345-0@lo:400:kworker.0 Request processed in 27us (1918us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460048.981103:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1788460048.981124:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022318464 00000100:00100000:0.0:1788460048.981128:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022318464 00000100:00100000:0.0:1788460048.981153:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022318336 00000100:00100000:0.0:1788460048.981156:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022318336 00000100:00100000:0.0:1788460048.981165:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022318848 00000100:00100000:0.0:1788460048.981167:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022318848 00000100:00100000:0.0:1788460048.981182:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788460048.981186:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3a32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022318464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460048.981216:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3a32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022318464:12345-0@lo:400:kworker.0 Request processed in 29us (2616us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460048.981222:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788460048.981232:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788460048.981246:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc43f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022318336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460048.981572:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022317440 00000100:00100000:3.0:1788460048.981577:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022317440 00000100:00100000:3.0:1788460048.981623:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 409 00000100:00100000:3.0:1788460048.981630:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+29:3659:x1875336022317440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460048.982500:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+29:3659:x1875336022317440:12345-0@lo:400:kworker.0 Request processed in 867us (4031us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460048.982509:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 409 00000100:00100000:3.0:1788460048.982584:0:8832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788460048.982965:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc43f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022318336:12345-0@lo:400:kworker.0 Request processed in 1718us (3746us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460048.982973:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:0.0:1788460048.982999:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788460048.983004:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788460048.983007:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788460048.983042:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3a30380 x1875336022317312/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460064 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460048.983063:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3a30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022317312:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788460048.983077:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3afb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3662:1875336022317824:0@lo:400:kworker.0 00000100:00100000:0.0:1788460048.983088:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3afa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022318336:0@lo:400:kworker.0 00010000:00080000:0.0:1788460048.983100:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3b6dc00 x1875336022317184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460064 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460048.983112:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3b6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022317184:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788460048.983161:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022317696 00000100:00100000:0.0:1788460048.983166:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022317696 00000100:00100000:0.0:1788460048.983192:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788460048.983198:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf7712300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022317696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460048.983241:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf7712300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022317696:12345-0@lo:400:kworker.0 Request processed in 43us (4176us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460048.983246:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788460048.983290:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3999f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1875336022317568:0@lo:400:kworker.0 00000100:00100000:0.0:1788460048.983301:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3afaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1875336022318080:0@lo:400:kworker.0 00000100:00100000:0.0:1788460048.983326:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfae8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1875336022318592:0@lo:400:kworker.0 00000100:00100000:0.0:1788460048.983333:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3b6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0cf73fe6-82e2-434e-b670-631647721b2c:3659:1875336022317440:0@lo:400:kworker.0 00000100:00100000:0.0:1788460048.983343:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022317952:0@lo:400:kworker.0 00000100:00100000:0.0:1788460048.983354:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfae8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022318464:0@lo:400:kworker.0 00000100:00100000:3.0:1788460048.983755:0:8832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc43f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022318848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460048.983812:0:8832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc43f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022318848:12345-0@lo:400:kworker.0 Request processed in 1215us (4560us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460048.983818:0:8832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00080000:0.0:1788460048.984071:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac4138000 x1875336022318848/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788460064 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460048.984082:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4138000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022318848:0@lo:400:kworker.0 00000100:00100000:2.0:1788460048.984236:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022317696:0@lo:400:kworker.0 00000100:00100000:2.0:1788460048.984246:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3afad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1875336022318208:0@lo:400:kworker.0 00000100:00100000:2.0:1788460048.984335:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460048.984392:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfae8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1875336022318720:0@lo:400:kworker.0 00000100:00100000:2.0:1788460048.984412:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460048.984744:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022318208 00000100:00100000:0.0:1788460048.984750:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022318208 00000100:00100000:0.0:1788460048.984806:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022318720 00000100:00100000:0.0:1788460048.984809:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022318720 00000100:00100000:0.0:1788460048.984829:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1788460048.984836:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf7711880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1875336022318208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460048.984883:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf7711880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1875336022318208:12345-0@lo:400:kworker.0 Request processed in 48us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460048.984890:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1788460048.984902:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1788460048.984908:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf7710380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1875336022318720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460048.984929:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf7710380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1875336022318720:12345-0@lo:400:kworker.0 Request processed in 22us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460048.984934:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00010000:00080000:2.0:1788460048.985078:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3afad80 x1875336022318208/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460064 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460048.985088:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3afad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1875336022318208:0@lo:400:kworker.0 00010000:00080000:2.0:1788460048.985107:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bfae8c000 x1875336022318720/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460064 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460048.985115:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfae8c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1875336022318720:0@lo:400:kworker.0 00000100:00080000:1.0:1788460048.985171:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1788460049.169986:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788460049.343528:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460049.343605:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003350784 00000100:00100000:2.0:1788460049.343615:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003350784 00000100:00100000:2.0:1788460049.343663:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 410 00000100:00100000:2.0:1788460049.343672:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bed032f6-c389-485e-b2f7-e2ea34763c65+14:2394:x1875336003350784:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:2.0:1788460049.343732:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bed032f6-c389-485e-b2f7-e2ea34763c65+14:2394:x1875336003350784:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 61us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460049.343739:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 410 00000100:00100000:3.0:1788460049.348416:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460049.348512:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003350912 00000100:00100000:0.0:1788460049.348522:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003350912 00000100:00100000:0.0:1788460049.348607:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 230 00000100:00100000:0.0:1788460049.348617:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4139c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2394:x1875336003350912:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:0.0:1788460049.348689:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4139c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2394:x1875336003350912:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 73us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460049.348697:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 230 00000100:00080000:1.0:1788460049.348875:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788460049.350925:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460049.350991:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460049.351022:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460049.351125:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003351040 00000100:00100000:3.0:1788460049.351134:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003351040 00000100:00100000:3.0:1788460049.351186:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003351296 00000100:00100000:3.0:1788460049.351201:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003351296 00000100:00100000:3.0:1788460049.351229:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 231 00000100:00100000:3.0:1788460049.351237:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfae8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2394:x1875336003351040:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:3.0:1788460049.351297:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfae8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2394:x1875336003351040:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 61us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460049.351305:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 231 00000100:00100000:3.0:1788460049.351321:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 232 00000100:00100000:3.0:1788460049.351327:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfae8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a5915a6d-4114-41fb-8d95-33add86e0720+5:2394:x1875336003351296:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:3.0:1788460049.351352:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfae8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a5915a6d-4114-41fb-8d95-33add86e0720+5:2394:x1875336003351296:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 26us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460049.351358:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 232 00000100:00080000:3.0:1788460049.351480:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788460049.351484:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788460049.351789:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460049.351870:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003351424 00000100:00100000:2.0:1788460049.351875:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003351424 00000100:00100000:2.0:1788460049.351927:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 233 00000100:00100000:2.0:1788460049.351936:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3999f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a5915a6d-4114-41fb-8d95-33add86e0720+5:2394:x1875336003351424:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:2.0:1788460049.352004:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3999f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a5915a6d-4114-41fb-8d95-33add86e0720+5:2394:x1875336003351424:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 69us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460049.352011:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 233 00000100:00080000:3.0:1788460049.352808:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788460049.355062:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003351168 00000100:00100000:1.0:1788460049.355076:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003351168 00000100:00100000:1.0:1788460049.355157:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 94 00000100:00100000:1.0:1788460049.355168:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfae8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2394:x1875336003351168:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:1.0:1788460049.355259:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfae8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2394:x1875336003351168:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 93us (4235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460049.355267:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 94 00000100:00080000:3.0:1788460049.356550:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788460050.193354:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460051.218915:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788460051.411153:0:13815:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1788460051.411862:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788460052.049426:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf76ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022318976:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788460052.049495:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460052.049732:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022318976 00000100:00100000:3.0:1788460052.049740:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022318976 00000100:00100000:3.0:1788460052.049812:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788460052.049822:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3b6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022318976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788460052.049859:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00080000:1.0:1788460052.049927:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788460052.051227:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3b6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022318976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1402us (1727us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460052.051256:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788460052.054221:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf76ed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022318976:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788460052.243306:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788460052.561520:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788460052.565842:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788460052.565863:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf7711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022319232:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788460052.565921:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460052.566506:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022319232 00000100:00100000:2.0:1788460052.566513:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022319232 00000100:00100000:2.0:1788460052.566566:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788460052.566575:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf76ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022319232:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788460052.566609:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788460052.566675:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf76ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022319232:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460052.566681:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788460052.566792:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf7711c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022319232:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788460052.571648:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac413b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022319104:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788460052.571722:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460052.572233:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022319104 00000100:00100000:2.0:1788460052.572241:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022319104 00000100:00100000:2.0:1788460052.572345:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788460052.572355:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3b6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022319104:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788460052.572385:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788460052.574005:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3b6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022319104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1644us (2275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460052.574018:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788460052.574184:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac413b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022319104:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788460052.574593:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788460053.266393:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460053.586223:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf76ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022319360:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788460053.586291:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460053.586421:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022319360 00000100:00100000:2.0:1788460053.586428:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022319360 00000100:00100000:2.0:1788460053.586489:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788460053.586499:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4139f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1875336022319360:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788460053.586530:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446453248 avail 1300213760 00000100:00100000:2.0:1788460053.588027:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4139f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1875336022319360:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1521us (1727us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460053.588040:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788460053.588045:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf76ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022319360:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788460054.097389:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788460054.097411:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4138e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022319488:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788460054.097481:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460054.097661:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022319488 00000100:00100000:3.0:1788460054.097669:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022319488 00000100:00100000:0.0:1788460054.097677:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875336022319744:0@lo:400:kworker.0 00000100:00100000:0.0:1788460054.097718:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460054.097724:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788460054.097735:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf7711c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022319488:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788460054.097745:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3afb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3661:1875336022320256:0@lo:400:kworker.0 00002000:00000024:3.0:1788460054.097762:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788460054.097771:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460054.097802:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac39d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3661:1875336022320768:0@lo:400:kworker.0 00000100:00100000:3.0:1788460054.097811:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf7711c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022319488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460054.097829:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788460054.097848:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788460054.097860:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788460054.097874:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022319744 00000100:00100000:0.0:1788460054.097876:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788460054.097878:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022319744 00000100:00100000:0.0:1788460054.097884:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022319872:0@lo:400:kworker.0 00000100:00100000:3.0:1788460054.097905:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022320256 00000100:00100000:3.0:1788460054.097908:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022320256 00000100:00100000:0.0:1788460054.097929:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460054.097941:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022320768 00000100:00100000:3.0:1788460054.097970:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022320768 00000100:00100000:0.0:1788460054.097973:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3a30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1875336022320384:0@lo:400:kworker.0 00000100:00100000:3.0:1788460054.097994:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1788460054.098001:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460054.098004:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac39d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1875336022319744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460054.098016:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac39d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1875336022320896:0@lo:400:kworker.0 00000100:00100000:0.0:1788460054.098047:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460054.098052:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac39d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1875336022319744:12345-0@lo:400:kworker.0 Request processed in 46us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460054.098059:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1788460054.098079:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875336022319744:0@lo:400:kworker.0 00000100:00100000:3.0:1788460054.098082:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022320384 00000100:00100000:3.0:1788460054.098087:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022320384 00000100:00100000:3.0:1788460054.098106:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022320896 00000100:00100000:3.0:1788460054.098109:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022320896 00000100:00100000:0.0:1788460054.098114:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1788460054.098125:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf2feb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1875336022320256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460054.098130:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1788460054.098140:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf2feaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1875336022320768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460054.098171:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf2feb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1875336022320256:12345-0@lo:400:kworker.0 Request processed in 48us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460054.098179:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1788460054.098185:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf2feaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1875336022320768:12345-0@lo:400:kworker.0 Request processed in 46us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460054.098194:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1788460054.098199:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1788460054.098209:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf2fe9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1875336022320384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460054.098213:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1788460054.098224:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf2feb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1875336022320896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460054.098244:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf2fe9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1875336022320384:12345-0@lo:400:kworker.0 Request processed in 37us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460054.098253:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1788460054.098276:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf2feb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1875336022320896:12345-0@lo:400:kworker.0 Request processed in 53us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460054.098281:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022319872 00000100:00100000:3.0:1788460054.098285:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1788460054.098287:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022319872 00000100:00080000:3.0:1788460054.098308:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788460054.098312:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788460054.098323:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788460054.098330:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf2fe9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022319872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460054.098348:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3afaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1875336022320000:0@lo:400:kworker.0 00000100:00100000:3.0:1788460054.100608:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460054.100673:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac36cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022320512:0@lo:400:kworker.0 00000100:00100000:3.0:1788460054.100722:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460054.100742:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac39d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022321024:0@lo:400:kworker.0 00000100:00100000:3.0:1788460054.100762:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460054.100805:0:8832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022320512 00000100:00100000:3.0:1788460054.100812:0:8832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022320512 00000100:00100000:3.0:1788460054.100878:0:8832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022321024 00000100:00100000:3.0:1788460054.100882:0:8832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022321024 00000100:00100000:3.0:1788460054.100906:0:8832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788460054.100914:0:8832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4138700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022320512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460054.102637:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022319872:0@lo:400:kworker.0 00010000:00080000:1.0:1788460054.102680:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3a30380 x1875336022320384/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460070 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460054.102695:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3a30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1875336022320384:0@lo:400:kworker.0 00010000:00080000:1.0:1788460054.102720:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac39d2d80 x1875336022320896/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460070 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460054.102730:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac39d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1875336022320896:0@lo:400:kworker.0 00000100:00100000:1.0:1788460054.102744:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3afb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3661:1875336022320256:0@lo:400:kworker.0 00000100:00100000:1.0:1788460054.102754:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac39d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3661:1875336022320768:0@lo:400:kworker.0 00000100:00100000:1.0:1788460054.102830:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788460054.102844:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac413a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022321024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460054.102924:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac413a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022321024:12345-0@lo:400:kworker.0 Request processed in 86us (2160us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460054.102931:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788460054.102991:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022320000 00000100:00100000:1.0:1788460054.102997:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022320000 00000100:00100000:1.0:1788460054.103034:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1788460054.103042:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac413aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1875336022320000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460054.103049:0:8832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4138700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022320512:12345-0@lo:400:kworker.0 Request processed in 2133us (2323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460054.103060:0:8832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:3.0:1788460054.103082:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788460054.103085:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac413aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1875336022320000:12345-0@lo:400:kworker.0 Request processed in 42us (4704us total) trans 0 rc 0/0 00000100:00080000:3.0:1788460054.103087:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788460054.103096:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1788460054.103117:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3afaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1875336022320000:0@lo:400:kworker.0 00000100:00100000:3.0:1788460054.103132:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac36cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022320512:0@lo:400:kworker.0 00010000:00080000:3.0:1788460054.103145:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac39d3100 x1875336022321024/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788460070 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460054.103154:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac39d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022321024:0@lo:400:kworker.0 00000100:00100000:0.0:1788460054.104194:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf2fe9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022319872:12345-0@lo:400:kworker.0 Request processed in 35us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460054.104206:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788460054.104353:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3afad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0cf73fe6-82e2-434e-b670-631647721b2c:3660:1875336022319616:0@lo:400:kworker.0 00000100:00100000:2.0:1788460054.104471:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460054.104599:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3afa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022320128:0@lo:400:kworker.0 00000100:00100000:2.0:1788460054.104627:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460054.104656:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac39d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022320640:0@lo:400:kworker.0 00000100:00100000:2.0:1788460054.104678:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460054.104714:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf76ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022321152:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788460054.104754:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460054.105034:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022320640 00000100:00100000:0.0:1788460054.105041:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022320640 00000100:00100000:0.0:1788460054.105094:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788460054.105102:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfa35bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022320640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460054.105148:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfa35bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022320640:12345-0@lo:400:kworker.0 Request processed in 47us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460054.105155:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:0.0:1788460054.105174:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788460054.105293:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac4138e00 x1875336022319488/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460070 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460054.105314:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4138e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022319488:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788460054.105339:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac39d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022320640:0@lo:400:kworker.0 00000100:00100000:2.0:1788460054.105360:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022321152 00000100:00100000:2.0:1788460054.105376:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022321152 00000100:00100000:2.0:1788460054.105412:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788460054.105419:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfa35a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022321152:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788460054.105431:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788460054.105468:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfa35a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022321152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 49us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460054.105474:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00010000:00080000:2.0:1788460054.105498:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bf76ee300 x1875336022321152/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460070 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460054.105512:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf76ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022321152:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788460054.105941:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022320128 00000100:00100000:3.0:1788460054.105962:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022320128 00000100:00100000:3.0:1788460054.105999:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788460054.106007:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfa358380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022320128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460054.106062:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfa358380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022320128:12345-0@lo:400:kworker.0 Request processed in 57us (1434us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460054.106068:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788460054.106177:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3afa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022320128:0@lo:400:kworker.0 00000100:00100000:1.0:1788460054.106280:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022319616 00000100:00100000:1.0:1788460054.106285:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022319616 00000100:00100000:1.0:1788460054.106357:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 411 00000100:00100000:1.0:1788460054.106433:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+29:3660:x1875336022319616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460054.106482:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+29:3660:x1875336022319616:12345-0@lo:400:kworker.0 Request processed in 51us (2010us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460054.106487:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 411 00000100:00100000:3.0:1788460054.106549:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3afad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0cf73fe6-82e2-434e-b670-631647721b2c:3660:1875336022319616:0@lo:400:kworker.0 00010000:00010000:1.0:1788460054.289315:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788460054.466014:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460054.466129:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460054.466208:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460054.466588:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003351808 00000100:00100000:2.0:1788460054.466602:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003351808 00000100:00100000:1.0:1788460054.466715:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003351680 00000100:00100000:2.0:1788460054.466721:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 240 00000100:00100000:1.0:1788460054.466722:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003351680 00000100:00100000:2.0:1788460054.466735:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf2fead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2394:x1875336003351808:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:2.0:1788460054.466807:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf2fead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2394:x1875336003351808:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 75us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460054.466815:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 240 00000100:00080000:0.0:1788460054.468135:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788460054.468143:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788460054.468784:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003351552 00000100:00100000:3.0:1788460054.468797:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003351552 00000100:00100000:3.0:1788460054.468934:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 412 00000100:00100000:3.0:1788460054.468958:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bd04fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bed032f6-c389-485e-b2f7-e2ea34763c65+14:2394:x1875336003351552:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:3.0:1788460054.469045:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bd04fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bed032f6-c389-485e-b2f7-e2ea34763c65+14:2394:x1875336003351552:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 103us (3040us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460054.469069:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 412 00000100:00100000:1.0:1788460054.472476:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 241 00000100:00100000:1.0:1788460054.472491:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf2fe8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2394:x1875336003351680:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:1.0:1788460054.472577:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf2fe8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2394:x1875336003351680:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 90us (6367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460054.472584:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 241 00000100:00100000:2.0:1788460054.476321:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460054.476367:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460054.476450:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460054.476492:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003352064 00000100:00100000:2.0:1788460054.476501:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003352064 00000100:00100000:1.0:1788460054.476570:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003352192 00000100:00100000:1.0:1788460054.476576:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003352192 00000100:00100000:3.0:1788460054.477046:0:8832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003351936 00000100:00100000:3.0:1788460054.477052:0:8832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003351936 00000100:00080000:0.0:1788460054.478928:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788460054.478939:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788460054.478954:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788460054.479191:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 242 00000100:00100000:2.0:1788460054.479205:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfa35aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a5915a6d-4114-41fb-8d95-33add86e0720+5:2393:x1875336003352064:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:2.0:1788460054.479465:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfa35aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a5915a6d-4114-41fb-8d95-33add86e0720+5:2393:x1875336003352064:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 263us (3096us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460054.479473:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 242 00000100:00100000:1.0:1788460054.481215:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 243 00000100:00100000:1.0:1788460054.481227:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfa358e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a5915a6d-4114-41fb-8d95-33add86e0720+5:2393:x1875336003352192:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:1.0:1788460054.481289:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfa358e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a5915a6d-4114-41fb-8d95-33add86e0720+5:2393:x1875336003352192:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 64us (4838us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460054.481296:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 243 00000100:00100000:3.0:1788460054.481719:0:8832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 27 00000100:00100000:3.0:1788460054.481728:0:8832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfa35ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2392:x1875336003351936:12345-192.168.206.5@tcp:9:kworker.0 00000020:00000080:3.0:1788460054.481747:0:8832:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5dfa74784542b06d 00000100:00080000:3.0:1788460054.481755:0:8832:0:(import.c:65:import_set_state_nolock()) ffff8c4ac3840000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788460054.481812:0:8832:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:3.0:1788460054.481937:0:8832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfa35ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+2:2392:x1875336003351936:12345-192.168.206.5@tcp:9:kworker.0 Request processed in 209us (5622us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460054.481974:0:8832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 27 00010000:00010000:2.0:1788460054.483272:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460055.313125:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460056.337347:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788460057.171982:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf76ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022321280:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788460057.172047:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460057.172182:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022321280 00000100:00100000:2.0:1788460057.172189:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022321280 00000100:00100000:2.0:1788460057.172258:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788460057.172269:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf2fe8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1875336022321280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788460057.172294:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788460057.172333:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf2fe8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1875336022321280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460057.172339:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:0.0:1788460057.172508:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788460057.172556:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf76ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022321280:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788460057.361193:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460057.681981:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022321408:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788460057.682048:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460057.682558:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022321408 00000100:00100000:2.0:1788460057.682566:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022321408 00000100:00100000:2.0:1788460057.682626:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788460057.682635:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac413a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022321408:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788460057.682666:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788460057.682722:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac413a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022321408:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460057.682892:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022321408:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788460057.683050:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788460057.683108:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788460057.683121:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf76ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022321536:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788460057.683158:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460057.683552:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022321536 00000100:00100000:2.0:1788460057.683558:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022321536 00000100:00100000:2.0:1788460057.683649:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788460057.683657:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3afad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022321536:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788460057.683680:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788460057.683734:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3afad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022321536:12345-0@lo:13:osp-pre-0-1.0 Request processed in 78us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460057.683741:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788460057.683813:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf76ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022321536:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788460057.685040:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788460058.385332:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788460058.705614:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788460058.705636:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf76ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022321664:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788460058.705716:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460058.709032:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022321664 00000100:00100000:1.0:1788460058.709045:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022321664 00000100:00100000:1.0:1788460058.709108:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788460058.709118:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3af5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022321664:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788460058.709152:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446453248 avail 1300213760 00000100:00100000:1.0:1788460058.709376:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3af5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022321664:12345-0@lo:41:osp-pre-1-0.0 Request processed in 259us (3659us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460058.709383:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788460058.712721:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf76ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022321664:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788460059.217315:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3660:1875336022322176:0@lo:400:kworker.0 00000100:00100000:0.0:1788460059.217380:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460059.217428:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3bdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022322688:0@lo:400:kworker.0 00000100:00100000:0.0:1788460059.217453:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460059.217470:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3671180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022323200:0@lo:400:kworker.0 00000100:00100000:0.0:1788460059.217506:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460059.217529:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788460059.217535:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3afb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022322048:0@lo:400:kworker.0 00000100:00100000:0.0:1788460059.217557:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460059.217573:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac366bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3660:1875336022322560:0@lo:400:kworker.0 00000100:00100000:0.0:1788460059.217592:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460059.217607:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3bd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3660:1875336022323072:0@lo:400:kworker.0 00000100:00100000:0.0:1788460059.217634:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460059.217666:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022322176 00000100:00100000:0.0:1788460059.217673:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022322176 00000100:00100000:0.0:1788460059.217711:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022322560 00000100:00100000:0.0:1788460059.217714:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022322560 00000100:00100000:0.0:1788460059.217737:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022323072 00000100:00100000:0.0:1788460059.217740:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022323072 00000100:00100000:0.0:1788460059.217754:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1788460059.217760:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfa1e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1875336022322176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460059.217819:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfa1e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1875336022322176:12345-0@lo:400:kworker.0 Request processed in 59us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460059.217827:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1788460059.217843:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1788460059.217849:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3b58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1875336022322560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460059.217878:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3b58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1875336022322560:12345-0@lo:400:kworker.0 Request processed in 30us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460059.217884:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1788460059.217895:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1788460059.217900:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3b5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1875336022323072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460059.217938:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3b5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1875336022323072:12345-0@lo:400:kworker.0 Request processed in 38us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460059.217978:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1788460059.217997:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022322688 00000100:00100000:0.0:1788460059.218001:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022322688 00000100:00100000:0.0:1788460059.218022:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022323200 00000100:00100000:0.0:1788460059.218025:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022323200 00000100:00100000:0.0:1788460059.218045:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788460059.218051:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfa1e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022322688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460059.218081:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfa1e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022322688:12345-0@lo:400:kworker.0 Request processed in 31us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460059.218087:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788460059.218099:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788460059.218104:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfa1e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022323200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460059.218129:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfa1e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022323200:12345-0@lo:400:kworker.0 Request processed in 26us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460059.218134:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:0.0:1788460059.218151:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788460059.218154:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788460059.218157:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788460059.218189:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac366bb80 x1875336022322560/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460075 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460059.218201:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac366bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3660:1875336022322560:0@lo:400:kworker.0 00010000:00080000:0.0:1788460059.218212:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3bd8700 x1875336022323072/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460075 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460059.218221:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3bd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3660:1875336022323072:0@lo:400:kworker.0 00000100:00100000:0.0:1788460059.218240:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3660:1875336022322176:0@lo:400:kworker.0 00000100:00100000:0.0:1788460059.218249:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3bdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022322688:0@lo:400:kworker.0 00010000:00080000:0.0:1788460059.218258:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3671180 x1875336022323200/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788460075 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460059.218266:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3671180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022323200:0@lo:400:kworker.0 00000100:00100000:3.0:1788460059.218559:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3afaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3662:1875336022321920:0@lo:400:kworker.0 00000100:00100000:3.0:1788460059.218596:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460059.218627:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac366aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3662:1875336022322432:0@lo:400:kworker.0 00000100:00100000:3.0:1788460059.218646:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460059.218670:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3bd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3662:1875336022322944:0@lo:400:kworker.0 00000100:00100000:3.0:1788460059.218689:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460059.218715:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1788460059.218722:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3afa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0cf73fe6-82e2-434e-b670-631647721b2c:3662:1875336022321792:0@lo:400:kworker.0 00000100:00100000:3.0:1788460059.218751:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460059.218790:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022322304:0@lo:400:kworker.0 00000100:00100000:3.0:1788460059.218826:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460059.218848:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3bdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022322816:0@lo:400:kworker.0 00000100:00100000:2.0:1788460059.218852:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022321920 00000100:00100000:2.0:1788460059.218859:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022321920 00000100:00100000:3.0:1788460059.218872:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460059.218891:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022322432 00000100:00100000:2.0:1788460059.218895:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022322432 00000100:00100000:3.0:1788460059.218896:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfaea9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022323328:0@lo:400:kworker.0 00000100:00100000:2.0:1788460059.218922:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022322944 00000100:00100000:3.0:1788460059.218925:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460059.218927:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022322944 00000100:00100000:2.0:1788460059.218975:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1788460059.218985:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac413b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1875336022321920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460059.219044:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac413b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1875336022321920:12345-0@lo:400:kworker.0 Request processed in 61us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460059.219064:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1788460059.219074:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac413ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1875336022322432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460059.219106:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac413ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1875336022322432:12345-0@lo:400:kworker.0 Request processed in 34us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460059.219172:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1788460059.219190:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1788460059.219197:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4139500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1875336022322944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460059.219225:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4139500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1875336022322944:12345-0@lo:400:kworker.0 Request processed in 30us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460059.219232:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1788460059.219376:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022322048 00000100:00100000:2.0:1788460059.219380:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022322048 00000100:00100000:2.0:1788460059.219399:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022322304 00000100:00100000:2.0:1788460059.219401:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022322304 00000100:00100000:2.0:1788460059.219413:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788460059.219419:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfa1e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022322048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460059.219458:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfa1e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022322048:12345-0@lo:400:kworker.0 Request processed in 38us (1899us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460059.219464:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788460059.219475:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788460059.219481:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4139880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1875336022322304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460059.219508:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4139880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1875336022322304:12345-0@lo:400:kworker.0 Request processed in 28us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460059.219514:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:2.0:1788460059.219528:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788460059.219536:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788460059.219545:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022323456:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788460059.219571:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460059.219607:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022322304:0@lo:400:kworker.0 00000100:00100000:2.0:1788460059.219619:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3afaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3662:1875336022321920:0@lo:400:kworker.0 00000100:00100000:2.0:1788460059.219628:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac366aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3662:1875336022322432:0@lo:400:kworker.0 00000100:00100000:2.0:1788460059.219637:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3bd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3662:1875336022322944:0@lo:400:kworker.0 00000100:00100000:2.0:1788460059.219669:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3afb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022322048:0@lo:400:kworker.0 00000100:00100000:2.0:1788460059.219701:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022322816 00000100:00100000:2.0:1788460059.219705:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022322816 00000100:00100000:2.0:1788460059.219738:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022323328 00000100:00100000:2.0:1788460059.219742:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022323328 00000100:00100000:2.0:1788460059.219756:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788460059.219761:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4138a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1875336022322816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460059.219805:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4138a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1875336022322816:12345-0@lo:400:kworker.0 Request processed in 44us (932us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460059.219810:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788460059.219821:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788460059.219827:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4139180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1875336022323328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460059.219855:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4139180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1875336022323328:12345-0@lo:400:kworker.0 Request processed in 29us (932us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460059.219860:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:2.0:1788460059.219875:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788460059.219877:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788460059.219893:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3bdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022322816:0@lo:400:kworker.0 00010000:00080000:2.0:1788460059.219903:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bfaea9c00 x1875336022323328/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788460075 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460059.219912:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfaea9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022323328:0@lo:400:kworker.0 00000100:00100000:3.0:1788460059.219967:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1788460059.220102:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022321792 00000100:00100000:1.0:1788460059.220108:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022321792 00000100:00100000:1.0:1788460059.220143:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 413 00000100:00100000:1.0:1788460059.220151:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4c02042850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+29:3662:x1875336022321792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460059.220196:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4c02042850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+29:3662:x1875336022321792:12345-0@lo:400:kworker.0 Request processed in 45us (1443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460059.220203:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 413 00000100:00100000:3.0:1788460059.220230:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022323456 00000100:00100000:3.0:1788460059.220235:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022323456 00000100:00100000:1.0:1788460059.220237:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac413b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022323584:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788460059.220266:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788460059.220273:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3af7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1875336022323456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788460059.220294:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788460059.220333:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3af7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1875336022323456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460059.220339:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00010000:00080000:3.0:1788460059.220368:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3af5500 x1875336022323456/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460075 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460059.220388:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022323456:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788460059.220406:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460059.220444:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3afa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0cf73fe6-82e2-434e-b670-631647721b2c:3662:1875336022321792:0@lo:400:kworker.0 00000100:00100000:1.0:1788460059.220447:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022323584 00000100:00100000:1.0:1788460059.220452:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022323584 00000100:00100000:1.0:1788460059.220473:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788460059.220480:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf76ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022323584:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788460059.220491:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788460059.220535:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf76ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022323584:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460059.220541:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00010000:00080000:3.0:1788460059.220976:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac413b100 x1875336022323584/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460075 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460059.220992:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac413b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022323584:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788460059.411032:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788460059.585290:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460059.585331:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460059.585360:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460059.585479:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003352448 00000100:00100000:2.0:1788460059.585488:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003352448 00000100:00100000:2.0:1788460059.585544:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003352704 00000100:00100000:2.0:1788460059.585547:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003352704 00000100:00100000:2.0:1788460059.585569:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 250 00000100:00100000:2.0:1788460059.585577:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3671180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2395:x1875336003352448:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:2.0:1788460059.585647:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3671180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2395:x1875336003352448:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 70us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460059.585671:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 250 00000100:00100000:2.0:1788460059.585688:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 251 00000100:00100000:2.0:1788460059.585695:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3afa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a5915a6d-4114-41fb-8d95-33add86e0720+5:2395:x1875336003352704:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:2.0:1788460059.585719:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3afa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a5915a6d-4114-41fb-8d95-33add86e0720+5:2395:x1875336003352704:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 26us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460059.585725:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 251 00000100:00080000:2.0:1788460059.585844:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788460059.585917:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460059.585979:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460059.585999:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003352576 00000100:00100000:0.0:1788460059.586003:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003352576 00000100:00100000:0.0:1788460059.586027:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003352832 00000100:00100000:0.0:1788460059.586030:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003352832 00000100:00100000:0.0:1788460059.587330:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 252 00000100:00100000:0.0:1788460059.587346:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3afb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2395:x1875336003352576:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:2.0:1788460059.587567:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 253 00000100:00100000:2.0:1788460059.587577:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3afaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a5915a6d-4114-41fb-8d95-33add86e0720+5:2395:x1875336003352832:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:2.0:1788460059.587634:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3afaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a5915a6d-4114-41fb-8d95-33add86e0720+5:2395:x1875336003352832:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 60us (1654us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460059.587642:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 253 00000100:00080000:2.0:1788460059.587683:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788460059.587810:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3afb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2395:x1875336003352576:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 470us (1892us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460059.587818:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 252 00000100:00100000:1.0:1788460059.588110:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003352320 00000100:00100000:1.0:1788460059.588119:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003352320 00000100:00100000:1.0:1788460059.588152:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 414 00000100:00100000:1.0:1788460059.588159:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc844a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bed032f6-c389-485e-b2f7-e2ea34763c65+14:2395:x1875336003352320:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:1.0:1788460059.588191:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc844a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bed032f6-c389-485e-b2f7-e2ea34763c65+14:2395:x1875336003352320:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 32us (2829us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460059.588216:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 414 00000001:00100000:3.0:1788460059.737980:0:8443:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f8767d3e-bfef-4d3d-8163-ef8ae18a3514 00000020:00000080:3.0:1788460059.737990:0:8443:0:(genops.c:885:class_export_put()) final put ffff8c4ac3843000/f8767d3e-bfef-4d3d-8163-ef8ae18a3514 00000020:00000080:0.0:1788460059.738719:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8c4ac3843000/f8767d3e-bfef-4d3d-8163-ef8ae18a3514 for lustre-OST0000 00000020:00000080:0.0:1788460059.738783:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c4ac3840000 for lustre-OST0000 00010000:00010000:3.0:1788460060.433389:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460061.461466:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788460061.651195:0:13815:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1788460061.656513:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788460062.290891:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788460062.290914:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf76ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022323712:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788460062.290992:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460062.291165:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022323712 00000100:00100000:1.0:1788460062.291173:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022323712 00000100:00100000:1.0:1788460062.291234:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788460062.291244:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac413b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022323712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788460062.291273:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788460062.291319:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac413b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022323712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460062.291326:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:3.0:1788460062.291902:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788460062.292089:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf76ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022323712:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788460062.481311:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788460062.801434:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788460062.802477:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022323968:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788460062.802561:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460062.802762:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022323968 00000100:00100000:3.0:1788460062.802770:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022323968 00000100:00100000:3.0:1788460062.802834:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788460062.802843:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3af9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022323968:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788460062.802874:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788460062.802919:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3af9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022323968:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460062.802927:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788460062.803108:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3af5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022323968:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788460062.803117:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf76eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022323840:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788460062.803155:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460062.815505:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022323840 00000100:00100000:3.0:1788460062.815520:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022323840 00000100:00100000:0.0:1788460062.816879:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788460062.816892:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3af8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022323840:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788460062.816918:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788460062.817028:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3af8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022323840:12345-0@lo:13:osp-pre-0-1.0 Request processed in 138us (13871us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460062.817036:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788460062.817632:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf76eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022323840:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788460062.822639:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788460063.505174:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788460063.825935:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788460063.825986:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf76eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022324096:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788460063.826052:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460063.827507:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022324096 00000100:00100000:1.0:1788460063.827521:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022324096 00000100:00100000:1.0:1788460063.827583:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788460063.827605:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3af7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022324096:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788460063.827640:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446453248 avail 1300213760 00000100:00100000:1.0:1788460063.827726:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3af7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022324096:12345-0@lo:41:osp-pre-1-0.0 Request processed in 134us (1673us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460063.827733:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788460063.827791:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf76eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022324096:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788460064.340154:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3bd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1875336022324608:0@lo:400:kworker.0 00000100:00100000:0.0:1788460064.340220:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460064.340267:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac405d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022325120:0@lo:400:kworker.0 00000100:00100000:0.0:1788460064.340292:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460064.340312:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac405c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022325632:0@lo:400:kworker.0 00000100:00100000:0.0:1788460064.340346:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460064.340371:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1788460064.340386:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3bdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0cf73fe6-82e2-434e-b670-631647721b2c:3659:1875336022324224:0@lo:400:kworker.0 00000100:00100000:0.0:1788460064.340414:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460064.340436:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac366aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022324736:0@lo:400:kworker.0 00000100:00100000:0.0:1788460064.340460:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460064.340476:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac405f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022325248:0@lo:400:kworker.0 00000100:00100000:0.0:1788460064.340495:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460064.340511:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac405dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022325760:0@lo:400:kworker.0 00000100:00100000:0.0:1788460064.340539:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460064.340564:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3bd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875336022324352:0@lo:400:kworker.0 00000100:00100000:0.0:1788460064.340585:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460064.340601:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac366bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3661:1875336022324864:0@lo:400:kworker.0 00000100:00100000:0.0:1788460064.340618:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460064.340632:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac405c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3661:1875336022325376:0@lo:400:kworker.0 00000100:00100000:0.0:1788460064.340647:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460064.340664:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788460064.340669:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3bdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022324480:0@lo:400:kworker.0 00000100:00100000:0.0:1788460064.340687:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460064.340703:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac405ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1875336022324992:0@lo:400:kworker.0 00000100:00100000:0.0:1788460064.340723:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460064.340738:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac405fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1875336022325504:0@lo:400:kworker.0 00000100:00100000:0.0:1788460064.340778:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460064.340809:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022324608 00000100:00100000:0.0:1788460064.340816:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022324608 00000100:00100000:0.0:1788460064.340850:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022324352 00000100:00100000:0.0:1788460064.340853:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022324352 00000100:00100000:0.0:1788460064.340863:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022324864 00000100:00100000:0.0:1788460064.340866:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022324864 00000100:00100000:0.0:1788460064.341187:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022325376 00000100:00100000:0.0:1788460064.341191:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022325376 00000100:00100000:0.0:1788460064.341202:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022324992 00000100:00100000:0.0:1788460064.341204:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022324992 00000100:00100000:0.0:1788460064.341215:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022325504 00000100:00100000:0.0:1788460064.341217:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022325504 00000100:00100000:0.0:1788460064.341229:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1788460064.341235:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac405f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1875336022324608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460064.341290:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac405f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1875336022324608:12345-0@lo:400:kworker.0 Request processed in 54us (1069us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460064.341296:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1788460064.341312:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1788460064.341318:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac405e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1875336022324352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460064.341348:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac405e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1875336022324352:12345-0@lo:400:kworker.0 Request processed in 30us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460064.341354:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1788460064.341366:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1788460064.341372:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac405f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1875336022324864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460064.341409:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac405f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1875336022324864:12345-0@lo:400:kworker.0 Request processed in 38us (791us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460064.341415:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1788460064.341425:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1788460064.341430:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac405ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1875336022325376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460064.341451:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac405ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1875336022325376:12345-0@lo:400:kworker.0 Request processed in 22us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460064.341456:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1788460064.341465:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1788460064.341470:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac405d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1875336022324992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460064.341490:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac405d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1875336022324992:12345-0@lo:400:kworker.0 Request processed in 20us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460064.341495:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1788460064.341504:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1788460064.341509:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3a3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1875336022325504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460064.341540:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3a3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1875336022325504:12345-0@lo:400:kworker.0 Request processed in 31us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460064.341545:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1788460064.341564:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022325120 00000100:00100000:0.0:1788460064.341567:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022325120 00000100:00100000:0.0:1788460064.341583:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022325632 00000100:00100000:0.0:1788460064.341586:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022325632 00000100:00100000:0.0:1788460064.341595:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022325248 00000100:00100000:0.0:1788460064.341597:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022325248 00000100:00100000:0.0:1788460064.341605:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022325760 00000100:00100000:0.0:1788460064.341607:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022325760 00000100:00100000:0.0:1788460064.341616:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788460064.341622:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac405df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022325120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460064.341646:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac405df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022325120:12345-0@lo:400:kworker.0 Request processed in 26us (1354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460064.341652:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788460064.341660:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788460064.341665:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac405ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022325632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460064.341687:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac405ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022325632:12345-0@lo:400:kworker.0 Request processed in 22us (1341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460064.341692:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788460064.341702:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788460064.341708:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac405c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022325248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460064.341733:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac405c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022325248:12345-0@lo:400:kworker.0 Request processed in 25us (1236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460064.341738:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788460064.341748:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788460064.341761:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac405e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022325760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460064.341799:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac405e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022325760:12345-0@lo:400:kworker.0 Request processed in 39us (1259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460064.341805:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788460064.341840:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022324736 00000100:00100000:0.0:1788460064.341843:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022324736 00000100:00100000:0.0:1788460064.341858:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022324480 00000100:00100000:0.0:1788460064.341861:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022324480 00000100:00100000:0.0:1788460064.341984:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788460064.341992:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac405ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022324736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460064.342023:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac405ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022324736:12345-0@lo:400:kworker.0 Request processed in 33us (1562us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460064.342030:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788460064.342041:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788460064.342047:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac405d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022324480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460064.342074:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac405d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022324480:12345-0@lo:400:kworker.0 Request processed in 28us (1386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460064.342080:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:0.0:1788460064.342100:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788460064.342104:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788460064.342106:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788460064.342108:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788460064.342134:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3bdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022324480:0@lo:400:kworker.0 00010000:00080000:0.0:1788460064.342148:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac405ca80 x1875336022324992/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460080 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460064.342157:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac405ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1875336022324992:0@lo:400:kworker.0 00010000:00080000:0.0:1788460064.342175:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac405fb80 x1875336022325504/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460080 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460064.342183:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac405fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1875336022325504:0@lo:400:kworker.0 00000100:00100000:0.0:1788460064.342194:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3bd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875336022324352:0@lo:400:kworker.0 00000100:00100000:0.0:1788460064.342202:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac366bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3661:1875336022324864:0@lo:400:kworker.0 00000100:00100000:0.0:1788460064.342212:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac405c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3661:1875336022325376:0@lo:400:kworker.0 00000100:00100000:0.0:1788460064.342253:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac366aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022324736:0@lo:400:kworker.0 00000100:00100000:0.0:1788460064.342263:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac405f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022325248:0@lo:400:kworker.0 00010000:00080000:0.0:1788460064.342273:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac405dc00 x1875336022325760/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788460080 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460064.342281:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac405dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022325760:0@lo:400:kworker.0 00000100:00100000:0.0:1788460064.342289:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3bd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1875336022324608:0@lo:400:kworker.0 00000100:00100000:0.0:1788460064.342297:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac405d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022325120:0@lo:400:kworker.0 00010000:00080000:0.0:1788460064.342305:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac405c000 x1875336022325632/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788460080 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460064.342313:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac405c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022325632:0@lo:400:kworker.0 00000100:00100000:1.0:1788460064.342465:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022324224 00000100:00100000:1.0:1788460064.342470:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022324224 00000100:00100000:1.0:1788460064.342505:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 415 00000100:00100000:1.0:1788460064.342511:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bca61bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+29:3659:x1875336022324224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460064.342550:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bca61bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+29:3659:x1875336022324224:12345-0@lo:400:kworker.0 Request processed in 39us (2135us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460064.342565:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 415 00000100:00100000:1.0:1788460064.342600:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3bdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0cf73fe6-82e2-434e-b670-631647721b2c:3659:1875336022324224:0@lo:400:kworker.0 00000100:00100000:0.0:1788460064.345183:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788460064.345201:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3a38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022325888:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788460064.345255:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460064.345295:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022325888 00000100:00100000:0.0:1788460064.345307:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022325888 00000100:00100000:0.0:1788460064.345347:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788460064.345355:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3a3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875336022325888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788460064.345390:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788460064.345431:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3a3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875336022325888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460064.345437:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00010000:00080000:0.0:1788460064.345470:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3a38700 x1875336022325888/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460080 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460064.345485:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3a38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022325888:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788460064.346135:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788460064.346483:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf76eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022326016:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788460064.346525:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460064.346707:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022326016 00000100:00100000:3.0:1788460064.346714:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022326016 00000100:00100000:3.0:1788460064.346898:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788460064.346908:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3af5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022326016:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788460064.346926:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788460064.346987:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3af5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022326016:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460064.346995:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00010000:00080000:2.0:1788460064.348284:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bf76eca80 x1875336022326016/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460080 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460064.348306:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf76eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022326016:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788460064.530014:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788460064.713067:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460064.713117:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460064.713142:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460064.713171:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460064.713197:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460064.713224:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003353216 00000100:00100000:0.0:1788460064.713245:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003353216 00000100:00100000:3.0:1788460064.713501:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003353472 00000100:00100000:3.0:1788460064.713506:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003353472 00000100:00100000:3.0:1788460064.713532:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003353088 00000100:00100000:3.0:1788460064.713535:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003353088 00000100:00100000:3.0:1788460064.713550:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 260 00000100:00100000:3.0:1788460064.713558:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3a38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2395:x1875336003353216:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:3.0:1788460064.713631:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3a38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2395:x1875336003353216:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 73us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460064.713639:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 260 00000100:00100000:3.0:1788460064.713654:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003353344 00000100:00100000:3.0:1788460064.713657:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003353344 00000100:00100000:3.0:1788460064.713696:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 261 00000100:00100000:3.0:1788460064.713703:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3a3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a5915a6d-4114-41fb-8d95-33add86e0720+5:2395:x1875336003353472:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:3.0:1788460064.713730:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3a3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a5915a6d-4114-41fb-8d95-33add86e0720+5:2395:x1875336003353472:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 27us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460064.713737:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 261 00000100:00100000:3.0:1788460064.713752:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 262 00000100:00100000:3.0:1788460064.713758:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3a3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2395:x1875336003353088:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:3.0:1788460064.713812:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3a3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2395:x1875336003353088:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 54us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460064.713831:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 262 00000100:00100000:3.0:1788460064.713845:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 263 00000100:00100000:3.0:1788460064.713852:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3a3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a5915a6d-4114-41fb-8d95-33add86e0720+5:2395:x1875336003353344:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:3.0:1788460064.713877:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3a3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a5915a6d-4114-41fb-8d95-33add86e0720+5:2395:x1875336003353344:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 26us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460064.713883:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 263 00000100:00080000:3.0:1788460064.714039:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788460064.714043:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788460064.714567:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003352960 00000100:00100000:1.0:1788460064.714575:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003352960 00000100:00100000:1.0:1788460064.714612:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 416 00000100:00100000:1.0:1788460064.714619:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bca61a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bed032f6-c389-485e-b2f7-e2ea34763c65+14:2395:x1875336003352960:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:1.0:1788460064.723760:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bca61a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bed032f6-c389-485e-b2f7-e2ea34763c65+14:2395:x1875336003352960:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 8602us (10164us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460064.723786:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 416 00010000:00010000:3.0:1788460065.557370:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788460066.013583:0:14077:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 14:27:43 (1788460063) 00010000:00010000:2.0:1788460066.577891:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788460067.413988:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf76ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022326144:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788460067.414055:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460067.414966:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022326144 00000100:00100000:1.0:1788460067.414978:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022326144 00000100:00100000:1.0:1788460067.415044:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788460067.415054:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3a39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022326144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788460067.415203:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788460067.415270:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3a39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022326144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 217us (1214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460067.415278:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788460067.415362:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf76ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022326144:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788460067.416181:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788460067.601162:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460067.924098:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf76ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022326272:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788460067.924177:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460067.924248:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022326272 00000100:00100000:0.0:1788460067.924257:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022326272 00000100:00080000:3.0:1788460067.924292:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788460067.924315:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788460067.924323:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4138380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022326272:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788460067.924343:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788460067.924394:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4138380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022326272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460067.924412:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788460067.924512:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf76ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022326272:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788460067.924813:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfaea9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022326400:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788460067.924846:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460067.924918:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022326400 00000100:00100000:2.0:1788460067.924923:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022326400 00000100:00100000:2.0:1788460067.925030:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788460067.925038:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3a39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022326400:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788460067.925063:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788460067.925109:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3a39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022326400:12345-0@lo:41:osp-pre-0-1.0 Request processed in 73us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460067.925115:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788460067.925185:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfaea9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022326400:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788460068.162995:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460068.163889:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003353600 00000100:00100000:3.0:1788460068.163901:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003353600 00000100:00100000:3.0:1788460068.164111:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 40 00000100:00100000:3.0:1788460068.164122:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfaea9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:11058:x1875336003353600:12345-192.168.206.5@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788460068.164142:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460068.164164:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841600/0x5dfa74784542b14d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a5ea expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460068.164255:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840000/0x5dfa74784542b154 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460068.164269:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840000/0x5dfa74784542b154 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460068.164282:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840000/0x5dfa74784542b154 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788460068.164333:0:6535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788460068.164338:0:6535:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788460068.164376:0:6535:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840000/0x5dfa74784542b154 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460068.164400:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841600/0x5dfa74784542b14d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a5ea expref: 7 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460068.164420:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840000/0x5dfa74784542b154 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a5ea expref: 6 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460068.164429:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4bef200900) 00010000:00010000:3.0:1788460068.164443:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788460068.164447:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ac2840000, rc 0) 00000100:00100000:3.0:1788460068.164536:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfaea9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:11058:x1875336003353600:12345-192.168.206.5@tcp:101:lhsmtool_posix.0 Request processed in 412us (1544us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460068.164544:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 40 00000100:00080000:0.0:1788460068.166264:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788460068.173844:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460068.174023:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003353728 00000100:00100000:0.0:1788460068.174033:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003353728 00000100:00100000:0.0:1788460068.174098:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 41 00000100:00100000:0.0:1788460068.174108:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac413bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:11059:x1875336003353728:12345-192.168.206.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788460068.174128:0:13560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460068.174147:0:13560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0e00/0x5dfa74784542b15b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a5f1 expref: -99 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460068.174205:0:13560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d1a00/0x5dfa74784542b162 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460068.174277:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d1a00/0x5dfa74784542b162 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460068.174297:0:13560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d1a00/0x5dfa74784542b162 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460068.174314:0:13560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0000/0x5dfa74784542b169 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460068.174321:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0000/0x5dfa74784542b169 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460068.174326:0:13560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0000/0x5dfa74784542b169 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460068.174408:0:13560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d1200/0x5dfa74784542b170 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460068.174417:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d1200/0x5dfa74784542b170 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460068.174423:0:13560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d1200/0x5dfa74784542b170 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788460068.174459:0:13560:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788460068.174463:0:13560:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788460068.174482:0:13560:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d1200/0x5dfa74784542b170 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460068.174503:0:13560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d1a00/0x5dfa74784542b162 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460068.174509:0:13560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d1a00/0x5dfa74784542b162 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460068.174515:0:13560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d1a00/0x5dfa74784542b162 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460068.174520:0:13560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc29d1a00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460068.174524:0:13560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d1a00/0x5dfa74784542b162 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460068.174530:0:13560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d1a00/0x5dfa74784542b162 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460068.174541:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4bef200900) 00010000:00010000:0.0:1788460068.174550:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460068.174556:0:13560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d1a00/0x5dfa74784542b162 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460068.174561:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d1a00/0x5dfa74784542b162 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460068.174575:0:13560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0000/0x5dfa74784542b169 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460068.174580:0:13560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0000/0x5dfa74784542b169 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460068.174585:0:13560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0000/0x5dfa74784542b169 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460068.174590:0:13560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc29d0000 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460068.174592:0:13560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0000/0x5dfa74784542b169 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460068.174597:0:13560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0000/0x5dfa74784542b169 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460068.174603:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8c4bc5dc1e00) 00010000:00010000:0.0:1788460068.174606:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460068.174608:0:13560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0000/0x5dfa74784542b169 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460068.174613:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0000/0x5dfa74784542b169 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460068.174641:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0e00/0x5dfa74784542b15b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a5f1 expref: 8 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460068.174663:0:13560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d1200/0x5dfa74784542b170 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a5f1 expref: 7 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460068.174669:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8c4bc5dc1100) 00010000:00010000:0.0:1788460068.174671:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788460068.174673:0:13560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc29d1200, rc 0) 00000100:00100000:0.0:1788460068.174753:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac413bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+7:11059:x1875336003353728:12345-192.168.206.5@tcp:101:lhsmtool_posix.0 Request processed in 637us (907us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460068.174761:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 41 00000100:00100000:2.0:1788460068.178818:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460068.178879:0:6545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003353856 00000100:00100000:0.0:1788460068.178889:0:6545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003353856 00000100:00100000:0.0:1788460068.178985:0:6545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 7 00000100:00100000:0.0:1788460068.178995:0:6545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc532b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+7:11059:x1875336003353856:12345-192.168.206.5@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1788460068.179065:0:6545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc532b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+7:11059:x1875336003353856:12345-192.168.206.5@tcp:900:lhsmtool_posix.0 Request processed in 72us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460068.179073:0:6545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 7 00000100:00100000:1.0:1788460068.189738:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460068.194837:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003354112 00000100:00100000:2.0:1788460068.194854:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003354112 00000100:00100000:2.0:1788460068.195000:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 42 00000100:00100000:2.0:1788460068.195011:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf76ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+7:11059:x1875336003354112:12345-192.168.206.5@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788460068.195035:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460068.195056:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542b177 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a5f8 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460068.195133:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b17e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460068.195148:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b17e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460068.195158:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b17e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460068.195206:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542b185 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460068.195225:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542b185 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460068.195232:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542b185 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460068.195347:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6a00/0x5dfa74784542b18c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460068.195370:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6a00/0x5dfa74784542b18c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460068.195377:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6a00/0x5dfa74784542b18c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788460068.195386:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1788460068.195466:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b17e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460068.195473:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b17e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460068.195480:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b17e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460068.195496:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bfadc7600 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:2.0:1788460068.195501:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b17e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460068.195508:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b17e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460068.195530:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8c4bc5dc1100) 00010000:00010000:2.0:1788460068.195533:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460068.195538:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b17e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460068.195545:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b17e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460068.195557:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542b185 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460068.195563:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542b185 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460068.195569:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542b185 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460068.195574:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bfadc7c00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:2.0:1788460068.195577:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542b185 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460068.195582:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542b185 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460068.195588:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8c4bef1fdc00) 00010000:00010000:2.0:1788460068.195590:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460068.195593:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542b185 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460068.195599:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542b185 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460068.195861:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542b177 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a5f8 expref: 10 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460068.195875:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6a00/0x5dfa74784542b18c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a5f8 expref: 9 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460068.195882:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c4bef1fde00) 00010000:00010000:2.0:1788460068.195884:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460068.195886:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bfadc6a00, rc 0) 00000100:00100000:2.0:1788460068.196006:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf76ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+9:11059:x1875336003354112:12345-192.168.206.5@tcp:101:lhsmtool_posix.0 Request processed in 994us (6273us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1788460068.196014:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 42 00000100:00100000:0.0:1788460068.215346:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460068.215442:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003354240 00000100:00100000:3.0:1788460068.215464:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003354240 00000100:00100000:3.0:1788460068.215520:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 43 00000100:00100000:3.0:1788460068.215531:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3a38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+9:11059:x1875336003354240:12345-192.168.206.5@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788460068.215644:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3a38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+9:11059:x1875336003354240:12345-192.168.206.5@tcp:59:lhsmtool_posix.0 Request processed in 114us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460068.215653:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 43 00000100:00100000:0.0:1788460068.225698:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460068.225831:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003354368 00000100:00100000:2.0:1788460068.225841:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003354368 00000100:00100000:2.0:1788460068.225912:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 44 00000100:00100000:2.0:1788460068.225922:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3a39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:11059:x1875336003354368:12345-192.168.206.5@tcp:59:lhsmtool_posix.0 00000100:00080000:0.0:1788460068.226154:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:2.0:1788460068.227582:0:6534:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 1591us 00000100:00100000:1.0:1788460068.253091:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3a39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:11059:x1875336003354368:12345-192.168.206.5@tcp:59:lhsmtool_posix.0 Request processed in 27160us (27391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460068.253105:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 44 00010000:00010000:3.0:1788460068.625288:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788460068.817618:0:13815:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1788460068.821393:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788460068.950783:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788460068.950802:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4138e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022326528:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788460068.950862:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460068.952558:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022326528 00000100:00100000:3.0:1788460068.952571:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022326528 00000100:00100000:3.0:1788460068.953117:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788460068.953128:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac413b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1875336022326528:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788460068.953160:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446453248 avail 1300213760 00000100:00100000:3.0:1788460068.953225:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac413b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3661:x1875336022326528:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (2363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460068.953232:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788460068.953288:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4138e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022326528:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788460069.457675:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788460069.457698:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf76ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022326656:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788460069.457792:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460069.459628:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022326656 00000100:00100000:1.0:1788460069.459655:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022326656 00000100:00100000:1.0:1788460069.459723:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788460069.459735:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf76ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022326656:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788460069.459776:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788460069.459844:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf76ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022326656:12345-0@lo:13:osp-pre-1-1.0 Request processed in 113us (2052us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460069.459852:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00010000:00080000:1.0:1788460069.459889:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bf76ece00 x1875336022326656/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460085 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460069.459907:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf76ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022326656:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788460069.460007:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788460069.460432:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4138000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875336022326912:0@lo:400:kworker.0 00000100:00100000:3.0:1788460069.460472:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460069.460514:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc532fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1875336022327424:0@lo:400:kworker.0 00000100:00100000:3.0:1788460069.460536:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460069.460558:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc532df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1875336022327936:0@lo:400:kworker.0 00000100:00100000:3.0:1788460069.460589:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460069.460613:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788460069.460618:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac36cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022327040:0@lo:400:kworker.0 00000100:00100000:3.0:1788460069.460661:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460069.460680:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc532c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022327552:0@lo:400:kworker.0 00000100:00100000:3.0:1788460069.460702:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460069.460718:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc532ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022328064:0@lo:400:kworker.0 00000100:00100000:3.0:1788460069.460735:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460069.460775:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022326912 00000100:00100000:3.0:1788460069.460781:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022326912 00000100:00100000:3.0:1788460069.460809:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022327424 00000100:00100000:3.0:1788460069.460813:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022327424 00000100:00100000:3.0:1788460069.460836:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022327936 00000100:00100000:3.0:1788460069.460838:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022327936 00000100:00100000:3.0:1788460069.460853:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788460069.460859:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc532ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1875336022326912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460069.460900:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc532ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1875336022326912:12345-0@lo:400:kworker.0 Request processed in 40us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460069.460908:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788460069.460923:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788460069.460929:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc532c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1875336022327424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460069.460985:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc532c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1875336022327424:12345-0@lo:400:kworker.0 Request processed in 56us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460069.460992:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788460069.461003:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1788460069.461009:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc532e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1875336022327936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460069.461044:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc532e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1875336022327936:12345-0@lo:400:kworker.0 Request processed in 36us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460069.461050:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1788460069.461072:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022327040 00000100:00100000:3.0:1788460069.461076:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022327040 00000100:00100000:3.0:1788460069.461096:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788460069.461102:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc532e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022327040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460069.461131:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc532e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022327040:12345-0@lo:400:kworker.0 Request processed in 30us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460069.461137:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788460069.461152:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022327552 00000100:00100000:3.0:1788460069.461156:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022327552 00000100:00100000:3.0:1788460069.461176:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022328064 00000100:00100000:3.0:1788460069.461179:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022328064 00000100:00100000:3.0:1788460069.461197:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788460069.461203:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc532f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022327552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460069.461245:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc532f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022327552:12345-0@lo:400:kworker.0 Request processed in 42us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460069.461251:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788460069.461262:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788460069.461268:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc532ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1875336022328064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460069.461295:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc532ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1875336022328064:12345-0@lo:400:kworker.0 Request processed in 27us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460069.461313:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:3.0:1788460069.461336:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788460069.461340:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788460069.461342:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788460069.461371:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac36cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022327040:0@lo:400:kworker.0 00000100:00100000:3.0:1788460069.461382:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc532c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022327552:0@lo:400:kworker.0 00010000:00080000:3.0:1788460069.461392:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bc532ce00 x1875336022328064/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788460085 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460069.461399:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc532ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022328064:0@lo:400:kworker.0 00000100:00100000:3.0:1788460069.461408:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4138000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875336022326912:0@lo:400:kworker.0 00010000:00080000:3.0:1788460069.461417:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bc532fb80 x1875336022327424/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460085 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460069.461424:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc532fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1875336022327424:0@lo:400:kworker.0 00010000:00080000:3.0:1788460069.461434:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bc532df80 x1875336022327936/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460085 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460069.461442:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc532df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1875336022327936:0@lo:400:kworker.0 00000100:00100000:1.0:1788460069.463522:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4138e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0cf73fe6-82e2-434e-b670-631647721b2c:3660:1875336022326784:0@lo:400:kworker.0 00000100:00100000:1.0:1788460069.463586:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460069.463630:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc532c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3660:1875336022327296:0@lo:400:kworker.0 00000100:00100000:1.0:1788460069.463660:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460069.463683:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc532f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3660:1875336022327808:0@lo:400:kworker.0 00000100:00100000:1.0:1788460069.463704:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460069.463728:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788460069.463735:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc532f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3660:1875336022327168:0@lo:400:kworker.0 00000100:00100000:1.0:1788460069.463769:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460069.463782:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc532dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022327680:0@lo:400:kworker.0 00000100:00100000:1.0:1788460069.463803:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460069.463820:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf76ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022328192:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788460069.463839:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460069.463868:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022327296 00000100:00100000:1.0:1788460069.463873:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022327296 00000100:00100000:1.0:1788460069.463922:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022327808 00000100:00100000:1.0:1788460069.463925:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022327808 00000100:00100000:1.0:1788460069.463934:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022327168 00000100:00100000:1.0:1788460069.463936:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022327168 00000100:00100000:1.0:1788460069.463966:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788460069.463974:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf76ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1875336022327296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460069.464017:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf76ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1875336022327296:12345-0@lo:400:kworker.0 Request processed in 44us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460069.464025:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788460069.464038:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788460069.464043:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf76ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1875336022327808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460069.464064:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf76ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1875336022327808:12345-0@lo:400:kworker.0 Request processed in 21us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460069.464069:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788460069.464077:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788460069.464082:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf76ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1875336022327168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460069.464100:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf76ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1875336022327168:12345-0@lo:400:kworker.0 Request processed in 19us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460069.464106:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788460069.464137:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022326784 00000100:00100000:1.0:1788460069.464141:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022326784 00000100:00100000:1.0:1788460069.464160:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 417 00000100:00100000:1.0:1788460069.464166:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+29:3660:x1875336022326784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460069.464189:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+29:3660:x1875336022326784:12345-0@lo:400:kworker.0 Request processed in 24us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460069.464194:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 417 00000100:00100000:1.0:1788460069.464219:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022328192 00000100:00100000:1.0:1788460069.464227:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022328192 00000100:00100000:1.0:1788460069.464259:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788460069.464264:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf76eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022328192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788460069.464277:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788460069.464304:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf76eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022328192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 39us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460069.464309:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:1.0:1788460069.464323:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788460069.464332:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022327680 00000100:00100000:1.0:1788460069.464334:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022327680 00000100:00100000:1.0:1788460069.464368:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788460069.464375:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf76ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022327680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460069.464401:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf76ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022327680:12345-0@lo:400:kworker.0 Request processed in 27us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460069.464406:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:1.0:1788460069.464418:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788460069.464441:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc532f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3660:1875336022327168:0@lo:400:kworker.0 00000100:00100000:1.0:1788460069.464450:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc532dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022327680:0@lo:400:kworker.0 00010000:00080000:1.0:1788460069.464461:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bf76ece00 x1875336022328192/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460085 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460069.464475:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf76ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022328192:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788460069.464482:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4138e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0cf73fe6-82e2-434e-b670-631647721b2c:3660:1875336022326784:0@lo:400:kworker.0 00000100:00100000:1.0:1788460069.464490:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc532c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3660:1875336022327296:0@lo:400:kworker.0 00000100:00100000:1.0:1788460069.464498:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc532f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3660:1875336022327808:0@lo:400:kworker.0 00010000:00010000:3.0:1788460069.650813:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460069.822376:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460069.822466:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460069.822993:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460069.823019:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460069.823345:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003354624 00000100:00100000:0.0:1788460069.823355:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003354624 00000100:00100000:0.0:1788460069.823406:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003354880 00000100:00100000:0.0:1788460069.823409:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003354880 00000100:00100000:0.0:1788460069.823440:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 270 00000100:00100000:0.0:1788460069.823560:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc532df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+9:2395:x1875336003354624:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:0.0:1788460069.823642:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc532df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+9:2395:x1875336003354624:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 86us (1276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460069.823649:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 270 00000100:00100000:0.0:1788460069.823668:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 271 00000100:00100000:0.0:1788460069.823674:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc532fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a5915a6d-4114-41fb-8d95-33add86e0720+5:2395:x1875336003354880:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:0.0:1788460069.823697:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc532fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a5915a6d-4114-41fb-8d95-33add86e0720+5:2395:x1875336003354880:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 24us (1231us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460069.823703:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 271 00000100:00080000:0.0:1788460069.823726:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788460069.825157:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003354496 00000100:00100000:0.0:1788460069.825839:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003354752 00000100:00100000:0.0:1788460069.825848:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003354752 00000100:00100000:0.0:1788460069.825894:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 272 00000100:00100000:0.0:1788460069.825903:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc532ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2395:x1875336003354752:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:3.0:1788460069.826309:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003354496 00000100:00100000:3.0:1788460069.826383:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 418 00000100:00100000:3.0:1788460069.826391:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bed032f6-c389-485e-b2f7-e2ea34763c65+14:2395:x1875336003354496:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:0.0:1788460069.826518:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc532ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2395:x1875336003354752:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 616us (3497us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460069.826526:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 272 00000100:00100000:2.0:1788460069.833086:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bed032f6-c389-485e-b2f7-e2ea34763c65+14:2395:x1875336003354496:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 6686us (10085us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460069.833099:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 418 00000100:00100000:0.0:1788460069.834615:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460069.837863:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003355008 00000100:00100000:2.0:1788460069.837878:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003355008 00000100:00100000:2.0:1788460069.838110:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 273 00000100:00100000:2.0:1788460069.838123:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3a3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a5915a6d-4114-41fb-8d95-33add86e0720+5:2395:x1875336003355008:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:2.0:1788460069.838301:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3a3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a5915a6d-4114-41fb-8d95-33add86e0720+5:2395:x1875336003355008:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 180us (3690us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460069.838309:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 273 00000100:00080000:0.0:1788460069.841350:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788460070.421323:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460070.422063:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003355136 00000100:00100000:2.0:1788460070.422084:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003355136 00000100:00100000:2.0:1788460070.422321:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 45 00000100:00100000:2.0:1788460070.422332:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3a38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+9:11101:x1875336003355136:12345-192.168.206.5@tcp:101:lfs.0 00010000:00010000:2.0:1788460070.422351:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460070.422396:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542b19a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a5ff expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460070.422471:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b1a1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460070.422485:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b1a1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460070.422498:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b1a1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460070.422514:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b1a8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460070.422522:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b1a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460070.422529:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b1a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460070.422596:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b1a1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460070.422613:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b1a1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460070.422619:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b1a1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460070.422626:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bfadc7200 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:2.0:1788460070.422630:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b1a1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460070.422637:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b1a1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460070.422648:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4bef200900) 00010000:00010000:2.0:1788460070.422651:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460070.422655:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b1a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460070.422660:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b1a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460070.422673:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b1a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460070.422679:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b1a8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460070.422685:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b1a8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460070.422690:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bfadc6400 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:2.0:1788460070.422700:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b1a8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460070.422706:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b1a8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460070.422714:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8c4bfa9fe100) 00010000:00010000:2.0:1788460070.422716:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460070.422719:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b1a8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460070.422724:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b1a8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460070.422766:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542b19a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a5ff expref: 10 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460070.422777:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4bef200900) 00010000:00010000:2.0:1788460070.422779:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460070.422782:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542b19a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a5ff expref: 10 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460070.422792:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bfadc7400, rc 0) 00000100:00100000:2.0:1788460070.422850:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3a38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+9:11101:x1875336003355136:12345-192.168.206.5@tcp:101:lfs.0 Request processed in 519us (1534us total) trans 0 rc 301/301 00000100:00100000:2.0:1788460070.423962:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 45 00000100:00080000:3.0:1788460070.424450:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788460070.431939:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460070.432068:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003355392 00000100:00100000:1.0:1788460070.432083:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003355392 00000100:00100000:1.0:1788460070.432136:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 46 00000100:00100000:1.0:1788460070.432145:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc532c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+9:11101:x1875336003355392:12345-192.168.206.5@tcp:36:lfs.0 00010000:00010000:1.0:1788460070.432192:0:13560:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788460070.432216:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840000/0x5dfa74784542b154 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a5ea expref: 9 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460070.432234:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4bef200900) 00010000:00010000:1.0:1788460070.432244:0:13560:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788460070.432300:0:13560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677a00/0x5dfa74784542b1af lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460070.432314:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677a00/0x5dfa74784542b1af lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460070.432324:0:13560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677a00/0x5dfa74784542b1af lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460070.432337:0:13560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676200/0x5dfa74784542b1b6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460070.432345:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676200/0x5dfa74784542b1b6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460070.432352:0:13560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676200/0x5dfa74784542b1b6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460070.432905:0:13560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677c00/0x5dfa74784542b1bd lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460070.432927:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677c00/0x5dfa74784542b1bd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460070.432935:0:13560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677c00/0x5dfa74784542b1bd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788460070.432977:0:13560:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cb0bc16a reply state 000000003e4a7bb0 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677c00/0x5dfa74784542b1bd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460070.432988:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677c00/0x5dfa74784542b1bd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460070.432995:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8c4bc2ab7100) 00010000:00010000:1.0:1788460070.432998:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788460070.433001:0:13560:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788460070.433005:0:13560:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1788460070.433012:0:13560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677a00/0x5dfa74784542b1af lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460070.433019:0:13560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677a00/0x5dfa74784542b1af lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460070.433025:0:13560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677a00/0x5dfa74784542b1af lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460070.433031:0:13560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac3677a00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:1.0:1788460070.433036:0:13560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677a00/0x5dfa74784542b1af lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460070.433044:0:13560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677a00/0x5dfa74784542b1af lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460070.433062:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4bc2ab7900) 00010000:00010000:1.0:1788460070.433065:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788460070.433068:0:13560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677a00/0x5dfa74784542b1af lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460070.433074:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677a00/0x5dfa74784542b1af lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788460070.433088:0:13560:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cb0bc16a reply state 000000003e4a7bb0 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676200/0x5dfa74784542b1b6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460070.433096:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676200/0x5dfa74784542b1b6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460070.433102:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8c4bc2ab7800) 00010000:00010000:1.0:1788460070.433104:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788460070.433106:0:13560:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1788460070.433219:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc532c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+10:11101:x1875336003355392:12345-192.168.206.5@tcp:36:lfs.0 Request processed in 1072us (1287us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1788460070.433228:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 46 00000100:00100000:2.0:1788460070.521185:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460070.521248:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003355520 00000100:00100000:0.0:1788460070.521257:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003355520 00000100:00100000:0.0:1788460070.521316:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 47 00000100:00100000:0.0:1788460070.521327:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc532ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+10:11109:x1875336003355520:12345-192.168.206.5@tcp:101:lctl.0 00010000:00010000:0.0:1788460070.521349:0:7760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460070.521502:0:7760:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0a00/0x5dfa74784542b1c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a606 expref: -99 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460070.521569:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d1e00/0x5dfa74784542b1cb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460070.521583:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d1e00/0x5dfa74784542b1cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460070.521593:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d1e00/0x5dfa74784542b1cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788460070.521631:0:7760:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788460070.521634:0:7760:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788460070.521666:0:7760:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d1e00/0x5dfa74784542b1cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460070.521688:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0a00/0x5dfa74784542b1c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a606 expref: 12 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460070.521704:0:7760:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d1e00/0x5dfa74784542b1cb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a606 expref: 11 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460070.521712:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4bc5dc1900) 00010000:00010000:0.0:1788460070.521714:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788460070.521717:0:7760:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc29d1e00, rc 0) 00000100:00100000:0.0:1788460070.521782:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc532ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+11:11109:x1875336003355520:12345-192.168.206.5@tcp:101:lctl.0 Request processed in 457us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460070.521789:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 47 00000100:00100000:3.0:1788460070.610504:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460070.610644:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003355648 00000100:00100000:2.0:1788460070.610654:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003355648 00000100:00100000:2.0:1788460070.610715:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 48 00000100:00100000:2.0:1788460070.610742:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc532d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+11:11115:x1875336003355648:12345-192.168.206.5@tcp:101:bash.0 00010000:00010000:2.0:1788460070.610762:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460070.610781:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542b1d2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a60d expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460070.610838:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b1d9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460070.610852:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b1d9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460070.611180:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b1d9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460070.611411:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677a00/0x5dfa74784542b1e0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460070.611422:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677a00/0x5dfa74784542b1e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460070.611429:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677a00/0x5dfa74784542b1e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460070.611505:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677600/0x5dfa74784542b1e7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460070.611521:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677600/0x5dfa74784542b1e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460070.611528:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677600/0x5dfa74784542b1e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788460070.611562:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1788460070.611567:0:6533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788460070.611603:0:6533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677600/0x5dfa74784542b1e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460070.611614:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b1d9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460070.611620:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b1d9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460070.611626:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b1d9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460070.611632:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bfadc6400 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:1.0:1788460070.611635:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b1d9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460070.611642:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b1d9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460070.611652:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4bc5dc1900) 00010000:00010000:1.0:1788460070.611655:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788460070.611659:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b1d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460070.611674:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b1d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460070.611687:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677a00/0x5dfa74784542b1e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460070.611693:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677a00/0x5dfa74784542b1e0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460070.611698:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677a00/0x5dfa74784542b1e0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460070.611703:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac3677a00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:1.0:1788460070.611706:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677a00/0x5dfa74784542b1e0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460070.611713:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677a00/0x5dfa74784542b1e0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460070.611721:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8c4bc2ab7800) 00010000:00010000:1.0:1788460070.611723:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788460070.611726:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677a00/0x5dfa74784542b1e0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460070.611744:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677a00/0x5dfa74784542b1e0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460070.611773:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542b1d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a60d expref: 13 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460070.611786:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677600/0x5dfa74784542b1e7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a60d expref: 12 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460070.611801:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8c4bc2ab7100) 00010000:00010000:1.0:1788460070.611803:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788460070.611806:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ac3677600, rc 0) 00000100:00100000:1.0:1788460070.612033:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc532d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+12:11115:x1875336003355648:12345-192.168.206.5@tcp:101:bash.0 Request processed in 1213us (1446us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460070.612042:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 48 00000100:00100000:2.0:1788460070.618450:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460070.618537:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003355904 00000100:00100000:3.0:1788460070.618546:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003355904 00000100:00100000:3.0:1788460070.618601:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 49 00000100:00100000:3.0:1788460070.618610:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc5329500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+12:11115:x1875336003355904:12345-192.168.206.5@tcp:101:bash.0 00010000:00010000:3.0:1788460070.618633:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460070.618654:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841800/0x5dfa74784542b1ee lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a614 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460070.618780:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841600/0x5dfa74784542b1f5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460070.618795:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841600/0x5dfa74784542b1f5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460070.618806:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841600/0x5dfa74784542b1f5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460070.619150:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841400/0x5dfa74784542b1fc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460070.619161:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841400/0x5dfa74784542b1fc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460070.619168:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841400/0x5dfa74784542b1fc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788460070.619656:0:6535:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:3.0:1788460070.619810:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841200/0x5dfa74784542b203 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460070.619821:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841200/0x5dfa74784542b203 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460070.619842:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841200/0x5dfa74784542b203 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460070.620431:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841600/0x5dfa74784542b1f5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460070.620440:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841600/0x5dfa74784542b1f5 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460070.620446:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841600/0x5dfa74784542b1f5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460070.620451:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac2841600 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:3.0:1788460070.620455:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841600/0x5dfa74784542b1f5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460070.620461:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841600/0x5dfa74784542b1f5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460070.620473:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8c4bc2ab7100) 00010000:00010000:3.0:1788460070.620476:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460070.620480:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841600/0x5dfa74784542b1f5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460070.620485:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841600/0x5dfa74784542b1f5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788460070.620498:0:6535:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004719cb12 reply state 0000000062a753df transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841400/0x5dfa74784542b1fc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460070.620509:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841400/0x5dfa74784542b1fc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460070.620523:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8c4bef1ffb00) 00010000:00010000:3.0:1788460070.620525:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788460070.620528:0:6535:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788460070.620565:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841800/0x5dfa74784542b1ee lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a614 expref: 15 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460070.620580:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841200/0x5dfa74784542b203 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a614 expref: 14 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460070.620587:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4bef1ff000) 00010000:00010000:3.0:1788460070.620589:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788460070.620592:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ac2841200, rc 0) 00000100:00100000:3.0:1788460070.620663:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc5329500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+15:11115:x1875336003355904:12345-192.168.206.5@tcp:101:bash.0 Request processed in 2054us (2222us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1788460070.620672:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 49 00000100:00100000:2.0:1788460070.628038:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460070.628202:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003356032 00000100:00100000:3.0:1788460070.628212:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003356032 00000100:00100000:3.0:1788460070.628270:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 28 00000100:00100000:3.0:1788460070.628278:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc5329880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2392:x1875336003356032:12345-192.168.206.5@tcp:8:bash.0 00010000:00080000:3.0:1788460070.628311:0:8448:0:(ldlm_lib.c:1461:target_handle_connect()) lustre-OST0001: connection from f8767d3e-bfef-4d3d-8163-ef8ae18a3514@192.168.206.5@tcp t0 exp 0000000000000000 cur 367 last 0 00000020:00000080:3.0:1788460070.628338:0:8448:0:(genops.c:1385:class_connect()) connect: client f8767d3e-bfef-4d3d-8163-ef8ae18a3514, cookie 0x5dfa74784542b211 00002000:00100000:3.0:1788460070.628349:0:8448:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f8767d3e-bfef-4d3d-8163-ef8ae18a3514/ffff8c4ac41f2000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a07 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788460070.628401:0:8448:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788460070.628477:0:8448:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788460070.628508:0:8448:0:(import.c:65:import_set_state_nolock()) ffff8c4ac41f0800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788460070.628592:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc5329880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:2392:x1875336003356032:12345-192.168.206.5@tcp:8:bash.0 Request processed in 312us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460070.628601:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 28 00000100:00100000:0.0:1788460070.632395:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460070.632787:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003356160 00000100:00100000:1.0:1788460070.632797:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003356160 00000100:00080000:3.0:1788460070.632973:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788460070.634052:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 29 00000100:00100000:1.0:1788460070.634079:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:0:x1875336003356160:12345-192.168.206.5@tcp:101:bash.0 00010000:00010000:1.0:1788460070.634099:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460070.634121:0:8449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007e1afeb8/0x5dfa74784542b218 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a61b expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788460070.634144:0:8449:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788460070.634162:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=367s v=(0 0) 00010000:00010000:1.0:1788460070.634167:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460070.634175:0:8449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007e1afeb8/0x5dfa74784542b218 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a61b expref: 7 pid: 8449 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460070.634195:0:8449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007e1afeb8/0x5dfa74784542b218 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a61b expref: 7 pid: 8449 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460070.634207:0:8449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ac3677800, rc 0) 00000100:00100000:1.0:1788460070.634273:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+7:0:x1875336003356160:12345-192.168.206.5@tcp:101:bash.0 Request processed in 210us (1958us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460070.634291:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 29 00000100:00100000:1.0:1788460070.643126:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460070.643264:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003356288 00000100:00100000:3.0:1788460070.643275:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003356288 00000100:00100000:3.0:1788460070.643330:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 30 00000100:00100000:3.0:1788460070.643340:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf76ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+7:11115:x1875336003356288:12345-192.168.206.5@tcp:101:bash.0 00010000:00010000:3.0:1788460070.643357:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460070.643378:0:8448:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f3e22ec4/0x5dfa74784542b21f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a622 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460070.643409:0:8448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007e1afeb8/0x5dfa74784542b218 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a61b expref: 8 pid: 8449 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460070.643419:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788460070.643423:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788460070.643428:0:8448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3e22ec4/0x5dfa74784542b21f lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a622 expref: 8 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460070.643460:0:8448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007e1afeb8/0x5dfa74784542b218 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a61b expref: 8 pid: 8449 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460070.643474:0:8448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007e1afeb8/0x5dfa74784542b218 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a61b expref: 8 pid: 8449 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460070.643488:0:8448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc532d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8448:1875336022328320:192.168.206.5@tcp:104: 00000100:00100000:3.0:1788460070.643598:0:8448:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac28b4c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788460070.647463:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460070.647663:0:8448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc532d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8448:1875336022328320:192.168.206.5@tcp:104: 00010000:00010000:3.0:1788460070.647695:0:8448:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f3e22ec4/0x5dfa74784542b21f lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a622 expref: 8 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460070.647714:0:8448:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ac2841800, rc 0) 00000100:00100000:3.0:1788460070.647787:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf76ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+8:11115:x1875336003356288:12345-192.168.206.5@tcp:101:bash.0 Request processed in 4448us (4668us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460070.647796:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 30 00000100:00100000:2.0:1788460070.648309:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003356416 00000100:00100000:2.0:1788460070.648318:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003356416 00010000:00010000:2.0:1788460070.648351:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007e1afeb8/0x5dfa74784542b218 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a61b expref: 8 pid: 8449 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460070.648382:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 60 00000100:00100000:2.0:1788460070.648392:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3a38000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+8:2393:x1875336003356416:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788460070.648406:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460070.648426:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007e1afeb8/0x5dfa74784542b218 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a61b expref: 8 pid: 8449 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460070.648440:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007e1afeb8/0x5dfa74784542b218 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a61b expref: 8 pid: 8449 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460070.648476:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007e1afeb8/0x5dfa74784542b218 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a61b expref: 8 pid: 8449 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460070.648491:0:6518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788460070.648495:0:6518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788460070.648504:0:6518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f3e22ec4/0x5dfa74784542b21f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a622 expref: 7 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460070.648514:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3e22ec4/0x5dfa74784542b21f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a622 expref: 7 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460070.648544:0:6518:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f3e22ec4/0x5dfa74784542b21f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a622 expref: 7 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460070.648557:0:6518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc5328a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6518:1875336022328448:192.168.206.5@tcp:105: 00000100:00100000:2.0:1788460070.648624:0:6518:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bfa392a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788460070.659186:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460070.660579:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003356672 00000100:00100000:3.0:1788460070.660590:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003356672 00000100:00100000:3.0:1788460070.660646:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 6 00000100:00100000:3.0:1788460070.660661:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3a39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+15:11115:x1875336003356672:12345-192.168.206.5@tcp:35:bash.0 00000100:00100000:3.0:1788460070.660919:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3a39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+16:11115:x1875336003356672:12345-192.168.206.5@tcp:35:bash.0 Request processed in 265us (1742us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1788460070.660927:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 6 00000100:00100000:2.0:1788460070.662042:0:6518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc5328a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6518:1875336022328448:192.168.206.5@tcp:105: 00010000:00010000:2.0:1788460070.662065:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788460070.662122:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3a38000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+7:2393:x1875336003356416:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 13731us (14666us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460070.662131:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 60 00010000:00010000:2.0:1788460070.673099:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788460070.760614:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460070.760871:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003356928 00000100:00100000:2.0:1788460070.760882:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003356928 00000100:00100000:2.0:1788460070.760992:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 50 00000100:00100000:2.0:1788460070.761001:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3a3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+16:11125:x1875336003356928:12345-192.168.206.5@tcp:101:lfs.0 00010000:00010000:2.0:1788460070.761025:0:7760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460070.761045:0:7760:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542b226 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a629 expref: -99 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788460070.761148:0:7760:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1788460070.761241:0:7760:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542b226 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a629 expref: 18 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460070.761254:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4bc5dc1900) 00010000:00010000:2.0:1788460070.761257:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788460070.761262:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542b226 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a629 expref: 18 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460070.761275:0:7760:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bfadc7400, rc 0) 00000100:00100000:2.0:1788460070.761336:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3a3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+17:11125:x1875336003356928:12345-192.168.206.5@tcp:101:lfs.0 Request processed in 336us (731us total) trans 4294967315 rc 301/301 00000100:00100000:2.0:1788460070.761344:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 50 00000100:00100000:1.0:1788460070.765391:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460070.765529:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003357184 00000100:00100000:3.0:1788460070.765539:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003357184 00000100:00100000:3.0:1788460070.765592:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 7 00000100:00100000:3.0:1788460070.765602:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac39d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+17:11125:x1875336003357184:12345-192.168.206.5@tcp:35:lfs.0 00000100:00100000:3.0:1788460070.765842:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac39d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+18:11125:x1875336003357184:12345-192.168.206.5@tcp:35:lfs.0 Request processed in 241us (458us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1788460070.765850:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 7 00000100:00100000:3.0:1788460070.873516:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460070.873820:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003357312 00000100:00100000:1.0:1788460070.873831:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003357312 00000100:00100000:1.0:1788460070.873895:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 51 00000100:00100000:1.0:1788460070.873906:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc532d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+18:11131:x1875336003357312:12345-192.168.206.5@tcp:101:lfs.0 00010000:00010000:1.0:1788460070.873929:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460070.873975:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676000/0x5dfa74784542b234 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a630 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460070.874056:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676e00/0x5dfa74784542b23b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460070.874071:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676e00/0x5dfa74784542b23b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460070.874094:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676e00/0x5dfa74784542b23b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788460070.874135:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1788460070.874139:0:6533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788460070.874158:0:6533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676e00/0x5dfa74784542b23b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460070.874182:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676000/0x5dfa74784542b234 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a630 expref: 20 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460070.874199:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676e00/0x5dfa74784542b23b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a630 expref: 19 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460070.874214:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8c4bc2ab7100) 00010000:00010000:1.0:1788460070.874217:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788460070.874220:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ac3676e00, rc 0) 00000100:00100000:1.0:1788460070.874285:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc532d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+19:11131:x1875336003357312:12345-192.168.206.5@tcp:101:lfs.0 Request processed in 380us (776us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460070.874292:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 51 00000100:00100000:2.0:1788460070.879621:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460070.879872:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003357568 00000100:00100000:3.0:1788460070.879890:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003357568 00000100:00100000:3.0:1788460070.879975:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 52 00000100:00100000:3.0:1788460070.879985:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc5328a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+19:11131:x1875336003357568:12345-192.168.206.5@tcp:101:lfs.0 00010000:00010000:3.0:1788460070.880004:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460070.880023:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841600/0x5dfa74784542b242 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a637 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460070.880131:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840400/0x5dfa74784542b249 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460070.880145:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840400/0x5dfa74784542b249 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460070.880156:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840400/0x5dfa74784542b249 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788460070.880166:0:6535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788460070.880263:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841600/0x5dfa74784542b242 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a637 expref: 22 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460070.880281:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840400/0x5dfa74784542b249 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a637 expref: 21 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460070.880289:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4bef1ff000) 00010000:00010000:3.0:1788460070.880291:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788460070.880294:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ac2840400, rc 0) 00000100:00100000:3.0:1788460070.880354:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc5328a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+21:11131:x1875336003357568:12345-192.168.206.5@tcp:101:lfs.0 Request processed in 370us (752us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1788460070.880361:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 52 00000100:00100000:0.0:1788460070.898706:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460070.899015:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003357824 00000100:00100000:1.0:1788460070.899025:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003357824 00000100:00100000:1.0:1788460070.899091:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 53 00000100:00100000:1.0:1788460070.899102:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3a39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+21:11131:x1875336003357824:12345-192.168.206.5@tcp:101:lfs.0 00010000:00010000:1.0:1788460070.899128:0:13560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460070.899148:0:13560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676a00/0x5dfa74784542b257 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a63e expref: -99 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460070.899249:0:13560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677a00/0x5dfa74784542b25e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460070.899263:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677a00/0x5dfa74784542b25e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460070.899276:0:13560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677a00/0x5dfa74784542b25e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788460070.899287:0:13560:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788460070.899381:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676a00/0x5dfa74784542b257 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a63e expref: 24 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460070.899415:0:13560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677a00/0x5dfa74784542b25e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a63e expref: 23 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460070.899423:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4bef1ff000) 00010000:00010000:1.0:1788460070.899425:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788460070.899428:0:13560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ac3677a00, rc 0) 00000100:00100000:1.0:1788460070.899489:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3a39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+23:11131:x1875336003357824:12345-192.168.206.5@tcp:101:lfs.0 Request processed in 390us (792us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1788460070.899496:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 53 00000100:00100000:1.0:1788460070.900362:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460070.900426:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003357952 00000100:00100000:2.0:1788460070.900433:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003357952 00000100:00100000:2.0:1788460070.900481:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 1 00000100:00100000:2.0:1788460070.900490:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bedf6d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+23:2393:x1875336003357952:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788460070.900501:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460070.900518:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840400/0x5dfa74784542b249 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a637 expref: 23 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460070.900547:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4bef1ff000) 00010000:00010000:2.0:1788460070.900551:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788460070.900596:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bedf6d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+22:2393:x1875336003357952:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 107us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460070.900603:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 1 00000100:00100000:2.0:1788460070.921172:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460070.921337:0:8832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003358080 00000100:00100000:3.0:1788460070.921347:0:8832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003358080 00000100:00100000:3.0:1788460070.921417:0:8832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 31 00000100:00100000:3.0:1788460070.921427:0:8832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc5329180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+7:2394:x1875336003358080:12345-192.168.206.5@tcp:1:lfs.0 00010000:00010000:3.0:1788460070.921469:0:8832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6236f5e/0x5dfa74784542b26c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460070.921488:0:8832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f3e22ec4/0x5dfa74784542b21f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a622 expref: 7 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460070.921497:0:8832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788460070.921501:0:8832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788460070.921505:0:8832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6236f5e/0x5dfa74784542b26c lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460070.921541:0:8832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f3e22ec4/0x5dfa74784542b21f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a622 expref: 7 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460070.921560:0:8832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f3e22ec4/0x5dfa74784542b21f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a622 expref: 7 pid: 8448 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460070.921575:0:8832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc532ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8832:1875336022328576:192.168.206.5@tcp:104: 00000100:00100000:3.0:1788460070.921678:0:8832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac28b46c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788460070.925607:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460070.926219:0:8832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc532ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8832:1875336022328576:192.168.206.5@tcp:104: 00010000:00010000:2.0:1788460070.926247:0:8832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e6236f5e/0x5dfa74784542b26c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460070.929496:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003358208 00000100:00100000:0.0:1788460070.929510:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003358208 00002000:00100000:0.0:1788460070.929560:0:8453:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff8c4bc532d180 x1875336003358208/t0(0) o4->f8767d3e-bfef-4d3d-8163-ef8ae18a3514@192.168.206.5@tcp:226/0 lens 504/0 e 0 to 0 dl 1788460081 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788460070.929571:0:8453:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c4bc532d180 with x1875336003358208 ext(0->12) 00010000:00010000:0.0:1788460070.929581:0:8453:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f3e22ec4/0x5dfa74784542b21f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a622 expref: 8 pid: 8448 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460070.929598:0:8453:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f3e22ec4/0x5dfa74784542b21f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a622 expref: 8 pid: 8448 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788460070.929606:0:8453:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8c4bc532d180 00000100:00100000:0.0:1788460070.929768:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 0 00000100:00100000:0.0:1788460070.929779:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc532d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+8:2394:x1875336003358208:12345-192.168.206.5@tcp:4:lfs.0 00000001:00100000:3.0:1788460070.933056:0:9527:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f8767d3e-bfef-4d3d-8163-ef8ae18a3514 00000100:00100000:0.0:1788460070.933795:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc532d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+9:2394:x1875336003358208:12345-192.168.206.5@tcp:4:lfs.0 Request processed in 4011us (8190us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788460070.933807:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 0 00002000:00100000:0.0:1788460070.933818:0:8453:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff8c4bc532d180 x1875336003358208/t4294967300(0) o4->f8767d3e-bfef-4d3d-8163-ef8ae18a3514@192.168.206.5@tcp:226/0 lens 504/448 e 0 to 0 dl 1788460081 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788460070.933829:0:8453:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c4bc532d180 with x1875336003358208 ext(0->12) 00010000:00010000:0.0:1788460070.933839:0:8453:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f3e22ec4/0x5dfa74784542b21f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a622 expref: 9 pid: 8448 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460070.934060:0:8453:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f3e22ec4/0x5dfa74784542b21f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a622 expref: 9 pid: 8448 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788460070.934069:0:8453:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8c4bc532d180 00000100:00100000:2.0:1788460070.942231:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460070.950871:0:9549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003358336 00000100:00100000:0.0:1788460070.950886:0:9549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003358336 00010000:00010000:0.0:1788460070.951061:0:9549:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f3e22ec4/0x5dfa74784542b21f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a622 expref: 9 pid: 8448 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460070.951118:0:9549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 61 00000100:00100000:0.0:1788460070.951128:0:9549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc532b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+9:2396:x1875336003358336:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788460070.951145:0:9549:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788460070.951284:0:9549:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788460070.951288:0:9549:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1788460069 00002000:00010000:0.0:1788460070.951290:0:9549:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb atime from disk: 0 -> 1788460069 00002000:00010000:0.0:1788460070.951293:0:9549:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1788460069 00002000:00010000:0.0:1788460070.951295:0:9549:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1788460070.951302:0:9549:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f3e22ec4/0x5dfa74784542b21f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a622 expref: 9 pid: 8448 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460070.951316:0:9549:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f3e22ec4/0x5dfa74784542b21f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a622 expref: 9 pid: 8448 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460070.951344:0:9549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f3e22ec4/0x5dfa74784542b21f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a622 expref: 9 pid: 8448 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460070.951379:0:9549:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788460070.951384:0:9549:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788460070.951390:0:9549:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e6236f5e/0x5dfa74784542b26c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460070.951399:0:9549:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6236f5e/0x5dfa74784542b26c lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460070.951434:0:9549:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788460070.951492:0:9549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc532b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+8:2396:x1875336003358336:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 365us (9338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460070.951500:0:9549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 61 00010000:00010000:2.0:1788460070.951593:0:8832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e6236f5e/0x5dfa74784542b26c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460070.951602:0:8832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e6236f5e/0x5dfa74784542b26c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460070.951622:0:8832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6236f5e/0x5dfa74784542b26c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460070.951630:0:8832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e6236f5e/0x5dfa74784542b26c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460070.951638:0:8832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e6236f5e/0x5dfa74784542b26c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460070.951666:0:8832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac2841600 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:2.0:1788460070.951670:0:8832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6236f5e/0x5dfa74784542b26c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460070.951679:0:8832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6236f5e/0x5dfa74784542b26c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460070.951691:0:8832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e6236f5e/0x5dfa74784542b26c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460070.951699:0:8832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6236f5e/0x5dfa74784542b26c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460070.951761:0:8832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc5329180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+7:2394:x1875336003358080:12345-192.168.206.5@tcp:1:lfs.0 Request processed in 30335us (30605us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460070.951769:0:8832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 31 00000100:00100000:2.0:1788460070.956638:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460070.956774:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003358592 00000100:00100000:0.0:1788460070.956784:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003358592 00000100:00100000:0.0:1788460070.956838:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 8 00000100:00100000:0.0:1788460070.956848:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc5328380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+22:11131:x1875336003358592:12345-192.168.206.5@tcp:35:lfs.0 00000004:00010000:0.0:1788460070.956919:0:6537:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677a00/0x5dfa74784542b25e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a63e expref: 22 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788460070.957194:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:0.0:1788460070.957238:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1788460070.957502:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:0.0:1788460070.957536:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0a00/0x5dfa74784542b273 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460070.957552:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841200/0x5dfa74784542b203 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a614 expref: 26 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460070.957569:0:6537:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0a00/0x5dfa74784542b273 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460070.957601:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841200/0x5dfa74784542b203 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a614 expref: 26 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460070.957616:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841200/0x5dfa74784542b203 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a614 expref: 26 pid: 6535 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460070.957631:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3a38e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6537:1875336022328704:192.168.206.5@tcp:104: 00000100:00100000:0.0:1788460070.957723:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc4d56a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788460070.961772:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460070.961874:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003358720 00000100:00100000:2.0:1788460070.961883:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003358720 00010000:00010000:2.0:1788460070.961920:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841200/0x5dfa74784542b203 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a614 expref: 27 pid: 6535 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460070.961992:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 62 00000100:00100000:2.0:1788460070.962002:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac39d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+27:2393:x1875336003358720:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788460070.962020:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460070.962038:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841200/0x5dfa74784542b203 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a614 expref: 27 pid: 6535 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460070.962052:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841200/0x5dfa74784542b203 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a614 expref: 27 pid: 6535 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460070.962081:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4bef1ff000) 00010000:00010000:2.0:1788460070.962086:0:6518:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0a00/0x5dfa74784542b273 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460070.962096:0:6518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0a00/0x5dfa74784542b273 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460070.962104:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0a00/0x5dfa74784542b273 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460070.962122:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788460070.962297:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac39d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+27:2393:x1875336003358720:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 296us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460070.962305:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 62 00010000:00010000:0.0:1788460070.962473:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841200/0x5dfa74784542b203 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a614 expref: 26 pid: 6535 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460070.962490:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3a38e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6537:1875336022328704:192.168.206.5@tcp:104: 00010000:00010000:0.0:1788460070.962512:0:6537:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0a00/0x5dfa74784542b273 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460070.962520:0:6537:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0a00/0x5dfa74784542b273 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460070.962526:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0a00/0x5dfa74784542b273 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788460070.962623:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:0.0:1788460070.962771:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:0.0:1788460070.962854:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3a38e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6537:1875336022328832:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788460070.962912:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460070.962977:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc4d56780 going to sleep for 11 seconds 00000100:00100000:2.0:1788460070.963518:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022328832 00000100:00100000:2.0:1788460070.963526:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022328832 00000100:00100000:2.0:1788460070.963572:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788460070.963581:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3a38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6537:x1875336022328832:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788460070.963675:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3a38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6537:x1875336022328832:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 95us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460070.963683:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788460070.963894:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3a38e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6537:1875336022328832:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788460070.964230:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:3.0:1788460070.964288:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc532ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6537:1875336022328960:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788460070.964320:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460070.964344:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac28b4c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788460070.964615:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022328960 00000100:00100000:2.0:1788460070.964621:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022328960 00000100:00100000:2.0:1788460070.964771:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788460070.964780:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc532f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6537:x1875336022328960:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788460070.964901:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc532f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6537:x1875336022328960:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 121us (578us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788460070.964908:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788460070.964999:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc532ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6537:1875336022328960:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788460070.965041:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:3.0:1788460070.965444:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0a00/0x5dfa74784542b273 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460070.965455:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0a00/0x5dfa74784542b273 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460070.965461:0:6537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0a00/0x5dfa74784542b273 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460070.965467:0:6537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc29d0a00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:3.0:1788460070.965471:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0a00/0x5dfa74784542b273 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460070.965478:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0a00/0x5dfa74784542b273 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460070.965492:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4bef1ff000) 00010000:00010000:3.0:1788460070.965494:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788460070.965499:0:6537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0a00/0x5dfa74784542b273 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460070.965505:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0a00/0x5dfa74784542b273 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788460070.965604:0:6537:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788460070.965920:0:6537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1788460070.966576:0:6537:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 368069630461ns, next at 369069339715ns, rc = 0 00000001:00080000:2.0:1788460070.966595:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:2.0:1788460070.966640:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4bef1ff000) 00010000:00010000:2.0:1788460070.966643:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788460070.966918:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677a00/0x5dfa74784542b25e lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a63e expref: 30 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460070.967603:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc5328380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+29:11131:x1875336003358592:12345-192.168.206.5@tcp:35:lfs.0 Request processed in 10754us (10970us total) trans 4294967327 rc 0/0 00000100:00100000:2.0:1788460070.967612:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 8 00000020:00080000:2.0:1788460070.967618:0:6537:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788460070.975470:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460070.975546:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003358848 00000100:00100000:2.0:1788460070.975556:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003358848 00000100:00100000:2.0:1788460070.975613:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 54 00000100:00100000:2.0:1788460070.975622:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac39d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+29:11131:x1875336003358848:12345-192.168.206.5@tcp:101:lfs.0 00010000:00010000:2.0:1788460070.975644:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460070.975676:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542b27a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a645 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460070.975740:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542b27a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a645 expref: 30 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460070.975754:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542b27a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a645 expref: 30 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460070.975785:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4bfa9fe100) 00010000:00010000:2.0:1788460070.975788:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788460070.975792:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bfadc7800, rc 0) 00000100:00100000:2.0:1788460070.975852:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac39d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+30:11131:x1875336003358848:12345-192.168.206.5@tcp:101:lfs.0 Request processed in 230us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460070.976818:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 54 00000100:00100000:1.0:1788460070.986454:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460070.986543:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003359104 00000100:00100000:3.0:1788460070.986553:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003359104 00000100:00100000:3.0:1788460070.986609:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 9 00000100:00100000:3.0:1788460070.986618:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc6be3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+30:11131:x1875336003359104:12345-192.168.206.5@tcp:35:lfs.0 00000100:00100000:3.0:1788460070.986860:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc6be3450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+31:11131:x1875336003359104:12345-192.168.206.5@tcp:35:lfs.0 Request processed in 235us (407us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1788460070.986868:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 9 00000100:00100000:0.0:1788460071.149254:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460071.149538:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003359360 00000100:00100000:2.0:1788460071.149547:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003359360 00000100:00100000:2.0:1788460071.149616:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 55 00000100:00100000:2.0:1788460071.149627:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3a39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+31:11141:x1875336003359360:12345-192.168.206.5@tcp:101:lfs.0 00010000:00010000:2.0:1788460071.149659:0:7760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460071.149678:0:7760:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542b281 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a64c expref: -99 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788460071.149779:0:7760:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1788460071.149882:0:7760:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542b281 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a64c expref: 33 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460071.149896:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4bc5dc1900) 00010000:00010000:2.0:1788460071.149899:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788460071.149904:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542b281 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a64c expref: 33 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460071.149919:0:7760:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bfadc7c00, rc 0) 00000100:00100000:2.0:1788460071.150085:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3a39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+32:11141:x1875336003359360:12345-192.168.206.5@tcp:101:lfs.0 Request processed in 460us (838us total) trans 4294967329 rc 301/301 00000100:00100000:2.0:1788460071.150109:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 55 00000100:00100000:1.0:1788460071.160094:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460071.160185:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003359488 00000100:00100000:2.0:1788460071.160194:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003359488 00000100:00100000:2.0:1788460071.160250:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 56 00000100:00100000:2.0:1788460071.160260:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac39d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+32:11141:x1875336003359488:12345-192.168.206.5@tcp:34:lfs.0 00010000:00010000:2.0:1788460071.160327:0:13560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542b28f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460071.160344:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542b28f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460071.160356:0:13560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542b28f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460071.160381:0:13560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b296 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460071.160389:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b296 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460071.160396:0:13560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b296 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460071.160468:0:13560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542b29d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460071.160477:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542b29d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460071.160485:0:13560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542b29d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788460071.160544:0:13560:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542b29d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460071.160557:0:13560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542b28f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460071.160564:0:13560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542b28f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460071.160571:0:13560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542b28f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460071.160577:0:13560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bfadc7c00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:2.0:1788460071.160581:0:13560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542b28f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460071.160588:0:13560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542b28f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460071.160600:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8c4bc2ab7100) 00010000:00010000:2.0:1788460071.160603:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460071.160608:0:13560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542b28f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460071.160615:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542b28f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460071.160627:0:13560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b296 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460071.160633:0:13560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b296 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460071.160663:0:13560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b296 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460071.160669:0:13560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bfadc7600 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:2.0:1788460071.160673:0:13560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b296 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460071.160680:0:13560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b296 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460071.160690:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8c4bef1ffb00) 00010000:00010000:2.0:1788460071.160692:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460071.160696:0:13560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b296 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460071.160702:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b296 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460071.160712:0:13560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542b29d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460071.160719:0:13560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542b29d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460071.160725:0:13560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542b29d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460071.160741:0:13560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bfadc7e00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:2.0:1788460071.160744:0:13560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542b29d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460071.160762:0:13560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542b29d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460071.160771:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4bfa9fe100) 00010000:00010000:2.0:1788460071.160774:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460071.160778:0:13560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542b29d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460071.160794:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542b29d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460071.160868:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac39d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+32:11141:x1875336003359488:12345-192.168.206.5@tcp:34:lfs.0 Request processed in 609us (781us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460071.160877:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 56 00000100:00100000:3.0:1788460071.173498:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460071.173810:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003359744 00000100:00100000:2.0:1788460071.173820:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003359744 00000100:00100000:2.0:1788460071.173879:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 10 00000100:00100000:2.0:1788460071.173889:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc532c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+32:11141:x1875336003359744:12345-192.168.206.5@tcp:35:lfs.0 00000100:00100000:2.0:1788460071.174136:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc532c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+33:11141:x1875336003359744:12345-192.168.206.5@tcp:35:lfs.0 Request processed in 247us (645us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1788460071.174143:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 10 00000100:00100000:0.0:1788460071.234234:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460071.234328:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003360000 00000100:00100000:2.0:1788460071.234338:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003360000 00000100:00100000:2.0:1788460071.234405:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 57 00000100:00100000:2.0:1788460071.234415:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3a38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+33:11144:x1875336003360000:12345-192.168.206.5@tcp:101:lfs.0 00010000:00010000:2.0:1788460071.234437:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460071.234456:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542b2a4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a653 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460071.234541:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b2ab lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460071.234557:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b2ab lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460071.234568:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b2ab lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460071.234580:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542b2b2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460071.234588:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542b2b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460071.234596:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542b2b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460071.234707:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6800/0x5dfa74784542b2b9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460071.234717:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6800/0x5dfa74784542b2b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460071.234725:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6800/0x5dfa74784542b2b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788460071.234745:0:6534:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788460071.234826:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b2ab lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460071.234834:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b2ab lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460071.234847:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b2ab lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460071.234853:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bfadc7600 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:2.0:1788460071.234857:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b2ab lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460071.234865:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b2ab lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460071.234876:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8c4bc2ab7100) 00010000:00010000:2.0:1788460071.234879:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460071.234884:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b2ab lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460071.234890:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b2ab lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460071.234903:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542b2b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460071.234909:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542b2b2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460071.234915:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542b2b2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460071.234920:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bfadc7c00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:2.0:1788460071.234923:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542b2b2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460071.234941:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542b2b2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460071.234999:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8c4bef1ffb00) 00010000:00010000:2.0:1788460071.235002:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460071.235006:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542b2b2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460071.235012:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542b2b2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460071.235049:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542b2a4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a653 expref: 36 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460071.235063:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6800/0x5dfa74784542b2b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a653 expref: 35 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460071.235071:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4bfa9fe100) 00010000:00010000:2.0:1788460071.235074:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788460071.235076:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bfadc6800, rc 0) 00000100:00100000:2.0:1788460071.235140:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3a38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+35:11144:x1875336003360000:12345-192.168.206.5@tcp:101:lfs.0 Request processed in 726us (915us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1788460071.235148:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 57 00000100:00100000:1.0:1788460071.239479:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460071.239664:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003360128 00000100:00100000:0.0:1788460071.239673:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003360128 00000100:00100000:0.0:1788460071.239737:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 58 00000100:00100000:0.0:1788460071.239748:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac39d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+35:11144:x1875336003360128:12345-192.168.206.5@tcp:54:lfs.0 00010000:00010000:0.0:1788460071.239811:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0e00/0x5dfa74784542b2c7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460071.239828:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0e00/0x5dfa74784542b2c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460071.239840:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0e00/0x5dfa74784542b2c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460071.239876:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0e00/0x5dfa74784542b2c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460071.239883:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0e00/0x5dfa74784542b2c7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460071.239889:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0e00/0x5dfa74784542b2c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460071.239894:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc29d0e00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460071.239898:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0e00/0x5dfa74784542b2c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460071.239917:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0e00/0x5dfa74784542b2c7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460071.239986:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4bfa9fe100) 00010000:00010000:0.0:1788460071.239989:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788460071.239995:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0e00/0x5dfa74784542b2c7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460071.240002:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0e00/0x5dfa74784542b2c7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460071.240116:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac39d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+35:11144:x1875336003360128:12345-192.168.206.5@tcp:54:lfs.0 Request processed in 370us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460071.240124:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 58 00000100:00100000:3.0:1788460071.244141:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460071.244273:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003360384 00000100:00100000:2.0:1788460071.244282:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003360384 00000100:00100000:2.0:1788460071.244338:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 11 00000100:00100000:2.0:1788460071.244348:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc532dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+35:11144:x1875336003360384:12345-192.168.206.5@tcp:35:lfs.0 00000100:00100000:2.0:1788460071.244577:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc532dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+36:11144:x1875336003360384:12345-192.168.206.5@tcp:35:lfs.0 Request processed in 230us (442us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1788460071.244585:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 11 00010000:00010000:3.0:1788460071.697246:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460071.731396:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460071.731525:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003360640 00000100:00100000:1.0:1788460071.731535:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003360640 00000100:00100000:1.0:1788460071.731599:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 59 00000100:00100000:1.0:1788460071.731619:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc532f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+36:11176:x1875336003360640:12345-192.168.206.5@tcp:101:cat.0 00010000:00010000:1.0:1788460071.731642:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460071.731673:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677000/0x5dfa74784542b2ce lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a65a expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460071.731793:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677a00/0x5dfa74784542b2d5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460071.731822:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677a00/0x5dfa74784542b2d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460071.731833:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677a00/0x5dfa74784542b2d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788460071.731845:0:6535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788460071.732033:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677000/0x5dfa74784542b2ce lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a65a expref: 39 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460071.732051:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677a00/0x5dfa74784542b2d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a65a expref: 38 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460071.732059:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4bfa9fe100) 00010000:00010000:1.0:1788460071.732062:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788460071.732066:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ac3677a00, rc 0) 00000100:00100000:1.0:1788460071.732121:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc532f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+38:11176:x1875336003360640:12345-192.168.206.5@tcp:101:cat.0 Request processed in 505us (733us total) trans 4294967333 rc 0/0 00000100:00100000:1.0:1788460071.732129:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 59 00000100:00100000:1.0:1788460071.735451:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460071.735539:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003360896 00000100:00100000:2.0:1788460071.735549:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003360896 00000100:00100000:2.0:1788460071.735608:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 12 00000100:00100000:2.0:1788460071.735627:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3a30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+38:11176:x1875336003360896:12345-192.168.206.5@tcp:35:cat.0 00000100:00100000:2.0:1788460071.735858:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3a30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+39:11176:x1875336003360896:12345-192.168.206.5@tcp:35:cat.0 Request processed in 234us (408us total) trans 4294967334 rc 0/0 00000100:00100000:2.0:1788460071.735865:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 12 00000100:00100000:3.0:1788460071.737571:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460071.737638:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003361024 00000100:00100000:0.0:1788460071.737659:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003361024 00000100:00100000:0.0:1788460071.737721:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 2 00000100:00100000:0.0:1788460071.737740:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4138e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+39:2395:x1875336003361024:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788460071.737753:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788460071.737776:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677a00/0x5dfa74784542b2d5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a65a expref: 39 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460071.737804:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4bfa9fe100) 00010000:00010000:0.0:1788460071.737809:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788460071.737844:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4138e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+38:2395:x1875336003361024:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 106us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460071.737862:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 2 00000100:00100000:1.0:1788460071.844210:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460071.844322:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003361280 00000100:00100000:0.0:1788460071.844332:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003361280 00000100:00100000:0.0:1788460071.844393:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 60 00000100:00100000:0.0:1788460071.844428:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3a31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+38:11182:x1875336003361280:12345-192.168.206.5@tcp:101:dd.0 00010000:00010000:0.0:1788460071.844451:0:7760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460071.844454:0:7760:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788460071.844478:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676e00/0x5dfa74784542b23b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a630 expref: 38 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460071.844497:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8c4bc2ab7100) 00010000:00010000:0.0:1788460071.844502:0:7760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788460071.844514:0:7760:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0e00/0x5dfa74784542b2e3 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a661 expref: -99 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460071.845052:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0c00/0x5dfa74784542b2ea lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460071.845067:0:7760:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6800/0x5dfa74784542b2b9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a653 expref: 38 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460071.845075:0:7760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0c00/0x5dfa74784542b2ea lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460071.845104:0:7760:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6800/0x5dfa74784542b2b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a653 expref: 38 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460071.845116:0:7760:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6800/0x5dfa74784542b2b9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a653 expref: 38 pid: 6534 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460071.845128:0:7760:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac366aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7760:1875336022329088:192.168.206.5@tcp:104: 00000100:00100000:0.0:1788460071.845802:0:7760:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bfa2983c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788460071.851265:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460071.851442:0:7760:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac366aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7760:1875336022329088:192.168.206.5@tcp:104: 00010000:00010000:0.0:1788460071.851468:0:7760:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0c00/0x5dfa74784542b2ea lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460071.856692:0:9538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003361408 00000100:00100000:1.0:1788460071.856706:0:9538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003361408 00010000:00010000:1.0:1788460071.856765:0:9538:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6800/0x5dfa74784542b2b9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a653 expref: 39 pid: 6534 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460071.856816:0:9538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 63 00000100:00100000:1.0:1788460071.856826:0:9538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4138000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+39:2394:x1875336003361408:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788460071.856863:0:9538:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788460071.856870:0:9538:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6800/0x5dfa74784542b2b9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a653 expref: 39 pid: 6534 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460071.856883:0:9538:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6800/0x5dfa74784542b2b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a653 expref: 39 pid: 6534 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460071.856902:0:9538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6800/0x5dfa74784542b2b9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a653 expref: 39 pid: 6534 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460071.856917:0:9538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4bfa9fe100) 00010000:00010000:1.0:1788460071.856922:0:9538:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0c00/0x5dfa74784542b2ea lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460071.856931:0:9538:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0c00/0x5dfa74784542b2ea lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460071.856939:0:9538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0c00/0x5dfa74784542b2ea lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460071.856990:0:9538:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788460071.857171:0:7760:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0c00/0x5dfa74784542b2ea lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460071.857179:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0c00/0x5dfa74784542b2ea lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788460071.857198:0:7760:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788460071.857344:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0e00/0x5dfa74784542b2e3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a661 expref: 40 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460071.857360:0:7760:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0c00/0x5dfa74784542b2ea lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a661 expref: 39 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460071.857367:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4bfa9fe100) 00010000:00010000:0.0:1788460071.857369:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788460071.857372:0:7760:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc29d0c00, rc 0) 00000100:00100000:1.0:1788460071.857439:0:9538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4138000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+39:2394:x1875336003361408:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 613us (6181us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460071.857447:0:9538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 63 00000100:00100000:0.0:1788460071.859625:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3a31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+38:11182:x1875336003361280:12345-192.168.206.5@tcp:101:dd.0 Request processed in 15203us (15415us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1788460071.859637:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 60 00000100:00100000:3.0:1788460071.869790:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460071.869885:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003361536 00000100:00100000:0.0:1788460071.869894:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003361536 00000100:00100000:0.0:1788460071.870525:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 61 00000100:00100000:0.0:1788460071.870540:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac36cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+38:11182:x1875336003361536:12345-192.168.206.5@tcp:101:dd.0 00010000:00010000:0.0:1788460071.870564:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460071.870597:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0000/0x5dfa74784542b2f8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a668 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460071.870641:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d1a00/0x5dfa74784542b2ff lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460071.870664:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d1a00/0x5dfa74784542b2ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460071.870676:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d1a00/0x5dfa74784542b2ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460071.870807:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0000/0x5dfa74784542b2f8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a668 expref: 40 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460071.870825:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d1a00/0x5dfa74784542b2ff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a668 expref: 39 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460071.870835:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4bfa9fe100) 00010000:00010000:0.0:1788460071.870838:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788460071.870842:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc29d1a00, rc 0) 00000100:00100000:0.0:1788460071.870916:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac36cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+39:11182:x1875336003361536:12345-192.168.206.5@tcp:101:dd.0 Request processed in 381us (1134us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460071.870923:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 61 00000100:00100000:3.0:1788460071.882039:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460071.882169:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003361792 00000100:00100000:2.0:1788460071.882179:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003361792 00000100:00100000:2.0:1788460071.882243:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 62 00000100:00100000:2.0:1788460071.882252:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc6760e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+39:11182:x1875336003361792:12345-192.168.206.5@tcp:36:dd.0 00010000:00010000:2.0:1788460071.883508:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542b306 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460071.883528:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542b306 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460071.883538:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542b306 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788460071.883582:0:6534:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:2.0:1788460071.883617:0:6534:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000761dfd08 reply state 0000000005984286 transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542b306 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460071.883629:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542b306 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460071.883980:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4bfa9fe100) 00010000:00010000:2.0:1788460071.883984:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788460071.883988:0:6534:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788460071.884111:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc6760e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+42:11182:x1875336003361792:12345-192.168.206.5@tcp:36:dd.0 Request processed in 1857us (2077us total) trans 4294967337 rc 0/0 00000100:00100000:2.0:1788460071.884120:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 62 00000020:00080000:2.0:1788460071.884125:0:6534:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:1.0:1788460071.891150:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1788460071.892387:0:13815:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788460072.240900:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460072.241111:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003361920 00000100:00100000:2.0:1788460072.241124:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003361920 00000100:00100000:2.0:1788460072.241226:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 63 00000100:00100000:2.0:1788460072.241240:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac366aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+42:11196:x1875336003361920:12345-192.168.206.5@tcp:101:stat.0 00010000:00010000:2.0:1788460072.241273:0:7760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460072.241303:0:7760:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542b30d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a66f expref: -99 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460072.241391:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b314 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460072.241410:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b314 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460072.241427:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b314 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460072.241440:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b31b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460072.241448:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b31b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460072.241473:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b31b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460072.241580:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542b322 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460072.241601:0:7760:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0c00/0x5dfa74784542b2ea lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a661 expref: 43 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460072.241611:0:7760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542b322 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460072.241664:0:7760:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0c00/0x5dfa74784542b2ea lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a661 expref: 43 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460072.241682:0:7760:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0c00/0x5dfa74784542b2ea lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a661 expref: 43 pid: 7760 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460072.241700:0:7760:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc532bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7760:1875336022329216:192.168.206.5@tcp:104: 00000100:00100000:2.0:1788460072.242413:0:7760:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bfa392240 going to sleep for 11 seconds 00000100:00080000:3.0:1788460072.243299:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788460072.246570:0:7760:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc532bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7760:1875336022329216:192.168.206.5@tcp:104: 00010000:00010000:2.0:1788460072.246617:0:7760:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542b322 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460072.247568:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460072.248004:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003362176 00000100:00100000:2.0:1788460072.248018:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003362176 00000100:00100000:0.0:1788460072.248189:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 13 00000100:00100000:0.0:1788460072.248206:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc6762a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+44:6161:x1875336003362176:12345-192.168.206.5@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788460072.248894:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc6762a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+45:6161:x1875336003362176:12345-192.168.206.5@tcp:35:ldlm_bl.0 Request processed in 691us (1329us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1788460072.248927:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 13 00000100:00100000:3.0:1788460072.251588:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460072.252055:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003362304 00000100:00100000:1.0:1788460072.252069:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003362304 00010000:00010000:1.0:1788460072.252122:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0c00/0x5dfa74784542b2ea lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a661 expref: 45 pid: 7760 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460072.252259:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 64 00000100:00100000:1.0:1788460072.252271:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc6760700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+45:2394:x1875336003362304:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788460072.252290:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788460072.252299:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0c00/0x5dfa74784542b2ea lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a661 expref: 45 pid: 7760 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460072.252319:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0c00/0x5dfa74784542b2ea lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a661 expref: 45 pid: 7760 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460072.252429:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0c00/0x5dfa74784542b2ea lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a661 expref: 45 pid: 7760 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460072.252450:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4bfa9fe100) 00010000:00010000:1.0:1788460072.252456:0:6520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542b322 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460072.252467:0:6520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542b322 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460072.252475:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542b322 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460072.252513:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788460072.252740:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc6760700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+44:2394:x1875336003362304:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 470us (1166us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460072.252750:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 64 00010000:00010000:2.0:1788460072.253482:0:7760:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542b322 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460072.253515:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542b322 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788460072.253596:0:7760:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788460072.253601:0:7760:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788460072.253941:0:7760:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542b322 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460072.254039:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542b322 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460072.254053:0:7760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b314 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460072.254060:0:7760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b314 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460072.254067:0:7760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b314 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460072.254074:0:7760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bfadc7600 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:2.0:1788460072.254079:0:7760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b314 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460072.254159:0:7760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b314 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460072.254177:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8c4bc2ab7100) 00010000:00010000:2.0:1788460072.254180:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460072.254185:0:7760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b314 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460072.254205:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b314 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460072.254222:0:7760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b31b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460072.254229:0:7760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b31b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460072.254235:0:7760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b31b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460072.254241:0:7760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bfadc7200 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:2.0:1788460072.254244:0:7760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b31b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460072.254250:0:7760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b31b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460072.254259:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8c4bef1ffb00) 00010000:00010000:2.0:1788460072.254261:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460072.254264:0:7760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b31b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460072.254269:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b31b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460072.254314:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542b30d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a66f expref: 44 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460072.254330:0:7760:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542b322 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a66f expref: 43 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460072.254346:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4bfa9fe100) 00010000:00010000:2.0:1788460072.254348:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788460072.254351:0:7760:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bfadc7400, rc 0) 00000100:00100000:2.0:1788460072.254484:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac366aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+43:11196:x1875336003361920:12345-192.168.206.5@tcp:101:stat.0 Request processed in 13245us (13596us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460072.254494:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 63 00000100:00100000:3.0:1788460072.346221:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460072.346836:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003362560 00000100:00100000:0.0:1788460072.346851:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003362560 00000100:00100000:0.0:1788460072.346978:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 64 00000100:00100000:0.0:1788460072.346991:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc6762680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+43:11202:x1875336003362560:12345-192.168.206.5@tcp:36:truncate.0 00010000:00010000:0.0:1788460072.347070:0:6533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788460072.347118:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542b322 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a66f expref: 43 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460072.347141:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4bfa9fe100) 00010000:00010000:0.0:1788460072.347147:0:6533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788460072.347376:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0000/0x5dfa74784542b329 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460072.347394:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0000/0x5dfa74784542b329 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460072.347406:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0000/0x5dfa74784542b329 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788460072.347454:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:0.0:1788460072.347491:0:6533:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000730ac579 reply state 0000000011f92373 transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0000/0x5dfa74784542b329 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460072.347505:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0000/0x5dfa74784542b329 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460072.347511:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4bfa9fe100) 00010000:00010000:0.0:1788460072.347514:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788460072.347533:0:6533:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788460072.347712:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc6762680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+45:11202:x1875336003362560:12345-192.168.206.5@tcp:36:truncate.0 Request processed in 723us (1506us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1788460072.347732:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 64 00000020:00080000:0.0:1788460072.347738:0:6533:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788460072.504695:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460072.504900:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003362688 00000100:00100000:2.0:1788460072.504913:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003362688 00000100:00100000:2.0:1788460072.505136:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 65 00000100:00100000:2.0:1788460072.505149:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3a30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+45:11216:x1875336003362688:12345-192.168.206.5@tcp:101:stat.0 00010000:00010000:2.0:1788460072.505184:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460072.505210:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542b330 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a676 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460072.505298:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b337 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460072.505317:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b337 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460072.505331:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b337 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460072.505345:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b33e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460072.505352:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b33e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460072.505372:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b33e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460072.505465:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b345 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460072.505475:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b345 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460072.505483:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b345 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788460072.505536:0:6534:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1788460072.505541:0:6534:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788460072.505566:0:6534:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b345 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460072.505581:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b345 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460072.505590:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b337 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460072.505596:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b337 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460072.505604:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b337 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460072.505611:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bfadc7200 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:2.0:1788460072.505616:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b337 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460072.505635:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b337 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460072.505666:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8c4bc2ab7100) 00010000:00010000:2.0:1788460072.505670:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460072.505677:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b337 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460072.505684:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b337 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460072.505699:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b33e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460072.505705:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b33e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460072.505711:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b33e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460072.505717:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bfadc7600 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:2.0:1788460072.505731:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b33e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460072.505738:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b33e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460072.505745:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8c4bef1ffb00) 00010000:00010000:2.0:1788460072.505748:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460072.505751:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b33e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460072.505769:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b33e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460072.505801:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542b330 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a676 expref: 47 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460072.505817:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b345 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a676 expref: 46 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460072.505825:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4bfa9fe100) 00010000:00010000:2.0:1788460072.505827:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788460072.505830:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bfadc6400, rc 0) 00000100:00100000:2.0:1788460072.506336:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3a30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+46:11216:x1875336003362688:12345-192.168.206.5@tcp:101:stat.0 Request processed in 1187us (1651us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460072.506346:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 65 00000100:00100000:3.0:1788460072.529654:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788460072.529687:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3a30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022329344:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788460072.529791:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460072.530067:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022329344 00000100:00100000:1.0:1788460072.530079:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022329344 00000100:00100000:1.0:1788460072.530158:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788460072.530171:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc6762300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022329344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788460072.530211:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788460072.530276:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc6762300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022329344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460072.530285:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:3.0:1788460072.532087:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788460072.532172:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3a30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022329344:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788460072.587288:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460072.587413:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003362944 00000100:00100000:2.0:1788460072.587428:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003362944 00000100:00100000:2.0:1788460072.587507:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 66 00000100:00100000:2.0:1788460072.587520:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3a30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+46:11226:x1875336003362944:12345-192.168.206.5@tcp:101:lfs.0 00010000:00010000:2.0:1788460072.587547:0:7760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460072.587576:0:7760:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542b34c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a67d expref: -99 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788460072.587733:0:7760:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1788460072.587866:0:7760:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542b34c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a67d expref: 48 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460072.587905:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4bc5dc1900) 00010000:00010000:2.0:1788460072.587909:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788460072.587916:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542b34c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a67d expref: 48 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460072.587934:0:7760:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bfadc7c00, rc 0) 00000100:00100000:2.0:1788460072.588080:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3a30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+47:11226:x1875336003362944:12345-192.168.206.5@tcp:101:lfs.0 Request processed in 562us (805us total) trans 4294967341 rc 301/301 00000100:00100000:2.0:1788460072.588090:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 66 00000100:00100000:3.0:1788460072.591937:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460072.592392:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003363200 00000100:00100000:2.0:1788460072.592405:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003363200 00000100:00100000:2.0:1788460072.592478:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 14 00000100:00100000:2.0:1788460072.592488:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc6763480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+47:11226:x1875336003363200:12345-192.168.206.5@tcp:35:lfs.0 00000100:00100000:2.0:1788460072.592785:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc6763480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+48:11226:x1875336003363200:12345-192.168.206.5@tcp:35:lfs.0 Request processed in 297us (858us total) trans 4294967342 rc 0/0 00000100:00100000:2.0:1788460072.592793:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 14 00000100:00100000:3.0:1788460072.666652:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460072.667083:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003363456 00000100:00100000:2.0:1788460072.667097:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003363456 00000100:00100000:2.0:1788460072.667192:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 67 00000100:00100000:2.0:1788460072.667213:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc6762d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+48:11232:x1875336003363456:12345-192.168.206.5@tcp:101:bash.0 00010000:00010000:2.0:1788460072.667243:0:13560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460072.667270:0:13560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542b35a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a684 expref: -99 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460072.667416:0:13560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b361 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460072.667440:0:13560:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b345 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a676 expref: 49 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460072.667450:0:13560:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b361 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460072.667496:0:13560:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b345 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a676 expref: 49 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460072.667513:0:13560:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b345 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a676 expref: 49 pid: 6534 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460072.667530:0:13560:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc532bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13560:1875336022329472:192.168.206.5@tcp:104: 00000100:00100000:2.0:1788460072.667660:0:13560:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bfa392480 going to sleep for 11 seconds 00000100:00100000:2.0:1788460072.671100:0:13560:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc532bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13560:1875336022329472:192.168.206.5@tcp:104: 00010000:00010000:2.0:1788460072.671152:0:13560:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b361 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460072.672271:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460072.672842:0:9549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003363584 00000100:00100000:2.0:1788460072.672855:0:9549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003363584 00010000:00010000:2.0:1788460072.672906:0:9549:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b345 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a676 expref: 50 pid: 6534 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460072.673005:0:9549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 65 00000100:00100000:2.0:1788460072.673016:0:9549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc6761500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+50:2393:x1875336003363584:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788460072.673034:0:9549:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460072.673059:0:9549:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b345 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a676 expref: 50 pid: 6534 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460072.673075:0:9549:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b345 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a676 expref: 50 pid: 6534 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460072.673102:0:9549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b345 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a676 expref: 50 pid: 6534 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460072.673123:0:9549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4bfa9fe100) 00010000:00010000:2.0:1788460072.673128:0:9549:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b361 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460072.673140:0:9549:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b361 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460072.673149:0:9549:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b361 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460072.673183:0:9549:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788460072.673275:0:9549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc6761500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+49:2393:x1875336003363584:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 260us (1014us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460072.673283:0:9549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 65 00010000:00010000:0.0:1788460072.673773:0:13560:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b361 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460072.673785:0:13560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b361 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788460072.673820:0:13560:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1788460072.674052:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542b35a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a684 expref: 50 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460072.674074:0:13560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b361 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a684 expref: 49 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460072.674083:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4bfa9fe100) 00010000:00010000:0.0:1788460072.674085:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788460072.674088:0:13560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bfadc7600, rc 0) 00000100:00100000:0.0:1788460072.674155:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc6762d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+49:11232:x1875336003363456:12345-192.168.206.5@tcp:101:bash.0 Request processed in 6944us (7516us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1788460072.674164:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 67 00000100:00100000:3.0:1788460072.680139:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460072.680476:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003363840 00000100:00100000:2.0:1788460072.680492:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003363840 00000100:00100000:2.0:1788460072.680581:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 68 00000100:00100000:2.0:1788460072.680592:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc6761880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+49:11232:x1875336003363840:12345-192.168.206.5@tcp:36:bash.0 00010000:00010000:2.0:1788460072.681636:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b36f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460072.686395:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b36f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460072.686416:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b36f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788460072.686558:0:6534:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:2.0:1788460072.686624:0:6534:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c658c755 reply state 0000000077f1ca3c transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b36f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460072.686639:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b36f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460072.687371:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4bfa9fe100) 00010000:00010000:2.0:1788460072.687375:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788460072.687381:0:6534:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788460072.687556:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc6761880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+52:11232:x1875336003363840:12345-192.168.206.5@tcp:36:bash.0 Request processed in 6959us (7423us total) trans 4294967345 rc 0/0 00000100:00100000:2.0:1788460072.687568:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 68 00000020:00080000:2.0:1788460072.687576:0:6534:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788460072.699397:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460072.699696:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003363968 00000100:00100000:0.0:1788460072.699709:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003363968 00000100:00100000:0.0:1788460072.699796:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 69 00000100:00100000:0.0:1788460072.699808:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3a30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+52:11232:x1875336003363968:12345-192.168.206.5@tcp:101:bash.0 00010000:00010000:0.0:1788460072.699839:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460072.699889:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0e00/0x5dfa74784542b376 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a68b expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460072.700059:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0a00/0x5dfa74784542b37d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460072.700078:0:6533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b361 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a684 expref: 53 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460072.700089:0:6533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0a00/0x5dfa74784542b37d lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460072.700132:0:6533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b361 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a684 expref: 53 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460072.700148:0:6533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b361 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a684 expref: 53 pid: 13560 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460072.700164:0:6533:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac366bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6533:1875336022329600:192.168.206.5@tcp:104: 00000100:00100000:0.0:1788460072.700272:0:6533:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc55edb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788460072.703034:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460072.703487:0:9538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003364096 00000100:00100000:3.0:1788460072.703501:0:9538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003364096 00010000:00010000:3.0:1788460072.703556:0:9538:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b361 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a684 expref: 54 pid: 13560 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460072.703613:0:9538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 66 00000100:00100000:3.0:1788460072.703624:0:9538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bedf6c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+54:2393:x1875336003364096:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788460072.703639:0:9538:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788460072.703646:0:9538:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b361 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a684 expref: 54 pid: 13560 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460072.703660:0:9538:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b361 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a684 expref: 54 pid: 13560 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460072.703686:0:9538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4bfa9fe100) 00010000:00010000:3.0:1788460072.703692:0:9538:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0a00/0x5dfa74784542b37d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460072.703703:0:9538:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0a00/0x5dfa74784542b37d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460072.703713:0:9538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0a00/0x5dfa74784542b37d lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460072.704231:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b361 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a684 expref: 54 pid: 13560 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460072.704505:0:9538:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788460072.704634:0:6533:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac366bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6533:1875336022329600:192.168.206.5@tcp:104: 00010000:00010000:0.0:1788460072.704662:0:6533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0a00/0x5dfa74784542b37d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460072.704672:0:6533:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0a00/0x5dfa74784542b37d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460072.704699:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0a00/0x5dfa74784542b37d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788460072.704786:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788460072.704792:0:6533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788460072.704818:0:6533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0a00/0x5dfa74784542b37d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460072.704858:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0e00/0x5dfa74784542b376 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a68b expref: 54 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460072.704883:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0a00/0x5dfa74784542b37d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a68b expref: 53 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460072.704893:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4bfa9fe100) 00010000:00010000:0.0:1788460072.704896:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788460072.704898:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc29d0a00, rc 0) 00000100:00100000:3.0:1788460072.706185:0:9538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bedf6c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+53:2393:x1875336003364096:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 2549us (3151us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460072.706230:0:9538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 66 00000100:00100000:0.0:1788460072.712852:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3a30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+52:11232:x1875336003363968:12345-192.168.206.5@tcp:101:bash.0 Request processed in 13025us (13450us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460072.712870:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 69 00000100:00100000:3.0:1788460072.720372:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460072.720543:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003364352 00000100:00100000:2.0:1788460072.720558:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003364352 00000100:00100000:2.0:1788460072.720635:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 15 00000100:00100000:2.0:1788460072.720778:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc6be1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+52:11232:x1875336003364352:12345-192.168.206.5@tcp:35:bash.0 00000100:00100000:3.0:1788460072.721462:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc6be1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+53:11232:x1875336003364352:12345-192.168.206.5@tcp:35:bash.0 Request processed in 813us (1100us total) trans 4294967346 rc 0/0 00000100:00100000:3.0:1788460072.721474:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 15 00010000:00010000:1.0:1788460072.723212:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788460072.853876:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460072.854293:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003364608 00000100:00100000:0.0:1788460072.854307:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003364608 00000100:00100000:0.0:1788460072.854394:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 70 00000100:00100000:0.0:1788460072.854407:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc532bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+53:11242:x1875336003364608:12345-192.168.206.5@tcp:101:lfs.0 00010000:00010000:0.0:1788460072.854444:0:13560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460072.854472:0:13560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0e00/0x5dfa74784542b384 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a692 expref: -99 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788460072.854636:0:13560:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1788460072.854783:0:13560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0e00/0x5dfa74784542b384 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a692 expref: 55 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460072.854800:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4bc5dc1900) 00010000:00010000:0.0:1788460072.854804:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788460072.854810:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0e00/0x5dfa74784542b384 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a692 expref: 55 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460072.854829:0:13560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc29d0e00, rc 0) 00000100:00100000:0.0:1788460072.854910:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc532bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+54:11242:x1875336003364608:12345-192.168.206.5@tcp:101:lfs.0 Request processed in 505us (1059us total) trans 4294967347 rc 301/301 00000100:00100000:2.0:1788460072.857522:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460072.857661:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003364736 00000100:00100000:1.0:1788460072.857676:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003364736 00000100:00100000:1.0:1788460072.857755:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 71 00000100:00100000:1.0:1788460072.857767:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc5328000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+55:11242:x1875336003364736:12345-192.168.206.5@tcp:34:lfs.0 00010000:00010000:1.0:1788460072.857862:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677800/0x5dfa74784542b392 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460072.857882:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677800/0x5dfa74784542b392 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460072.857894:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677800/0x5dfa74784542b392 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460072.857905:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676000/0x5dfa74784542b399 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460072.857912:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676000/0x5dfa74784542b399 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460072.857991:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676000/0x5dfa74784542b399 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460072.858078:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676a00/0x5dfa74784542b3a0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460072.858160:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676a00/0x5dfa74784542b3a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460072.858167:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676a00/0x5dfa74784542b3a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788460072.858227:0:6534:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676a00/0x5dfa74784542b3a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460072.858242:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677800/0x5dfa74784542b392 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460072.858249:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677800/0x5dfa74784542b392 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460072.858256:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677800/0x5dfa74784542b392 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460072.858262:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac3677800 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:1.0:1788460072.858267:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677800/0x5dfa74784542b392 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460072.858474:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677800/0x5dfa74784542b392 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460072.858491:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8c4bc2ab7100) 00010000:00010000:1.0:1788460072.858501:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788460072.858508:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677800/0x5dfa74784542b392 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460072.858516:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677800/0x5dfa74784542b392 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460072.858532:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676000/0x5dfa74784542b399 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460072.858538:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676000/0x5dfa74784542b399 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460072.858545:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676000/0x5dfa74784542b399 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460072.858550:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac3676000 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:1.0:1788460072.858553:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676000/0x5dfa74784542b399 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460072.858560:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676000/0x5dfa74784542b399 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460072.858568:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8c4bef1ffb00) 00010000:00010000:1.0:1788460072.858571:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788460072.858573:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676000/0x5dfa74784542b399 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460072.858579:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676000/0x5dfa74784542b399 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460072.858589:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676a00/0x5dfa74784542b3a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460072.858600:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676a00/0x5dfa74784542b3a0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460072.858607:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676a00/0x5dfa74784542b3a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460072.858613:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac3676a00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:1.0:1788460072.858615:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676a00/0x5dfa74784542b3a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460072.858622:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676a00/0x5dfa74784542b3a0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460072.858629:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4bfa9fe100) 00010000:00010000:1.0:1788460072.858632:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788460072.858635:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676a00/0x5dfa74784542b3a0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460072.858641:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676a00/0x5dfa74784542b3a0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460072.858744:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc5328000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+55:11242:x1875336003364736:12345-192.168.206.5@tcp:34:lfs.0 Request processed in 977us (1236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460072.858754:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 71 00000100:00100000:0.0:1788460072.860394:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 70 00000100:00100000:3.0:1788460072.867742:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460072.868327:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003364992 00000100:00100000:0.0:1788460072.868338:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003364992 00000100:00100000:0.0:1788460072.868439:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 16 00000100:00100000:0.0:1788460072.868450:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc6762a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+54:11242:x1875336003364992:12345-192.168.206.5@tcp:35:lfs.0 00000100:00100000:0.0:1788460072.868677:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc6762a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+55:11242:x1875336003364992:12345-192.168.206.5@tcp:35:lfs.0 Request processed in 229us (955us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1788460072.868686:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 16 00000100:00100000:3.0:1788460072.921254:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460072.921362:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003365248 00000100:00100000:0.0:1788460072.921371:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003365248 00000100:00100000:0.0:1788460072.921444:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 72 00000100:00100000:0.0:1788460072.921454:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc6763480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+55:11245:x1875336003365248:12345-192.168.206.5@tcp:101:lfs.0 00010000:00010000:0.0:1788460072.921476:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460072.921508:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0e00/0x5dfa74784542b3a7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a699 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460072.921593:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0800/0x5dfa74784542b3ae lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460072.921608:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0800/0x5dfa74784542b3ae lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460072.921621:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0800/0x5dfa74784542b3ae lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460072.921633:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0c00/0x5dfa74784542b3b5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460072.921641:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0c00/0x5dfa74784542b3b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460072.921660:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0c00/0x5dfa74784542b3b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460072.921914:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4000/0x5dfa74784542b3bc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460072.921925:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4000/0x5dfa74784542b3bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460072.921932:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4000/0x5dfa74784542b3bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788460072.921980:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788460072.922055:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0800/0x5dfa74784542b3ae lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460072.922071:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0800/0x5dfa74784542b3ae lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460072.922077:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0800/0x5dfa74784542b3ae lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460072.922083:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc29d0800 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460072.922087:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0800/0x5dfa74784542b3ae lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460072.922095:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0800/0x5dfa74784542b3ae lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460072.922107:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8c4bc2ab7100) 00010000:00010000:0.0:1788460072.922110:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460072.922114:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0800/0x5dfa74784542b3ae lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460072.922120:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0800/0x5dfa74784542b3ae lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460072.922133:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0c00/0x5dfa74784542b3b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460072.922138:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0c00/0x5dfa74784542b3b5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460072.922145:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0c00/0x5dfa74784542b3b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460072.922150:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc29d0c00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460072.922159:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0c00/0x5dfa74784542b3b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460072.922165:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0c00/0x5dfa74784542b3b5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460072.922173:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8c4bef1ffb00) 00010000:00010000:0.0:1788460072.922176:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460072.922178:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0c00/0x5dfa74784542b3b5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460072.922184:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0c00/0x5dfa74784542b3b5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460072.922223:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0e00/0x5dfa74784542b3a7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a699 expref: 58 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460072.922235:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4000/0x5dfa74784542b3bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a699 expref: 57 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460072.922242:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4bfa9fe100) 00010000:00010000:0.0:1788460072.922244:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788460072.922247:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc2bd4000, rc 0) 00000100:00100000:0.0:1788460072.922309:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc6763480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+57:11245:x1875336003365248:12345-192.168.206.5@tcp:101:lfs.0 Request processed in 857us (1074us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1788460072.922316:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 72 00000100:00100000:2.0:1788460072.927730:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460072.927777:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460072.928125:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003365504 00000100:00100000:3.0:1788460072.928136:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003365504 00000100:00100000:3.0:1788460072.928196:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 73 00000100:00100000:3.0:1788460072.928206:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc532b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+57:11245:x1875336003365504:12345-192.168.206.5@tcp:54:lfs.0 00010000:00010000:3.0:1788460072.928269:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840000/0x5dfa74784542b3ca lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460072.928287:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840000/0x5dfa74784542b3ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460072.928298:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840000/0x5dfa74784542b3ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460072.928330:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840000/0x5dfa74784542b3ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460072.928337:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840000/0x5dfa74784542b3ca lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460072.928344:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840000/0x5dfa74784542b3ca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460072.928366:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac2840000 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:3.0:1788460072.928371:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840000/0x5dfa74784542b3ca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460072.928391:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840000/0x5dfa74784542b3ca lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460072.928404:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4bfa9fe100) 00010000:00010000:3.0:1788460072.928407:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788460072.928412:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840000/0x5dfa74784542b3ca lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460072.928418:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840000/0x5dfa74784542b3ca lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460072.928495:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc532b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+57:11245:x1875336003365504:12345-192.168.206.5@tcp:54:lfs.0 Request processed in 290us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460072.928502:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 73 00000100:00100000:1.0:1788460072.930207:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003365376 00000100:00100000:1.0:1788460072.930220:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003365376 00000100:00100000:1.0:1788460072.930315:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 3 00000100:00100000:1.0:1788460072.930325:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc5329c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+57:2393:x1875336003365376:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788460072.930339:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788460072.930792:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4000/0x5dfa74784542b3bc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a699 expref: 57 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460072.930815:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4bfa9fe100) 00010000:00010000:1.0:1788460072.930820:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788460072.930882:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc5329c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+56:2393:x1875336003365376:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 558us (3171us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460072.930892:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 3 00000100:00100000:2.0:1788460072.943008:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460072.943142:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003365760 00000100:00100000:3.0:1788460072.943162:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003365760 00000100:00100000:3.0:1788460072.943216:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 17 00000100:00100000:3.0:1788460072.943228:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc5329f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+56:11245:x1875336003365760:12345-192.168.206.5@tcp:35:lfs.0 00000100:00100000:3.0:1788460072.943486:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc5329f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+57:11245:x1875336003365760:12345-192.168.206.5@tcp:35:lfs.0 Request processed in 260us (488us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1788460072.943494:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 17 00000100:00100000:1.0:1788460073.041225:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788460073.041257:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc5328e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022329728:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788460073.041329:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460073.041664:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022329728 00000100:00100000:2.0:1788460073.041672:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022329728 00000100:00100000:2.0:1788460073.041733:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788460073.041743:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3a30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022329728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788460073.041773:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446301696 avail 1300062208 00000100:00100000:2.0:1788460073.041827:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3a30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022329728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460073.041834:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788460073.042135:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788460073.042146:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac366bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022329856:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788460073.042179:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460073.042326:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022329856 00000100:00100000:2.0:1788460073.042341:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022329856 00000100:00100000:2.0:1788460073.042405:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788460073.042413:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc6760700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022329856:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788460073.042428:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788460073.042462:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc6760700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022329856:12345-0@lo:13:osp-pre-0-1.0 Request processed in 50us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460073.042468:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:3.0:1788460073.042966:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788460073.043007:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac366bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022329856:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788460073.043313:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc5328e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022329728:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788460073.085410:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460073.085647:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003366016 00000100:00100000:0.0:1788460073.085657:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003366016 00000100:00100000:0.0:1788460073.085716:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 74 00000100:00100000:0.0:1788460073.085736:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc6761500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+57:11263:x1875336003366016:12345-192.168.206.5@tcp:101:cat.0 00010000:00010000:0.0:1788460073.085774:0:13560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460073.085794:0:13560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5e00/0x5dfa74784542b3d1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a6a0 expref: -99 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460073.085900:0:13560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b3d8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460073.085917:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b3d8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460073.085927:0:13560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b3d8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788460073.085938:0:13560:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788460073.086071:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5e00/0x5dfa74784542b3d1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a6a0 expref: 60 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460073.086088:0:13560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b3d8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a6a0 expref: 59 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460073.086097:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4bfa9fe100) 00010000:00010000:0.0:1788460073.086100:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788460073.086104:0:13560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc2bd4200, rc 0) 00000100:00100000:0.0:1788460073.086168:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc6761500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+59:11263:x1875336003366016:12345-192.168.206.5@tcp:101:cat.0 Request processed in 434us (767us total) trans 4294967351 rc 0/0 00000100:00100000:0.0:1788460073.086176:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 74 00000100:00100000:1.0:1788460073.106928:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460073.107349:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003366144 00000100:00100000:0.0:1788460073.107363:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003366144 00000100:00100000:0.0:1788460073.107442:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 75 00000100:00100000:0.0:1788460073.107471:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc471b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+59:11264:x1875336003366144:12345-192.168.206.5@tcp:101:lfs.0 00010000:00010000:0.0:1788460073.107496:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460073.107516:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5e00/0x5dfa74784542b3e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a6a7 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460073.107712:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5a00/0x5dfa74784542b3ed lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460073.107737:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5a00/0x5dfa74784542b3ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460073.107748:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5a00/0x5dfa74784542b3ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788460073.107790:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1788460073.107793:0:6533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788460073.107810:0:6533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5a00/0x5dfa74784542b3ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460073.107836:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5e00/0x5dfa74784542b3e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a6a7 expref: 61 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460073.107854:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5a00/0x5dfa74784542b3ed lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a6a7 expref: 60 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460073.107863:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8c4bc2ab7100) 00010000:00010000:0.0:1788460073.107866:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788460073.107869:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc2bd5a00, rc 0) 00000100:00100000:0.0:1788460073.107934:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc471b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+60:11264:x1875336003366144:12345-192.168.206.5@tcp:101:lfs.0 Request processed in 467us (1031us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460073.108004:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 75 00000100:00100000:1.0:1788460073.117218:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460073.118030:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003366528 00000100:00100000:3.0:1788460073.118046:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003366528 00000100:00100000:3.0:1788460073.118201:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 18 00000100:00100000:3.0:1788460073.118216:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc471a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+60:11264:x1875336003366528:12345-192.168.206.5@tcp:35:lfs.0 00000100:00100000:3.0:1788460073.118594:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc471a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+61:11264:x1875336003366528:12345-192.168.206.5@tcp:35:lfs.0 Request processed in 380us (1390us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1788460073.118602:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 18 00000100:00100000:1.0:1788460073.126482:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460073.126578:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003366656 00000100:00100000:3.0:1788460073.126590:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003366656 00000100:00100000:3.0:1788460073.127309:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 4 00000100:00100000:3.0:1788460073.127327:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc4719180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+61:11264:x1875336003366656:12345-192.168.206.5@tcp:103:lfs.0 00010000:00010000:3.0:1788460073.127353:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788460073.127384:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0a00/0x5dfa74784542b37d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a68b expref: 61 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460073.127413:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b3d8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a6a0 expref: 60 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460073.127428:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542b27a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a645 expref: 59 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460073.127439:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4bfa9fe100) 00010000:00010000:3.0:1788460073.127445:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788460073.128959:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc4719180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+58:11264:x1875336003366656:12345-192.168.206.5@tcp:103:lfs.0 Request processed in 1614us (2466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460073.129004:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 4 00000100:00100000:1.0:1788460073.145649:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460073.145762:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003366784 00000100:00100000:2.0:1788460073.145775:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003366784 00000100:00100000:2.0:1788460073.145923:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 76 00000100:00100000:2.0:1788460073.145936:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc471bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+58:11264:x1875336003366784:12345-192.168.206.5@tcp:58:lfs.0 00010000:00010000:2.0:1788460073.146156:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542b3f4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460073.146179:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542b3f4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460073.146194:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542b3f4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788460073.149440:0:6535:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788460073.149604:0:6535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1788460073.153806:0:6535:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1788460073.154018:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc471bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+58:11264:x1875336003366784:12345-192.168.206.5@tcp:58:lfs.0 Request processed in 8080us (8379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460073.154030:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 76 00000100:00100000:2.0:1788460073.203083:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460073.203185:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003366912 00000100:00100000:0.0:1788460073.203194:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003366912 00000100:00100000:3.0:1788460073.203391:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 77 00000100:00100000:3.0:1788460073.203403:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc532aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+58:11266:x1875336003366912:12345-192.168.206.5@tcp:101:lfs.0 00010000:00010000:3.0:1788460073.203426:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460073.203446:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840400/0x5dfa74784542b3fb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a6ae expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460073.203509:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840000/0x5dfa74784542b402 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460073.203523:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840000/0x5dfa74784542b402 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460073.203533:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840000/0x5dfa74784542b402 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460073.203545:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841c00/0x5dfa74784542b409 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460073.203551:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841c00/0x5dfa74784542b409 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460073.203558:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841c00/0x5dfa74784542b409 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460073.203823:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841200/0x5dfa74784542b410 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460073.203835:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841200/0x5dfa74784542b410 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460073.203859:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841200/0x5dfa74784542b410 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788460073.203901:0:6534:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788460073.203905:0:6534:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788460073.203923:0:6534:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841200/0x5dfa74784542b410 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460073.203935:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841200/0x5dfa74784542b410 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460073.204111:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840000/0x5dfa74784542b402 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460073.204120:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840000/0x5dfa74784542b402 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460073.204126:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840000/0x5dfa74784542b402 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460073.204132:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac2840000 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:3.0:1788460073.204137:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840000/0x5dfa74784542b402 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460073.204145:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840000/0x5dfa74784542b402 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460073.204157:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8c4bc2ab7100) 00010000:00010000:3.0:1788460073.204159:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460073.204164:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840000/0x5dfa74784542b402 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460073.204181:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840000/0x5dfa74784542b402 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460073.204196:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841c00/0x5dfa74784542b409 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460073.204201:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841c00/0x5dfa74784542b409 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460073.204206:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841c00/0x5dfa74784542b409 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460073.204211:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac2841c00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:3.0:1788460073.204213:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841c00/0x5dfa74784542b409 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460073.204219:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841c00/0x5dfa74784542b409 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460073.204226:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8c4bef1ffb00) 00010000:00010000:3.0:1788460073.204228:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460073.204231:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841c00/0x5dfa74784542b409 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460073.204236:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841c00/0x5dfa74784542b409 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460073.206056:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840400/0x5dfa74784542b3fb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a6ae expref: 60 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460073.206075:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841200/0x5dfa74784542b410 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a6ae expref: 59 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460073.206095:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4bfa9fe100) 00010000:00010000:3.0:1788460073.206098:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788460073.206101:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ac2841200, rc 0) 00000100:00100000:3.0:1788460073.206192:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc532aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+59:11266:x1875336003366912:12345-192.168.206.5@tcp:101:lfs.0 Request processed in 2790us (3118us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460073.206201:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 77 00010000:00010000:0.0:1788460073.752897:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788460073.937166:0:13811:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788460073.937177:0:13811:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788460073.937219:0:13811:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788460073.937229:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788460073.937354:0:13811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc471b480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13811:1875336022329984:192.168.206.5@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788460073.937456:0:13811:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac36aaa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788460073.943657:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460073.944061:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003367040 00000100:00100000:0.0:1788460073.944073:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003367040 00000100:00100000:0.0:1788460073.944145:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 78 00000100:00100000:0.0:1788460073.944156:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc5328700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+60:11277:x1875336003367040:12345-192.168.206.5@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788460073.944186:0:6533:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788460073.944285:0:13811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc471b480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13811:1875336022329984:192.168.206.5@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788460073.944316:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc5328700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+59:11277:x1875336003367040:12345-192.168.206.5@tcp:53:lhsmtool_posix.0 Request processed in 162us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460073.944325:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 78 00000001:00080000:3.0:1788460073.946939:0:6513:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967352 is committed 00000004:00080000:3.0:1788460073.947020:0:6513:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:3.0:1788460073.947037:0:6513:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8c4ac28b4e40 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1788460073.947042:0:6513:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8c4ac25cd500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8c4ac28b43c0 00000020:00080000:3.0:1788460073.947046:0:6513:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8c4ac25cda00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8c4ac2950000 00000020:00080000:2.0:1788460073.947179:0:6565:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:2.0:1788460073.947332:0:6565:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:3.0:1788460073.947659:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc471b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022330112:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788460073.947890:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460073.947982:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022330112 00000100:00100000:2.0:1788460073.947989:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022330112 00000100:00100000:2.0:1788460073.948043:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788460073.948053:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc6760a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3659:x1875336022330112:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788460073.948078:0:8450:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:2.0:1788460073.948108:0:8450:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 13, mtime: 0x6a99bc25, atime: 0x6a99bc25, ctime: 0x6a99bc25, blocks: 0x8 00010000:00010000:2.0:1788460073.948115:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000504a61f/0x5dfa74784542b417 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460073.948130:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=371s v=(0 0) 00010000:00010000:2.0:1788460073.948149:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788460073.948156:0:8450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000504a61f/0x5dfa74784542b417 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460073.948171:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000504a61f/0x5dfa74784542b417 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460073.948194:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000504a61f/0x5dfa74784542b417 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460073.948203:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000504a61f/0x5dfa74784542b417 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460073.948220:0:8450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:1.0:1788460073.948415:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788460073.948431:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788460073.948437:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000504a61f/0x5dfa74784542b417 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460073.948456:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bfadc7600 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:1.0:1788460073.948460:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000504a61f/0x5dfa74784542b417 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460073.948469:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000504a61f/0x5dfa74784542b417 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460073.948485:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000504a61f/0x5dfa74784542b417 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460073.948492:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000504a61f/0x5dfa74784542b417 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460073.948510:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460073.948512:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460073.948513:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460073.948903:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676200/0x5dfa74784542b1b6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460073.948914:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676200/0x5dfa74784542b1b6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460073.948921:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676200/0x5dfa74784542b1b6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460073.948927:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac3676200 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460073.948931:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676200/0x5dfa74784542b1b6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460073.948938:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676200/0x5dfa74784542b1b6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460073.948971:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8c4bc2ab7800) 00010000:00010000:0.0:1788460073.948982:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460073.948988:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676200/0x5dfa74784542b1b6 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460073.948994:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676200/0x5dfa74784542b1b6 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460073.949012:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677c00/0x5dfa74784542b1bd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460073.949019:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677c00/0x5dfa74784542b1bd lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460073.949025:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677c00/0x5dfa74784542b1bd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460073.949031:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac3677c00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460073.949033:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677c00/0x5dfa74784542b1bd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460073.949040:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677c00/0x5dfa74784542b1bd lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460073.949048:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8c4bc2ab7100) 00010000:00010000:0.0:1788460073.949051:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460073.949054:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677c00/0x5dfa74784542b1bd lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460073.949060:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677c00/0x5dfa74784542b1bd lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460073.949074:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841400/0x5dfa74784542b1fc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460073.949091:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841400/0x5dfa74784542b1fc lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460073.949098:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841400/0x5dfa74784542b1fc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460073.949103:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac2841400 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460073.949107:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841400/0x5dfa74784542b1fc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460073.949113:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841400/0x5dfa74784542b1fc lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460073.949122:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8c4bef1ffb00) 00010000:00010000:0.0:1788460073.949124:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460073.949127:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841400/0x5dfa74784542b1fc lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460073.949133:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841400/0x5dfa74784542b1fc lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460073.949150:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542b306 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460073.949156:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542b306 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460073.949162:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542b306 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460073.949167:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bfadc7e00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460073.949177:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542b306 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460073.949185:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542b306 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460073.949194:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4bfa9fe100) 00010000:00010000:0.0:1788460073.949197:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460073.949200:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542b306 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460073.949207:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542b306 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460073.949222:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0000/0x5dfa74784542b329 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460073.949228:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0000/0x5dfa74784542b329 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460073.949234:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0000/0x5dfa74784542b329 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460073.949239:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc29d0000 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460073.949241:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0000/0x5dfa74784542b329 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460073.949248:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0000/0x5dfa74784542b329 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460073.949256:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4bfa9fe100) 00010000:00010000:0.0:1788460073.949259:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460073.949268:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0000/0x5dfa74784542b329 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460073.949274:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d0000/0x5dfa74784542b329 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460073.949285:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b36f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460073.949291:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b36f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460073.949297:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b36f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460073.949302:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bfadc7200 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460073.949305:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b36f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460073.949311:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b36f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460073.949320:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4bfa9fe100) 00010000:00010000:0.0:1788460073.949322:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460073.949325:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b36f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460073.949331:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b36f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460073.951454:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc6760a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3659:x1875336022330112:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3394us (3555us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788460073.951471:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000004:00080000:3.0:1788460073.955567:0:3659:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8c4bc471b480/2, rc 0, transno 4294967302 00000100:00100000:3.0:1788460073.955581:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc471b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022330112:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788460073.957385:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460073.960353:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003367168 00000100:00100000:0.0:1788460073.960367:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003367168 00000100:00100000:0.0:1788460073.960485:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 79 00000100:00100000:0.0:1788460073.960508:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc4718a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+12:11277:x1875336003367168:12345-192.168.206.5@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788460073.960580:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4400/0x5dfa74784542b41e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460073.960599:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4400/0x5dfa74784542b41e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460073.960610:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4400/0x5dfa74784542b41e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460073.960661:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5000/0x5dfa74784542b425 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460073.960669:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5000/0x5dfa74784542b425 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460073.960676:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5000/0x5dfa74784542b425 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460073.960700:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542b42c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460073.960710:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542b42c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460073.960726:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542b42c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788460073.960769:0:6535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788460073.960773:0:6535:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788460073.960785:0:6535:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542b42c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460073.960808:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4400/0x5dfa74784542b41e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460073.960815:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4400/0x5dfa74784542b41e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460073.960821:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4400/0x5dfa74784542b41e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460073.960827:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc2bd4400 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460073.960831:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4400/0x5dfa74784542b41e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460073.960838:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4400/0x5dfa74784542b41e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460073.960850:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c4bef1fde00) 00010000:00010000:0.0:1788460073.960852:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460073.960857:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4400/0x5dfa74784542b41e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460073.960864:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4400/0x5dfa74784542b41e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460073.960876:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5000/0x5dfa74784542b425 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460073.960882:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5000/0x5dfa74784542b425 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460073.960887:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5000/0x5dfa74784542b425 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460073.960898:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc2bd5000 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460073.960901:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5000/0x5dfa74784542b425 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460073.960907:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5000/0x5dfa74784542b425 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460073.960915:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff8c4bc5dc1400) 00010000:00010000:0.0:1788460073.960918:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460073.960920:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5000/0x5dfa74784542b425 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460073.960927:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5000/0x5dfa74784542b425 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460073.960941:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542b42c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460073.960981:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542b42c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460073.960986:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542b42c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460073.960991:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc2bd5c00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460073.960994:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542b42c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460073.961000:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542b42c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460073.961018:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4bfa9fe100) 00010000:00010000:0.0:1788460073.961021:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460073.961025:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542b42c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460073.961030:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542b42c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460073.961106:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc4718a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+12:11277:x1875336003367168:12345-192.168.206.5@tcp:34:lhsmtool_posix.0 Request processed in 600us (3728us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460073.961115:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 79 00000100:00100000:3.0:1788460073.964925:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460073.965047:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003367424 00000100:00100000:1.0:1788460073.965057:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003367424 00000100:00100000:1.0:1788460073.965108:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 80 00000100:00100000:1.0:1788460073.965117:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc6761180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+12:11277:x1875336003367424:12345-192.168.206.5@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788460073.965148:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460073.965169:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677a00/0x5dfa74784542b433 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a6b5 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460073.965265:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676800/0x5dfa74784542b43a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460073.965291:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676800/0x5dfa74784542b43a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460073.965302:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676800/0x5dfa74784542b43a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788460073.965313:0:6534:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788460073.965386:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676800/0x5dfa74784542b43a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460073.965392:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676800/0x5dfa74784542b43a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460073.965398:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676800/0x5dfa74784542b43a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460073.965403:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac3676800 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:1.0:1788460073.965407:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676800/0x5dfa74784542b43a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460073.965415:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676800/0x5dfa74784542b43a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460073.965427:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4bfa9fe100) 00010000:00010000:1.0:1788460073.965430:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788460073.965435:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676800/0x5dfa74784542b43a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460073.965441:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676800/0x5dfa74784542b43a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460073.965480:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677a00/0x5dfa74784542b433 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a6b5 expref: 14 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460073.965497:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c4bef1fde00) 00010000:00010000:1.0:1788460073.965499:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788460073.965503:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677a00/0x5dfa74784542b433 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a6b5 expref: 14 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460073.965513:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ac3677a00, rc 0) 00000100:00100000:1.0:1788460073.965581:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc6761180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+13:11277:x1875336003367424:12345-192.168.206.5@tcp:101:lhsmtool_posix.0 Request processed in 464us (666us total) trans 4294967353 rc 301/301 00000100:00100000:1.0:1788460073.965588:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 80 00000100:00100000:1.0:1788460073.976212:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460073.976389:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003367552 00000100:00100000:3.0:1788460073.976398:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003367552 00000100:00100000:3.0:1788460073.976459:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 81 00000100:00100000:3.0:1788460073.976469:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc4394a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+13:11277:x1875336003367552:12345-192.168.206.5@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788460073.976505:0:6533:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788460073.976619:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc4394a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+13:11277:x1875336003367552:12345-192.168.206.5@tcp:53:lhsmtool_posix.0 Request processed in 150us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460073.976653:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 81 00000100:00100000:1.0:1788460073.989900:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460073.990379:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003367808 00000100:00100000:3.0:1788460073.990389:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003367808 00000100:00100000:3.0:1788460073.990451:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 82 00000100:00100000:3.0:1788460073.990461:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc4395c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+13:11277:x1875336003367808:12345-192.168.206.5@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788460073.990481:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460073.990484:0:6534:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788460073.990508:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5a00/0x5dfa74784542b3ed lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a6a7 expref: 13 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460073.990525:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8c4bc2ab7100) 00010000:00010000:3.0:1788460073.990530:0:6534:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788460073.990543:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840400/0x5dfa74784542b448 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a6bc expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788460073.990890:0:6534:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:3.0:1788460073.991833:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841c00/0x5dfa74784542b44f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460073.991848:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841c00/0x5dfa74784542b44f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460073.991857:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841c00/0x5dfa74784542b44f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460073.991921:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840400/0x5dfa74784542b448 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a6bc expref: 15 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460073.992064:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841c00/0x5dfa74784542b44f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a6bc expref: 14 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460073.992073:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8c4bef200800) 00010000:00010000:3.0:1788460073.992076:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788460073.992079:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ac2841c00, rc 0) 00000100:00100000:3.0:1788460073.992160:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc4395c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+14:11277:x1875336003367808:12345-192.168.206.5@tcp:101:lhsmtool_posix.0 Request processed in 1700us (2267us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1788460073.992170:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 82 00000100:00100000:3.0:1788460073.998509:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460074.001252:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003368064 00000100:00100000:0.0:1788460074.001266:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003368064 00000100:00100000:0.0:1788460074.001353:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 83 00000100:00100000:0.0:1788460074.001364:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc6763100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+14:11277:x1875336003368064:12345-192.168.206.5@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788460074.001416:0:6535:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788460074.001454:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841c00/0x5dfa74784542b44f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a6bc expref: 14 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460074.001471:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8c4bef200800) 00010000:00010000:0.0:1788460074.001481:0:6535:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788460074.001503:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542b45d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460074.001517:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542b45d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460074.001526:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542b45d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460074.001550:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5000/0x5dfa74784542b464 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xfdd11949 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460074.001557:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5000/0x5dfa74784542b464 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xfdd11949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460074.001564:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5000/0x5dfa74784542b464 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xfdd11949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460074.001607:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542b45d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460074.001615:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542b45d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460074.001622:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542b45d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460074.001628:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc2bd5c00 already unused, calling callback (ffffffffc18714f0) 00000100:00080000:1.0:1788460074.001748:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788460074.002083:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542b45d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460074.002095:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542b45d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460074.002105:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8c4bc2ab7100) 00010000:00010000:0.0:1788460074.002108:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460074.002113:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542b45d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460074.002120:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542b45d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460074.002139:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5000/0x5dfa74784542b464 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xfdd11949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460074.002145:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5000/0x5dfa74784542b464 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xfdd11949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460074.002150:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5000/0x5dfa74784542b464 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xfdd11949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460074.002155:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc2bd5000 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460074.002159:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5000/0x5dfa74784542b464 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xfdd11949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460074.002165:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5000/0x5dfa74784542b464 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xfdd11949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460074.002173:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xfdd11949 (ffff8c4bc5dc1400) 00010000:00010000:0.0:1788460074.002175:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460074.002178:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5000/0x5dfa74784542b464 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xfdd11949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460074.002183:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5000/0x5dfa74784542b464 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xfdd11949 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460074.010535:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc6763100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+13:11277:x1875336003368064:12345-192.168.206.5@tcp:36:lhsmtool_posix.0 Request processed in 9160us (12020us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788460074.010552:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 83 00000100:00100000:2.0:1788460074.014776:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460074.014905:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003368192 00000100:00100000:3.0:1788460074.014925:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003368192 00000100:00100000:3.0:1788460074.014998:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 84 00000100:00100000:3.0:1788460074.015008:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc532a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+13:11277:x1875336003368192:12345-192.168.206.5@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788460074.015027:0:7760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460074.015047:0:7760:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840400/0x5dfa74784542b46b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a6c3 expref: -99 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460074.015082:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840000/0x5dfa74784542b472 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460074.015095:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840000/0x5dfa74784542b472 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460074.015107:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840000/0x5dfa74784542b472 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460074.015383:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840400/0x5dfa74784542b46b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a6c3 expref: 15 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460074.015399:0:7760:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840000/0x5dfa74784542b472 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a6c3 expref: 14 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460074.015407:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8c4bef200000) 00010000:00010000:3.0:1788460074.015410:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788460074.015414:0:7760:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ac2840000, rc 0) 00000100:00100000:3.0:1788460074.015475:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc532a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+14:11277:x1875336003368192:12345-192.168.206.5@tcp:101:lhsmtool_posix.0 Request processed in 468us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460074.015482:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 84 00000100:00100000:0.0:1788460074.028897:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460074.029002:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003368448 00000100:00100000:3.0:1788460074.029012:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003368448 00000100:00100000:3.0:1788460074.029068:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 85 00000100:00100000:3.0:1788460074.029078:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac366bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+14:11277:x1875336003368448:12345-192.168.206.5@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788460074.029299:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840400/0x5dfa74784542b479 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460074.029316:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840400/0x5dfa74784542b479 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460074.029327:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840400/0x5dfa74784542b479 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788460074.029484:0:6534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:3.0:1788460074.029495:0:6534:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 371132550158ns, next at 372132547823ns, rc = 0 00000004:00010000:3.0:1788460074.029549:0:6534:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000024f0dfd reply state 00000000b1aeca3f transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840400/0x5dfa74784542b479 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460074.029562:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840400/0x5dfa74784542b479 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460074.029569:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8c4bef200000) 00010000:00010000:3.0:1788460074.029572:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788460074.029576:0:6534:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788460074.030361:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac366bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+16:11277:x1875336003368448:12345-192.168.206.5@tcp:36:lhsmtool_posix.0 Request processed in 1279us (1467us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1788460074.030370:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 85 00000100:00100000:3.0:1788460074.032561:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460074.039970:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003368576 00000100:00100000:0.0:1788460074.039985:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003368576 00000100:00100000:0.0:1788460074.040062:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 86 00000100:00100000:0.0:1788460074.040073:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc6760380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+16:11277:x1875336003368576:12345-192.168.206.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788460074.040095:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460074.040114:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542b480 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a6ca expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460074.040171:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542b480 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a6ca expref: 17 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460074.040185:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542b480 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a6ca expref: 17 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460074.040203:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8c4bef200000) 00010000:00010000:0.0:1788460074.040207:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788460074.040210:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc2bd5c00, rc 0) 00000100:00100000:0.0:1788460074.040271:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc6760380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+17:11277:x1875336003368576:12345-192.168.206.5@tcp:101:lhsmtool_posix.0 Request processed in 200us (7718us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460074.040279:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 86 00000100:00100000:0.0:1788460074.047753:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460074.047816:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003368704 00000100:00100000:1.0:1788460074.047826:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003368704 00000100:00100000:1.0:1788460074.047876:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 33 00000100:00100000:1.0:1788460074.047884:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac405c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2392:x1875336003368704:12345-192.168.206.5@tcp:8:lhsmtool_posix.0 00010000:00080000:1.0:1788460074.047927:0:8449:0:(ldlm_lib.c:1461:target_handle_connect()) lustre-OST0000: connection from f8767d3e-bfef-4d3d-8163-ef8ae18a3514@192.168.206.5@tcp t0 exp 0000000000000000 cur 371 last 0 00000020:00000080:1.0:1788460074.047974:0:8449:0:(genops.c:1385:class_connect()) connect: client f8767d3e-bfef-4d3d-8163-ef8ae18a3514, cookie 0x5dfa74784542b487 00002000:00100000:1.0:1788460074.047985:0:8449:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f8767d3e-bfef-4d3d-8163-ef8ae18a3514/ffff8c4ac40a6800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a07 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788460074.048004:0:8449:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788460074.048085:0:8449:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788460074.048113:0:8449:0:(import.c:65:import_set_state_nolock()) ffff8c4ac40a6000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788460074.048180:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac405c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:2392:x1875336003368704:12345-192.168.206.5@tcp:8:lhsmtool_posix.0 Request processed in 295us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460074.048200:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 33 00000100:00100000:3.0:1788460074.053417:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460074.053573:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003368832 00000100:00100000:0.0:1788460074.053584:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003368832 00000100:00100000:0.0:1788460074.053652:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 34 00000100:00100000:0.0:1788460074.053662:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc6763b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:0:x1875336003368832:12345-192.168.206.5@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1788460074.056746:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1788460074.058140:0:8443:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00100000:0.0:1788460074.058155:0:8443:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f8767d3e-bfef-4d3d-8163-ef8ae18a3514 00000100:00100000:3.0:1788460074.072233:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc6763b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:0:x1875336003368832:12345-192.168.206.5@tcp:2:lhsmtool_posix.0 Request processed in 18561us (18824us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788460074.072246:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 34 00000100:00100000:3.0:1788460074.072410:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac405d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022330240:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788460074.072464:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460074.072620:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022330240 00000100:00100000:0.0:1788460074.072628:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022330240 00000100:00100000:0.0:1788460074.072695:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788460074.072704:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc6760000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022330240:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788460074.072745:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446453248 avail 1300213760 00000100:00100000:0.0:1788460074.072786:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc6760000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022330240:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460074.072792:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788460074.072933:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac405d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022330240:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788460074.079397:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460074.079523:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003369088 00000100:00100000:0.0:1788460074.079532:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003369088 00000100:00100000:0.0:1788460074.079591:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 19 00000100:00100000:0.0:1788460074.079602:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc532a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+17:11277:x1875336003369088:12345-192.168.206.5@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788460074.079829:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc532a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+18:11277:x1875336003369088:12345-192.168.206.5@tcp:35:lhsmtool_posix.0 Request processed in 229us (440us total) trans 4294967356 rc 0/0 00000100:00100000:0.0:1788460074.079836:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 19 00000100:00100000:2.0:1788460074.083921:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460074.084308:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003369344 00000100:00100000:3.0:1788460074.084317:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003369344 00000100:00100000:3.0:1788460074.084416:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 87 00000100:00100000:3.0:1788460074.084426:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc5328e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+18:11277:x1875336003369344:12345-192.168.206.5@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788460074.084534:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc5328e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+18:11277:x1875336003369344:12345-192.168.206.5@tcp:57:lhsmtool_posix.0 Request processed in 110us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460074.084557:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 87 00000100:00100000:2.0:1788460074.098356:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460074.100270:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003369472 00000100:00100000:3.0:1788460074.100284:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003369472 00000100:00100000:2.0:1788460074.102331:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 88 00000100:00100000:2.0:1788460074.102345:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc532b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+18:11277:x1875336003369472:12345-192.168.206.5@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788460074.102365:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460074.102385:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542b48e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a6d1 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460074.102456:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b495 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460074.102470:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b495 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460074.102492:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b495 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788460074.102540:0:6533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788460074.102557:0:6533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b495 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460074.102580:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542b48e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a6d1 expref: 20 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460074.102595:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b495 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a6d1 expref: 19 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460074.102604:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8c4bef200000) 00010000:00010000:2.0:1788460074.102607:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788460074.102610:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bfadc7600, rc 0) 00000100:00100000:2.0:1788460074.102683:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc532b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+19:11277:x1875336003369472:12345-192.168.206.5@tcp:101:lhsmtool_posix.0 Request processed in 341us (4335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460074.102690:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 88 00000100:00100000:3.0:1788460074.106567:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460074.106665:0:8832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003369600 00000100:00100000:1.0:1788460074.106675:0:8832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003369600 00000100:00100000:1.0:1788460074.106737:0:8832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 35 00000100:00100000:1.0:1788460074.106748:0:8832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc6761c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2394:x1875336003369600:12345-192.168.206.5@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788460074.106765:0:8832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460074.106784:0:8832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000806d8bda/0x5dfa74784542b49c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a6d8 expref: -99 pid: 8832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788460074.106806:0:8832:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a99bc28, blocks: 0x0 00010000:00010000:1.0:1788460074.106827:0:8832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=371s v=(0 0) 00010000:00010000:1.0:1788460074.106832:0:8832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460074.106842:0:8832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000806d8bda/0x5dfa74784542b49c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a6d8 expref: 6 pid: 8832 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460074.106859:0:8832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000806d8bda/0x5dfa74784542b49c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a6d8 expref: 6 pid: 8832 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460074.106871:0:8832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ac3676800, rc 0) 00000100:00100000:1.0:1788460074.106928:0:8832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc6761c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:2394:x1875336003369600:12345-192.168.206.5@tcp:101:lhsmtool_posix.0 Request processed in 183us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460074.106935:0:8832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 35 00000100:00100000:3.0:1788460074.115209:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460074.116158:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003369856 00000100:00100000:0.0:1788460074.116170:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003369856 00000100:00100000:0.0:1788460074.116231:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 89 00000100:00100000:0.0:1788460074.116241:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc6763800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+19:11277:x1875336003369856:12345-192.168.206.5@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788460074.116347:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc6763800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+19:11277:x1875336003369856:12345-192.168.206.5@tcp:57:lhsmtool_posix.0 Request processed in 107us (1146us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460074.116355:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 89 00000100:00100000:3.0:1788460074.132354:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460074.132508:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003369984 00000100:00100000:0.0:1788460074.132518:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003369984 00000100:00100000:0.0:1788460074.132574:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 36 00000100:00100000:0.0:1788460074.132583:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc6761f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:11277:x1875336003369984:12345-192.168.206.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788460074.132600:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460074.132623:0:8450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f737b230/0x5dfa74784542b4a3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a6df expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460074.132663:0:8450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000806d8bda/0x5dfa74784542b49c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a6d8 expref: 7 pid: 8832 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460074.132672:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460074.132676:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460074.132681:0:8450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f737b230/0x5dfa74784542b4a3 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a6df expref: 7 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460074.132723:0:8450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000806d8bda/0x5dfa74784542b49c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a6d8 expref: 7 pid: 8832 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460074.132737:0:8450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000806d8bda/0x5dfa74784542b49c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a6d8 expref: 7 pid: 8832 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460074.132751:0:8450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac405dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8450:1875336022330368:192.168.206.5@tcp:104: 00000100:00100000:0.0:1788460074.132828:0:8450:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc65d7e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788460074.136348:0:8450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac405dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8450:1875336022330368:192.168.206.5@tcp:104: 00010000:00010000:0.0:1788460074.136383:0:8450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f737b230/0x5dfa74784542b4a3 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a6df expref: 7 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460074.136404:0:8450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc2bd4400, rc 0) 00000100:00100000:0.0:1788460074.136457:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc6761f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+7:11277:x1875336003369984:12345-192.168.206.5@tcp:101:lhsmtool_posix.0 Request processed in 3874us (4111us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460074.136481:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 36 00000100:00100000:3.0:1788460074.138239:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460074.138362:0:9538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003370112 00000100:00100000:1.0:1788460074.138372:0:9538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003370112 00010000:00010000:1.0:1788460074.138409:0:9538:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000806d8bda/0x5dfa74784542b49c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a6d8 expref: 7 pid: 8832 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460074.138472:0:9538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 67 00000100:00100000:1.0:1788460074.138482:0:9538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc532c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+7:2394:x1875336003370112:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788460074.138497:0:9538:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788460074.138517:0:9538:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000806d8bda/0x5dfa74784542b49c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a6d8 expref: 7 pid: 8832 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460074.138530:0:9538:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000806d8bda/0x5dfa74784542b49c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a6d8 expref: 7 pid: 8832 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460074.138552:0:9538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000806d8bda/0x5dfa74784542b49c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a6d8 expref: 7 pid: 8832 timeout: 471 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460074.138567:0:9538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460074.138571:0:9538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460074.138578:0:9538:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f737b230/0x5dfa74784542b4a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a6df expref: 6 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460074.138588:0:9538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f737b230/0x5dfa74784542b4a3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a6df expref: 6 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460074.138620:0:9538:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000f737b230/0x5dfa74784542b4a3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a6df expref: 6 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460074.138632:0:9538:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4396300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9538:1875336022330496:192.168.206.5@tcp:105: 00000100:00100000:1.0:1788460074.139407:0:9538:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac36aac00 going to sleep for 11 seconds 00000100:00100000:3.0:1788460074.148652:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460074.149869:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003370240 00000100:00100000:2.0:1788460074.149882:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003370240 00002000:00100000:2.0:1788460074.150203:0:8455:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff8c4bc532dc00 x1875336003370240/t0(0) o4->f8767d3e-bfef-4d3d-8163-ef8ae18a3514@192.168.206.5@tcp:230/0 lens 504/0 e 0 to 0 dl 1788460085 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788460074.150215:0:8455:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c4bc532dc00 with x1875336003370240 ext(0->8) 00002000:00010000:2.0:1788460074.150221:0:8455:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c4bc532dc00 00000100:00100000:1.0:1788460074.150359:0:9538:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4396300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9538:1875336022330496:192.168.206.5@tcp:105: 00010000:00010000:1.0:1788460074.150382:0:9538:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788460074.150438:0:9538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc532c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+7:2394:x1875336003370112:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 11957us (12300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460074.150448:0:9538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 67 00000100:00100000:2.0:1788460074.150624:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 0 00000100:00100000:2.0:1788460074.150640:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc532dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:2393:x1875336003370240:12345-192.168.206.5@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788460074.157304:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc532dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+8:2393:x1875336003370240:12345-192.168.206.5@tcp:4:lhsmtool_posix.0 Request processed in 6661us (8652us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1788460074.157324:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 0 00002000:00100000:3.0:1788460074.157337:0:8455:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff8c4bc532dc00 x1875336003370240/t4294967303(0) o4->f8767d3e-bfef-4d3d-8163-ef8ae18a3514@192.168.206.5@tcp:230/0 lens 504/448 e 0 to 0 dl 1788460085 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788460074.157348:0:8455:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c4bc532dc00 with x1875336003370240 ext(0->8) 00002000:00010000:3.0:1788460074.157354:0:8455:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c4bc532dc00 00000100:00100000:3.0:1788460074.165200:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460074.165305:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003370368 00000100:00100000:2.0:1788460074.165314:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003370368 00000100:00100000:2.0:1788460074.165368:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 90 00000100:00100000:2.0:1788460074.165378:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac39d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+19:11277:x1875336003370368:12345-192.168.206.5@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788460074.168823:0:6513:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:3.0:1788460074.168838:0:6513:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:3.0:1788460074.168863:0:6513:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:3.0:1788460074.168886:0:6565:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:3.0:1788460074.168896:0:6565:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1788460074.169083:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac39d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+15:11277:x1875336003370368:12345-192.168.206.5@tcp:44:lhsmtool_posix.0 Request processed in 3700us (3886us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460074.169094:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 90 00000100:00100000:1.0:1788460074.169302:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788460074.169318:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4396300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022330624:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788460074.169371:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460074.169414:0:8832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022330624 00000100:00100000:1.0:1788460074.169422:0:8832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022330624 00000100:00100000:1.0:1788460074.169474:0:8832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788460074.169483:0:8832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc4395180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3662:x1875336022330624:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788460074.169615:0:8832:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788460074.169619:0:8832:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788460073 00002000:00010000:1.0:1788460074.169622:0:8832:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788460074.169624:0:8832:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1788460072 -> 1788460073 00002000:00010000:1.0:1788460074.169626:0:8832:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1788460074.169675:0:8832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc4395180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3662:x1875336022330624:12345-0@lo:2:osp-syn-0-0.0 Request processed in 194us (304us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788460074.169683:0:8832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000004:00080000:1.0:1788460074.169732:0:3662:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8c4bc4396300/2, rc 0, transno 4294967304 00000100:00100000:1.0:1788460074.169738:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4396300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022330624:0@lo:2:osp-syn-0-0.0 00000100:00080000:1.0:1788460074.169751:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788460074.172319:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840400/0x5dfa74784542b479 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460074.172335:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840400/0x5dfa74784542b479 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460074.172343:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840400/0x5dfa74784542b479 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460074.172348:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac2840400 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460074.172353:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840400/0x5dfa74784542b479 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460074.172360:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840400/0x5dfa74784542b479 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460074.172375:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8c4bef200000) 00010000:00010000:0.0:1788460074.172378:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788460074.172383:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840400/0x5dfa74784542b479 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460074.172389:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840400/0x5dfa74784542b479 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460074.173525:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460074.173587:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003370496 00000100:00100000:3.0:1788460074.173597:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003370496 00000100:00100000:3.0:1788460074.173781:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 38 00000100:00100000:3.0:1788460074.173791:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc4394380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+8:2394:x1875336003370496:12345-192.168.206.5@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1788460074.182110:0:8443:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:0.0:1788460074.182125:0:8443:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:3.0:1788460074.183555:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc4394380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:2394:x1875336003370496:12345-192.168.206.5@tcp:16:lhsmtool_posix.0 Request processed in 9756us (10027us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460074.183568:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 38 00000100:00100000:2.0:1788460074.193599:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460074.193730:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003370752 00000100:00100000:3.0:1788460074.193741:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003370752 00000100:00100000:3.0:1788460074.193795:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 91 00000100:00100000:3.0:1788460074.193804:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc5328380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+14:11277:x1875336003370752:12345-192.168.206.5@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788460074.193870:0:6533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788460074.193896:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b495 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a6d1 expref: 14 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460074.193924:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8c4bef200000) 00010000:00010000:3.0:1788460074.193929:0:6533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788460074.194185:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841800/0x5dfa74784542b4aa lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460074.194200:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841800/0x5dfa74784542b4aa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460074.194210:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841800/0x5dfa74784542b4aa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788460074.194318:0:6533:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000fa56514 reply state 00000000fd88bdb7 transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841800/0x5dfa74784542b4aa lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460074.194328:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841800/0x5dfa74784542b4aa lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460074.194339:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8c4bef200000) 00010000:00010000:3.0:1788460074.194342:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788460074.194345:0:6533:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788460074.194433:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc5328380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+15:11277:x1875336003370752:12345-192.168.206.5@tcp:36:lhsmtool_posix.0 Request processed in 630us (843us total) trans 4294967357 rc 0/0 00000100:00100000:3.0:1788460074.194440:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 91 00000100:00100000:2.0:1788460074.196866:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460074.197360:0:8832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003370880 00000100:00100000:3.0:1788460074.197371:0:8832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003370880 00000100:00100000:3.0:1788460074.197419:0:8832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 39 00000100:00100000:3.0:1788460074.197429:0:8832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfa1e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:2393:x1875336003370880:12345-192.168.206.5@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788460074.197574:0:8832:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1788460074.197578:0:8832:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1788460073 -> 1788460071 00002000:00010000:3.0:1788460074.197580:0:8832:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788460069 00002000:00010000:3.0:1788460074.197582:0:8832:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1788460073 -> 1788460071 00002000:00010000:3.0:1788460074.197584:0:8832:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1788460074.197742:0:8832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfa1e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+7:2393:x1875336003370880:12345-192.168.206.5@tcp:2:lhsmtool_posix.0 Request processed in 314us (883us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1788460074.197751:0:8832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 39 00000040:00080000:1.0:1788460074.204503:0:14225:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788460074.204518:0:14225:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788460074.204546:0:14225:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788460074.204552:0:14225:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788460074.217057:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460074.217568:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003371136 00000100:00100000:3.0:1788460074.217580:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003371136 00000100:00100000:3.0:1788460074.217700:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 92 00000100:00100000:3.0:1788460074.217723:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc4397b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+15:11277:x1875336003371136:12345-192.168.206.5@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788460074.217792:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841600/0x5dfa74784542b4b1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460074.217809:0:6534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840000/0x5dfa74784542b472 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a6c3 expref: 15 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460074.217826:0:6534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841600/0x5dfa74784542b4b1 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460074.217861:0:6534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840000/0x5dfa74784542b472 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a6c3 expref: 15 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460074.217875:0:6534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840000/0x5dfa74784542b472 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a6c3 expref: 15 pid: 7760 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460074.217889:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4138e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6534:1875336022330752:192.168.206.5@tcp:104: 00000100:00100000:3.0:1788460074.217998:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bf7753900 going to sleep for 11 seconds 00000100:00100000:3.0:1788460074.231255:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4138e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6534:1875336022330752:192.168.206.5@tcp:104: 00010000:00010000:3.0:1788460074.231283:0:6534:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841600/0x5dfa74784542b4b1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460074.237778:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460074.237853:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003371264 00000100:00100000:2.0:1788460074.237863:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003371264 00010000:00010000:2.0:1788460074.237904:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840000/0x5dfa74784542b472 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a6c3 expref: 16 pid: 7760 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460074.237987:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 68 00000100:00100000:2.0:1788460074.237997:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4138e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+16:2394:x1875336003371264:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788460074.238012:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460074.238019:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840000/0x5dfa74784542b472 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a6c3 expref: 16 pid: 7760 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460074.238031:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840000/0x5dfa74784542b472 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a6c3 expref: 16 pid: 7760 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460074.238063:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840000/0x5dfa74784542b472 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a6c3 expref: 16 pid: 7760 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460074.238081:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8c4bef200000) 00010000:00010000:2.0:1788460074.238085:0:6520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841600/0x5dfa74784542b4b1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460074.238112:0:6520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841600/0x5dfa74784542b4b1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460074.238120:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841600/0x5dfa74784542b4b1 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460074.238148:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788460074.238195:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4138e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+15:2394:x1875336003371264:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 198us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460074.238202:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 68 00010000:00010000:3.0:1788460074.238653:0:6534:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841600/0x5dfa74784542b4b1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460074.238663:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841600/0x5dfa74784542b4b1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460074.238700:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841600/0x5dfa74784542b4b1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460074.238706:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841600/0x5dfa74784542b4b1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460074.238737:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841600/0x5dfa74784542b4b1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460074.238743:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac2841600 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:3.0:1788460074.238748:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841600/0x5dfa74784542b4b1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460074.238756:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841600/0x5dfa74784542b4b1 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460074.238767:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8c4bef200000) 00010000:00010000:3.0:1788460074.238770:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788460074.238774:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841600/0x5dfa74784542b4b1 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460074.238780:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841600/0x5dfa74784542b4b1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460074.238842:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc4397b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+14:11277:x1875336003371136:12345-192.168.206.5@tcp:55:lhsmtool_posix.0 Request processed in 21132us (21805us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788460074.238851:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 92 00000100:00100000:0.0:1788460074.276981:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460074.277017:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003371392 00000100:00100000:0.0:1788460074.277026:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003371392 00000100:00100000:0.0:1788460074.277432:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 40 00000100:00100000:0.0:1788460074.277452:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac405dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+7:2394:x1875336003371392:12345-192.168.206.5@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788460074.277490:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f19e6968/0x5dfa74784542b4b8 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460074.277508:0:8450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f737b230/0x5dfa74784542b4a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a6df expref: 7 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460074.277517:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460074.277522:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788460074.277526:0:8450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f19e6968/0x5dfa74784542b4b8 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460074.277556:0:8450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f737b230/0x5dfa74784542b4a3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a6df expref: 7 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460074.277569:0:8450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f737b230/0x5dfa74784542b4a3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a6df expref: 7 pid: 8450 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460074.277582:0:8450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac405f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8450:1875336022330880:192.168.206.5@tcp:104: 00000100:00100000:0.0:1788460074.277770:0:8450:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc65d7e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788460074.287520:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460074.287560:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003371520 00000100:00100000:2.0:1788460074.287569:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003371520 00010000:00010000:2.0:1788460074.287608:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f737b230/0x5dfa74784542b4a3 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a6df expref: 8 pid: 8450 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460074.287705:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 69 00000100:00100000:2.0:1788460074.287727:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+8:2394:x1875336003371520:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788460074.287742:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460074.287763:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f737b230/0x5dfa74784542b4a3 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a6df expref: 8 pid: 8450 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460074.287778:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f737b230/0x5dfa74784542b4a3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a6df expref: 8 pid: 8450 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460074.287803:0:6518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788460074.287807:0:6518:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788460074.287823:0:6518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f19e6968/0x5dfa74784542b4b8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460074.287833:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f19e6968/0x5dfa74784542b4b8 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460074.287853:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788460074.287895:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+8:2394:x1875336003371520:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 182us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460074.287902:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 69 00010000:00010000:3.0:1788460074.292317:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f737b230/0x5dfa74784542b4a3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a6df expref: 7 pid: 8450 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460074.292343:0:8450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac405f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8450:1875336022330880:192.168.206.5@tcp:104: 00010000:00010000:3.0:1788460074.292368:0:8450:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f19e6968/0x5dfa74784542b4b8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460074.292390:0:8450:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f19e6968/0x5dfa74784542b4b8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460074.292397:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f19e6968/0x5dfa74784542b4b8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460074.292424:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f19e6968/0x5dfa74784542b4b8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460074.292432:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f19e6968/0x5dfa74784542b4b8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460074.292439:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f19e6968/0x5dfa74784542b4b8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460074.292446:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc2bd5800 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:3.0:1788460074.292451:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f19e6968/0x5dfa74784542b4b8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460074.292458:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f19e6968/0x5dfa74784542b4b8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460074.292476:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f19e6968/0x5dfa74784542b4b8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460074.292494:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f19e6968/0x5dfa74784542b4b8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460074.292570:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac405dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:2394:x1875336003371392:12345-192.168.206.5@tcp:1:lhsmtool_posix.0 Request processed in 15119us (15625us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460074.292580:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 40 00000100:00100000:2.0:1788460074.299918:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460074.300299:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003371776 00000100:00100000:3.0:1788460074.300309:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003371776 00000100:00100000:3.0:1788460074.300500:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 93 00000100:00100000:3.0:1788460074.300511:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+14:11277:x1875336003371776:12345-192.168.206.5@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788460074.300584:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841600/0x5dfa74784542b4bf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460074.300600:0:7760:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d1a00/0x5dfa74784542b2ff lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a668 expref: 14 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460074.300609:0:7760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841600/0x5dfa74784542b4bf lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460074.300800:0:7760:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d1a00/0x5dfa74784542b2ff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a668 expref: 14 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460074.300819:0:7760:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d1a00/0x5dfa74784542b2ff lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a668 expref: 14 pid: 6533 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460074.300835:0:7760:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4138000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7760:1875336022331008:192.168.206.5@tcp:104: 00000100:00100000:3.0:1788460074.301268:0:7760:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bf7753900 going to sleep for 11 seconds 00000100:00100000:3.0:1788460074.314839:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460074.314870:0:9538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003371904 00000100:00100000:3.0:1788460074.314878:0:9538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003371904 00010000:00010000:3.0:1788460074.314915:0:9538:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d1a00/0x5dfa74784542b2ff lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a668 expref: 15 pid: 6533 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460074.314979:0:9538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 70 00000100:00100000:3.0:1788460074.314990:0:9538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+15:2393:x1875336003371904:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788460074.315003:0:9538:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788460074.315011:0:9538:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d1a00/0x5dfa74784542b2ff lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a668 expref: 15 pid: 6533 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460074.315023:0:9538:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d1a00/0x5dfa74784542b2ff lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a668 expref: 15 pid: 6533 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460074.315043:0:9538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4bfa9fe100) 00010000:00010000:3.0:1788460074.315048:0:9538:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841600/0x5dfa74784542b4bf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460074.315057:0:9538:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841600/0x5dfa74784542b4bf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460074.315064:0:9538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841600/0x5dfa74784542b4bf lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460074.315080:0:9538:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788460074.315124:0:9538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+15:2393:x1875336003371904:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 136us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460074.316285:0:9538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 70 00010000:00010000:3.0:1788460074.316934:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d1a00/0x5dfa74784542b2ff lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a668 expref: 14 pid: 6533 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460074.316982:0:7760:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4138000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7760:1875336022331008:192.168.206.5@tcp:104: 00010000:00010000:3.0:1788460074.317002:0:7760:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841600/0x5dfa74784542b4bf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460074.317010:0:7760:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841600/0x5dfa74784542b4bf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460074.317016:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841600/0x5dfa74784542b4bf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460074.318736:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b4c6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460074.318758:0:7760:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542b480 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a6ca expref: 14 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460074.318767:0:7760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b4c6 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460074.318803:0:7760:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542b480 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a6ca expref: 14 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460074.318818:0:7760:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542b480 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a6ca expref: 14 pid: 6535 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460074.318832:0:7760:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac41b9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7760:1875336022331136:192.168.206.5@tcp:104: 00000100:00100000:2.0:1788460074.318934:0:7760:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bd0b68f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788460074.323724:0:7760:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac41b9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7760:1875336022331136:192.168.206.5@tcp:104: 00010000:00010000:2.0:1788460074.323763:0:7760:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b4c6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460074.332120:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460074.332614:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003372032 00000100:00100000:1.0:1788460074.332625:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003372032 00010000:00010000:1.0:1788460074.332676:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542b480 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a6ca expref: 15 pid: 6535 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460074.332729:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 71 00000100:00100000:1.0:1788460074.332738:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bedf6e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+15:2394:x1875336003372032:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788460074.332752:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788460074.332758:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542b480 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a6ca expref: 15 pid: 6535 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460074.332771:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542b480 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a6ca expref: 15 pid: 6535 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460074.332792:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542b480 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a6ca expref: 15 pid: 6535 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460074.332806:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8c4bef200000) 00010000:00010000:1.0:1788460074.332811:0:6519:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b4c6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460074.332820:0:6519:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b4c6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460074.332827:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b4c6 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460074.332871:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788460074.332919:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bedf6e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+14:2394:x1875336003372032:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 182us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460074.332926:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 71 00010000:00010000:3.0:1788460074.335475:0:7760:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b4c6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460074.335490:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b4c6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788460074.335602:0:7760:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:3.0:1788460074.335741:0:7760:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:3.0:1788460074.335778:0:7760:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:3.0:1788460074.335855:0:7760:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac41bf800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7760:1875336022331264:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788460074.335919:0:7760:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460074.335996:0:7760:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac286ca80 going to sleep for 11 seconds 00000100:00100000:1.0:1788460074.337621:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022331264 00000100:00100000:1.0:1788460074.337644:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022331264 00000100:00100000:1.0:1788460074.337724:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788460074.337735:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7760:x1875336022331264:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788460074.337854:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7760:x1875336022331264:12345-0@lo:1000:mdt00_003.0 Request processed in 121us (1934us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460074.337862:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788460074.338665:0:7760:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1788460074.338672:0:7760:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8c4bc4396300, transno 4294967304 00000100:00100000:3.0:1788460074.338704:0:7760:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac41bf800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7760:1875336022331264:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1788460074.338863:0:7760:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:3.0:1788460074.338974:0:7760:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac41bf800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7760:1875336022331392:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788460074.339024:0:7760:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460074.340872:0:7760:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac286c840 going to sleep for 11 seconds 00000100:00100000:3.0:1788460074.341494:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022331392 00000100:00100000:3.0:1788460074.341505:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022331392 00000100:00100000:3.0:1788460074.341615:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788460074.341625:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7760:x1875336022331392:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788460074.341819:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7760:x1875336022331392:12345-0@lo:1000:mdt00_003.0 Request processed in 195us (2793us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788460074.341828:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788460074.343058:0:7760:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac41bf800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7760:1875336022331392:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1788460074.343115:0:7760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b4c6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460074.343126:0:7760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b4c6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460074.343134:0:7760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b4c6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460074.343141:0:7760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bfadc6400 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:2.0:1788460074.343146:0:7760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b4c6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460074.343153:0:7760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b4c6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460074.343168:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8c4bef200000) 00010000:00010000:2.0:1788460074.343172:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788460074.343176:0:7760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b4c6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460074.343182:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b4c6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460074.343211:0:7760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542b3f4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460074.343218:0:7760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542b3f4 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460074.343232:0:7760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542b3f4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460074.343238:0:7760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bfadc7400 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:2.0:1788460074.343240:0:7760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542b3f4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460074.343246:0:7760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542b3f4 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460074.343255:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4bfa9fe100) 00010000:00010000:2.0:1788460074.343258:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788460074.343261:0:7760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542b3f4 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460074.343266:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542b3f4 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460074.343287:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b4cd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460074.343300:0:7760:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841200/0x5dfa74784542b410 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a6ae expref: 17 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460074.343308:0:7760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b4cd lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460074.343339:0:7760:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841200/0x5dfa74784542b410 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a6ae expref: 17 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460074.343353:0:7760:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841200/0x5dfa74784542b410 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a6ae expref: 17 pid: 6534 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460074.343375:0:7760:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac41b9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7760:1875336022331520:192.168.206.5@tcp:104: 00000100:00100000:2.0:1788460074.343449:0:7760:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bd0b68f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788460074.355850:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460074.355920:0:9549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003372160 00000100:00100000:0.0:1788460074.355931:0:9549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003372160 00010000:00010000:0.0:1788460074.356006:0:9549:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841200/0x5dfa74784542b410 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a6ae expref: 18 pid: 6534 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460074.356064:0:9549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 72 00000100:00100000:0.0:1788460074.356074:0:9549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+18:2393:x1875336003372160:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788460074.356102:0:9549:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788460074.356108:0:9549:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841200/0x5dfa74784542b410 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a6ae expref: 18 pid: 6534 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460074.356122:0:9549:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841200/0x5dfa74784542b410 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a6ae expref: 18 pid: 6534 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460074.356552:0:9549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4bfa9fe100) 00010000:00010000:0.0:1788460074.356559:0:9549:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b4cd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460074.356569:0:9549:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b4cd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460074.356578:0:9549:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b4cd lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460074.356599:0:9549:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788460074.356649:0:9549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+18:2393:x1875336003372160:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 576us (808us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460074.356658:0:9549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 72 00010000:00010000:3.0:1788460074.357655:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841200/0x5dfa74784542b410 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a6ae expref: 17 pid: 6534 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460074.357676:0:7760:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac41b9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7760:1875336022331520:192.168.206.5@tcp:104: 00010000:00010000:3.0:1788460074.357697:0:7760:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b4cd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460074.357707:0:7760:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b4cd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460074.357725:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b4cd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460074.357737:0:7760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b4cd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460074.357744:0:7760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b4cd lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460074.357765:0:7760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b4cd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460074.357771:0:7760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bfadc7200 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:3.0:1788460074.357775:0:7760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b4cd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460074.357783:0:7760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b4cd lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460074.357796:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4bfa9fe100) 00010000:00010000:3.0:1788460074.357799:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460074.357804:0:7760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b4cd lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460074.357810:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b4cd lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460074.357821:0:7760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841600/0x5dfa74784542b4bf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460074.357828:0:7760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841600/0x5dfa74784542b4bf lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460074.357834:0:7760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841600/0x5dfa74784542b4bf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460074.357839:0:7760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac2841600 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:3.0:1788460074.357841:0:7760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841600/0x5dfa74784542b4bf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460074.357858:0:7760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841600/0x5dfa74784542b4bf lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460074.357866:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4bfa9fe100) 00010000:00010000:3.0:1788460074.357868:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788460074.357872:0:7760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841600/0x5dfa74784542b4bf lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460074.357877:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841600/0x5dfa74784542b4bf lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460074.358609:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+16:11277:x1875336003371776:12345-192.168.206.5@tcp:57:lhsmtool_posix.0 Request processed in 58095us (58704us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1788460074.358619:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 93 00000020:00080000:3.0:1788460074.358625:0:7760:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788460074.358933:0:13811:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788460074.358937:0:13811:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788460074.359337:0:13811:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788460074.359347:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788460074.361837:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460074.361919:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003372416 00000100:00100000:0.0:1788460074.361929:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003372416 00000100:00100000:0.0:1788460074.362018:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 20 00000100:00100000:0.0:1788460074.362025:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+16:11277:x1875336003372416:12345-192.168.206.5@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788460074.362455:0:6537:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788460074.362482:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:0.0:1788460074.362511:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5400/0x5dfa74784542b4d4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460074.362527:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5400/0x5dfa74784542b4d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460074.362538:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5400/0x5dfa74784542b4d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460074.362546:0:6537:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5400/0x5dfa74784542b4d4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460074.362553:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5400/0x5dfa74784542b4d4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460074.362559:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5400/0x5dfa74784542b4d4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460074.362578:0:6537:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788460074.362648:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+18:11277:x1875336003372416:12345-192.168.206.5@tcp:35:lhsmtool_posix.0 Request processed in 622us (818us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1788460074.362656:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 20 00000020:00080000:0.0:1788460074.362661:0:6537:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788460074.362685:0:9536:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788460074.362691:0:9536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5400/0x5dfa74784542b4d4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460074.362698:0:9536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc2bd5400 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:0.0:1788460074.362701:0:9536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5400/0x5dfa74784542b4d4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460074.362727:0:9536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5400/0x5dfa74784542b4d4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460074.362739:0:9536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8c4bef200000) 00010000:00010000:0.0:1788460074.362742:0:9536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788460074.362746:0:9536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5400/0x5dfa74784542b4d4 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460074.362753:0:9536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5400/0x5dfa74784542b4d4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460074.362763:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460074.362764:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460074.362766:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460074.577347:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4396a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0cf73fe6-82e2-434e-b670-631647721b2c:3659:1875336022331776:0@lo:400:kworker.0 00000100:00100000:3.0:1788460074.577431:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460074.577486:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4396300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1875336022332288:0@lo:400:kworker.0 00000100:00100000:2.0:1788460074.577507:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4394000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022331648:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788460074.577514:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460074.577532:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac2975f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1875336022332800:0@lo:400:kworker.0 00000100:00100000:2.0:1788460074.577538:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460074.577551:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460074.577554:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4397100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3662:1875336022332160:0@lo:400:kworker.0 00000100:00100000:3.0:1788460074.577573:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788460074.577574:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460074.577578:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4394e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1875336022331904:0@lo:400:kworker.0 00000100:00100000:2.0:1788460074.577589:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc532c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3662:1875336022332672:0@lo:400:kworker.0 00000100:00100000:3.0:1788460074.577596:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460074.577611:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022332288 00000100:00100000:2.0:1788460074.577622:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022332288 00000100:00100000:1.0:1788460074.577787:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022331776 00000100:00100000:1.0:1788460074.577793:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022331776 00000100:00100000:1.0:1788460074.577831:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 419 00000100:00100000:1.0:1788460074.577839:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+29:3659:x1875336022331776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460074.577895:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4397800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022332032:0@lo:400:kworker.0 00000100:00100000:2.0:1788460074.579097:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022332800 00000100:00100000:2.0:1788460074.579107:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022332800 00000100:00100000:2.0:1788460074.579124:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022332160 00000100:00100000:1.0:1788460074.579192:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+29:3659:x1875336022331776:12345-0@lo:400:kworker.0 Request processed in 1351us (1758us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460074.579202:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 419 00000100:00080000:1.0:1788460074.579657:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788460074.579662:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788460074.579672:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022331904 00000100:00100000:1.0:1788460074.579677:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022331904 00000100:00100000:2.0:1788460074.579699:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022332160 00000100:00100000:1.0:1788460074.579699:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1788460074.579706:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1875336022332288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460074.579728:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1788460074.579734:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1875336022332800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460074.579764:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1875336022332800:12345-0@lo:400:kworker.0 Request processed in 31us (2212us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460074.579764:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1875336022332288:12345-0@lo:400:kworker.0 Request processed in 58us (2249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460074.579771:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1788460074.579782:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1788460074.579787:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1788460074.579788:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1875336022331904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460074.579797:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1788460074.579803:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1875336022332160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460074.579812:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1875336022331904:12345-0@lo:400:kworker.0 Request processed in 25us (2215us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460074.579826:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1788460074.579827:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1875336022332160:12345-0@lo:400:kworker.0 Request processed in 25us (2254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460074.579832:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1788460074.579847:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460074.579850:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022331648 00000100:00100000:1.0:1788460074.579854:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022331648 00000100:00100000:1.0:1788460074.579880:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788460074.579885:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3662:x1875336022331648:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788460074.579897:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4397100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3662:1875336022332160:0@lo:400:kworker.0 00002000:00000024:1.0:1788460074.579919:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923509248 avail 3691986944 00000100:00100000:1.0:1788460074.579975:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3662:x1875336022331648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (2436us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460074.579981:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788460074.580020:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022332672 00000100:00100000:1.0:1788460074.580024:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022332672 00000100:00100000:1.0:1788460074.580052:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1788460074.580057:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1875336022332672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460074.580090:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1875336022332672:12345-0@lo:400:kworker.0 Request processed in 32us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460074.580096:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00080000:1.0:1788460074.580116:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788460074.580751:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4394000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022331648:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788460074.580762:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc532c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3662:1875336022332672:0@lo:400:kworker.0 00000100:00100000:0.0:1788460074.581251:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460074.581308:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4719180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022332544:0@lo:400:kworker.0 00000100:00100000:0.0:1788460074.581339:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460074.581359:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac41bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022333056:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788460074.581380:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460074.581421:0:8832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022332544 00000100:00100000:0.0:1788460074.581426:0:8832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022332544 00000100:00100000:0.0:1788460074.581459:0:8832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788460074.581466:0:8832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac405fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022332544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460074.581505:0:8832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac405fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022332544:12345-0@lo:400:kworker.0 Request processed in 39us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460074.581511:0:8832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788460074.581519:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4719180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022332544:0@lo:400:kworker.0 00000100:00100000:0.0:1788460074.581546:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022333056 00000100:00100000:0.0:1788460074.581549:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022333056 00000100:00100000:0.0:1788460074.581586:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788460074.581593:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac405ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022333056:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788460074.581606:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923509248 avail 3691986944 00000100:00080000:2.0:1788460074.581612:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788460074.581654:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac405ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022333056:12345-0@lo:13:osp-pre-1-1.0 Request processed in 61us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460074.581660:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788460074.583572:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022332032 00000100:00100000:1.0:1788460074.583602:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022332032 00000100:00100000:1.0:1788460074.583675:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788460074.583685:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac405c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022332032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460074.583887:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac405c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022332032:12345-0@lo:400:kworker.0 Request processed in 203us (2636us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460074.583894:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788460074.585106:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4397800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022332032:0@lo:400:kworker.0 00000100:00100000:2.0:1788460074.585143:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac41bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022333056:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788460074.588835:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4394e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1875336022331904:0@lo:400:kworker.0 00000100:00100000:3.0:1788460074.588850:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc5329c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1875336022332416:0@lo:400:kworker.0 00000100:00100000:3.0:1788460074.588928:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460074.588978:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac2975c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022332928:0@lo:400:kworker.0 00000100:00100000:3.0:1788460074.589007:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460074.589076:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4396a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0cf73fe6-82e2-434e-b670-631647721b2c:3659:1875336022331776:0@lo:400:kworker.0 00000100:00100000:3.0:1788460074.589090:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4396300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1875336022332288:0@lo:400:kworker.0 00010000:00080000:3.0:1788460074.589105:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac2975f80 x1875336022332800/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460090 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460074.589116:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac2975f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1875336022332800:0@lo:400:kworker.0 00000100:00100000:2.0:1788460074.589154:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022332416 00000100:00100000:2.0:1788460074.589161:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022332416 00000100:00100000:2.0:1788460074.589225:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1788460074.589233:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1875336022332416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460074.589297:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1875336022332416:12345-0@lo:400:kworker.0 Request processed in 64us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460074.589305:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00080000:2.0:1788460074.589325:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1788460074.589364:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bc5329c00 x1875336022332416/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460090 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460074.589373:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc5329c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1875336022332416:0@lo:400:kworker.0 00000100:00100000:0.0:1788460074.590396:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022332928 00000100:00100000:0.0:1788460074.590417:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022332928 00000100:00100000:0.0:1788460074.590466:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788460074.590480:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022332928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460074.590567:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022332928:12345-0@lo:400:kworker.0 Request processed in 88us (1559us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460074.590574:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788460074.590721:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac2975c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022332928:0@lo:400:kworker.0 00010000:00010000:1.0:1788460074.770107:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460074.942820:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460074.942863:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460074.942886:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460074.942922:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460074.942937:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460074.942991:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460074.943043:0:8832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003372928 00000100:00100000:0.0:1788460074.943053:0:8832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003372928 00000100:00100000:0.0:1788460074.943131:0:8832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003372800 00000100:00100000:0.0:1788460074.943135:0:8832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003372800 00000100:00100000:0.0:1788460074.943159:0:8832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 111 00000100:00100000:0.0:1788460074.943168:0:8832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+7:2396:x1875336003372928:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:0.0:1788460074.943238:0:8832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+7:2396:x1875336003372928:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 71us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460074.943245:0:8832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 111 00000100:00100000:0.0:1788460074.943262:0:8832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 112 00000100:00100000:0.0:1788460074.943268:0:8832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:2396:x1875336003372800:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:0.0:1788460074.943291:0:8832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:2396:x1875336003372800:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 23us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460074.943310:0:8832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 112 00000100:00100000:2.0:1788460074.943408:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003372544 00000100:00100000:2.0:1788460074.943414:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003372544 00000100:00100000:2.0:1788460074.943448:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 420 00000100:00100000:2.0:1788460074.943456:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bed032f6-c389-485e-b2f7-e2ea34763c65+14:2396:x1875336003372544:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:2.0:1788460074.943485:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bed032f6-c389-485e-b2f7-e2ea34763c65+14:2396:x1875336003372544:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 30us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460074.943502:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 420 00000100:00080000:3.0:1788460074.943566:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788460074.943593:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003372672 00000100:00100000:3.0:1788460074.943597:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003372672 00000100:00100000:3.0:1788460074.943636:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003373184 00000100:00100000:3.0:1788460074.943640:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003373184 00000100:00080000:2.0:1788460074.943661:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788460074.943662:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003373056 00000100:00100000:3.0:1788460074.943667:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003373056 00000100:00100000:2.0:1788460074.943686:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 280 00000100:00100000:2.0:1788460074.943699:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2396:x1875336003372672:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:3.0:1788460074.943704:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 281 00000100:00100000:3.0:1788460074.943726:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a5915a6d-4114-41fb-8d95-33add86e0720+5:2396:x1875336003373184:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:2.0:1788460074.943752:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2396:x1875336003372672:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 56us (937us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460074.943760:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 280 00000100:00100000:3.0:1788460074.943766:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a5915a6d-4114-41fb-8d95-33add86e0720+5:2396:x1875336003373184:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 42us (877us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460074.943774:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 281 00000100:00100000:2.0:1788460074.949454:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 282 00000100:00100000:2.0:1788460074.949484:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a5915a6d-4114-41fb-8d95-33add86e0720+5:2396:x1875336003373056:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:2.0:1788460074.949588:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a5915a6d-4114-41fb-8d95-33add86e0720+5:2396:x1875336003373056:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 120us (6595us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460074.949598:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 282 00000100:00080000:2.0:1788460074.949656:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788460075.794843:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788460076.146294:0:14277:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788460076.146305:0:14277:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788460076.146336:0:14277:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788460076.146343:0:14277:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788460076.375388:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460076.375519:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003373440 00000100:00100000:0.0:1788460076.375529:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003373440 00000100:00100000:0.0:1788460076.375603:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 94 00000100:00100000:0.0:1788460076.375614:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+18:11295:x1875336003373440:12345-192.168.206.5@tcp:101:lfs.0 00010000:00010000:0.0:1788460076.375648:0:13560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460076.375673:0:13560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5a00/0x5dfa74784542b4db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a6e6 expref: -99 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460076.375789:0:13560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5200/0x5dfa74784542b4e2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460076.375804:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5200/0x5dfa74784542b4e2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460076.375818:0:13560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5200/0x5dfa74784542b4e2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788460076.375829:0:13560:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000100:00080000:1.0:1788460076.376057:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788460076.376264:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5a00/0x5dfa74784542b4db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a6e6 expref: 21 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460076.376281:0:13560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5200/0x5dfa74784542b4e2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a6e6 expref: 20 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460076.376289:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8c4bc2ab7100) 00010000:00010000:0.0:1788460076.376292:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788460076.376295:0:13560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc2bd5200, rc 0) 00000100:00100000:0.0:1788460076.376610:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+20:11295:x1875336003373440:12345-192.168.206.5@tcp:101:lfs.0 Request processed in 997us (1231us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1788460076.376618:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 94 00000100:00100000:2.0:1788460076.383416:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460076.383481:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003373568 00000100:00100000:1.0:1788460076.383491:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003373568 00000100:00100000:1.0:1788460076.383557:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 95 00000100:00100000:1.0:1788460076.383567:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+20:11295:x1875336003373568:12345-192.168.206.5@tcp:34:lfs.0 00010000:00010000:1.0:1788460076.383651:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677800/0x5dfa74784542b4f0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460076.383668:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677800/0x5dfa74784542b4f0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460076.383680:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677800/0x5dfa74784542b4f0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460076.383693:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676800/0x5dfa74784542b4f7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460076.383714:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676800/0x5dfa74784542b4f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460076.383727:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676800/0x5dfa74784542b4f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460076.383794:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677000/0x5dfa74784542b4fe lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460076.383802:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677000/0x5dfa74784542b4fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460076.383808:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677000/0x5dfa74784542b4fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788460076.383849:0:6534:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677000/0x5dfa74784542b4fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460076.383861:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677800/0x5dfa74784542b4f0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460076.383867:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677800/0x5dfa74784542b4f0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460076.383874:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677800/0x5dfa74784542b4f0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460076.383881:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac3677800 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:1.0:1788460076.383885:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677800/0x5dfa74784542b4f0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460076.383892:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677800/0x5dfa74784542b4f0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460076.383903:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8c4bc2ab7100) 00010000:00010000:1.0:1788460076.383912:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788460076.383917:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677800/0x5dfa74784542b4f0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460076.383924:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677800/0x5dfa74784542b4f0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460076.383936:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676800/0x5dfa74784542b4f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460076.384140:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676800/0x5dfa74784542b4f7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460076.384146:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676800/0x5dfa74784542b4f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460076.384152:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac3676800 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:1.0:1788460076.384155:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676800/0x5dfa74784542b4f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460076.384160:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676800/0x5dfa74784542b4f7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460076.384168:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8c4bc2ab7c00) 00010000:00010000:1.0:1788460076.384171:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788460076.384173:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676800/0x5dfa74784542b4f7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460076.384178:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676800/0x5dfa74784542b4f7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460076.384191:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677000/0x5dfa74784542b4fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460076.384204:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677000/0x5dfa74784542b4fe lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460076.384209:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677000/0x5dfa74784542b4fe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460076.384214:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac3677000 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:1.0:1788460076.384217:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677000/0x5dfa74784542b4fe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460076.384232:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677000/0x5dfa74784542b4fe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460076.384242:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4bc2ab7400) 00010000:00010000:1.0:1788460076.384244:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788460076.384247:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677000/0x5dfa74784542b4fe lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460076.384252:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677000/0x5dfa74784542b4fe lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460076.384325:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+20:11295:x1875336003373568:12345-192.168.206.5@tcp:34:lfs.0 Request processed in 758us (919us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460076.384333:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 95 00000100:00100000:0.0:1788460076.431483:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460076.431576:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003373824 00000100:00100000:2.0:1788460076.431587:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003373824 00000100:00100000:2.0:1788460076.431673:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 96 00000100:00100000:2.0:1788460076.431684:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac405f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+20:11298:x1875336003373824:12345-192.168.206.5@tcp:101:lfs.0 00010000:00010000:2.0:1788460076.431715:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460076.431735:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b505 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a6ed expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460076.431803:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542b50c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460076.431819:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542b50c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460076.431840:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542b50c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460076.431855:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b513 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460076.431875:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b513 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460076.431883:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b513 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460076.432035:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542b51a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460076.432044:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542b51a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460076.432052:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542b51a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788460076.432060:0:6535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:2.0:1788460076.432134:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542b50c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460076.432141:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542b50c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460076.432148:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542b50c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460076.432155:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bfadc7400 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:2.0:1788460076.432164:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542b50c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460076.432173:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542b50c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460076.432183:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8c4bc2ab7100) 00010000:00010000:2.0:1788460076.432186:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460076.432190:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542b50c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460076.432196:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542b50c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460076.432206:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b513 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460076.432211:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b513 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460076.432215:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b513 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460076.432221:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bfadc7200 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:2.0:1788460076.432223:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b513 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460076.432229:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b513 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460076.432236:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8c4bfa9fe700) 00010000:00010000:2.0:1788460076.432239:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460076.432248:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b513 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460076.432254:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b513 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460076.432293:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b505 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a6ed expref: 23 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460076.432307:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542b51a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a6ed expref: 22 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460076.432314:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4bfa9fe600) 00010000:00010000:2.0:1788460076.432316:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788460076.432318:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bfadc7e00, rc 0) 00000100:00100000:2.0:1788460076.432373:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac405f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+22:11298:x1875336003373824:12345-192.168.206.5@tcp:101:lfs.0 Request processed in 692us (898us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1788460076.432381:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 96 00000100:00100000:3.0:1788460076.437263:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460076.437326:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003373952 00000100:00100000:0.0:1788460076.437336:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003373952 00000100:00100000:0.0:1788460076.437398:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 97 00000100:00100000:0.0:1788460076.437410:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+22:11298:x1875336003373952:12345-192.168.206.5@tcp:54:lfs.0 00010000:00010000:0.0:1788460076.437471:0:13560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4800/0x5dfa74784542b528 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460076.437487:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4800/0x5dfa74784542b528 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460076.437498:0:13560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4800/0x5dfa74784542b528 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460076.437529:0:13560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4800/0x5dfa74784542b528 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460076.437536:0:13560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4800/0x5dfa74784542b528 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460076.437542:0:13560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4800/0x5dfa74784542b528 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460076.437547:0:13560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc2bd4800 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460076.437552:0:13560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4800/0x5dfa74784542b528 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460076.437559:0:13560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4800/0x5dfa74784542b528 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460076.437580:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4bfa9fe600) 00010000:00010000:0.0:1788460076.437583:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788460076.437588:0:13560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4800/0x5dfa74784542b528 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460076.437595:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4800/0x5dfa74784542b528 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460076.437678:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+22:11298:x1875336003373952:12345-192.168.206.5@tcp:54:lfs.0 Request processed in 271us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460076.437686:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 97 00000100:00100000:2.0:1788460076.445516:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460076.445585:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003374208 00000100:00100000:0.0:1788460076.445595:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003374208 00000100:00100000:0.0:1788460076.445726:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 21 00000100:00100000:0.0:1788460076.445738:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc6be0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+22:11298:x1875336003374208:12345-192.168.206.5@tcp:35:lfs.0 00000100:00100000:0.0:1788460076.446175:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc6be0c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+23:11298:x1875336003374208:12345-192.168.206.5@tcp:35:lfs.0 Request processed in 439us (666us total) trans 4294967367 rc 0/0 00000100:00100000:0.0:1788460076.446184:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 21 00000100:00100000:2.0:1788460076.503577:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460076.503774:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003374464 00000100:00100000:3.0:1788460076.503784:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003374464 00000100:00100000:3.0:1788460076.503878:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 98 00000100:00100000:3.0:1788460076.503900:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+23:10816:x1875336003374464:12345-192.168.206.5@tcp:101:bash.0 00010000:00010000:3.0:1788460076.503931:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460076.503989:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841600/0x5dfa74784542b52f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a6f4 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.504097:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841200/0x5dfa74784542b536 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.504123:0:6533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542b51a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a6ed expref: 24 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.504132:0:6533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841200/0x5dfa74784542b536 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.504166:0:6533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542b51a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a6ed expref: 24 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.504180:0:6533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542b51a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a6ed expref: 24 pid: 6535 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460076.504203:0:6533:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac41bc000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6533:1875336022333184:192.168.206.5@tcp:104: 00000100:00100000:3.0:1788460076.504297:0:6533:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac286c600 going to sleep for 11 seconds 00000100:00100000:3.0:1788460076.508534:0:6533:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac41bc000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6533:1875336022333184:192.168.206.5@tcp:104: 00010000:00010000:3.0:1788460076.508576:0:6533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841200/0x5dfa74784542b536 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460076.508812:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460076.508935:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003374592 00000100:00100000:3.0:1788460076.508942:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003374592 00010000:00010000:0.0:1788460076.510855:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542b51a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a6ed expref: 25 pid: 6535 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460076.510995:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 73 00000100:00100000:0.0:1788460076.511005:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+25:2394:x1875336003374592:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788460076.511019:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788460076.511025:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542b51a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a6ed expref: 25 pid: 6535 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460076.511053:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542b51a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a6ed expref: 25 pid: 6535 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460076.511087:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542b51a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a6ed expref: 25 pid: 6535 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460076.511103:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4bfa9fe600) 00010000:00010000:0.0:1788460076.511109:0:6520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841200/0x5dfa74784542b536 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460076.511130:0:6520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841200/0x5dfa74784542b536 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460076.511139:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841200/0x5dfa74784542b536 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460076.511217:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788460076.511269:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+24:2394:x1875336003374592:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 266us (2458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460076.511277:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 73 00010000:00010000:3.0:1788460076.511671:0:6533:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841200/0x5dfa74784542b536 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.511680:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841200/0x5dfa74784542b536 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788460076.511709:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:1.0:1788460076.512153:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841600/0x5dfa74784542b52f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a6f4 expref: 25 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460076.512171:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841200/0x5dfa74784542b536 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a6f4 expref: 24 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460076.512193:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4bfa9fe600) 00010000:00010000:1.0:1788460076.512196:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788460076.512198:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ac2841200, rc 0) 00000100:00100000:1.0:1788460076.512245:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+24:10816:x1875336003374464:12345-192.168.206.5@tcp:101:bash.0 Request processed in 8347us (8677us total) trans 4294967368 rc 0/0 00000100:00100000:1.0:1788460076.512253:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 98 00000100:00100000:2.0:1788460076.516786:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460076.516890:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003374720 00000100:00100000:0.0:1788460076.517114:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003374720 00000100:00100000:0.0:1788460076.517260:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 99 00000100:00100000:0.0:1788460076.517270:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+24:10816:x1875336003374720:12345-192.168.206.5@tcp:101:bash.0 00010000:00010000:0.0:1788460076.517294:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460076.517313:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4600/0x5dfa74784542b544 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a6fb expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460076.517368:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5e00/0x5dfa74784542b54b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460076.517384:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5e00/0x5dfa74784542b54b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460076.517395:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5e00/0x5dfa74784542b54b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460076.517501:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4600/0x5dfa74784542b544 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a6fb expref: 26 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460076.517519:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5e00/0x5dfa74784542b54b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a6fb expref: 25 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460076.517527:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4bfa9fe600) 00010000:00010000:0.0:1788460076.517530:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788460076.517534:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc2bd5e00, rc 0) 00000100:00100000:0.0:1788460076.517697:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+25:10816:x1875336003374720:12345-192.168.206.5@tcp:101:bash.0 Request processed in 362us (854us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460076.517716:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 99 00000100:00100000:2.0:1788460076.520304:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460076.520427:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003374976 00000100:00100000:3.0:1788460076.520437:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003374976 00000100:00100000:3.0:1788460076.520530:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 100 00000100:00100000:3.0:1788460076.520540:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+25:10816:x1875336003374976:12345-192.168.206.5@tcp:36:bash.0 00010000:00010000:3.0:1788460076.520763:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841c00/0x5dfa74784542b552 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.520780:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841c00/0x5dfa74784542b552 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.520791:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841c00/0x5dfa74784542b552 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788460076.520831:0:6534:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:3.0:1788460076.520853:0:6534:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000062605e26 reply state 000000001ac711d0 transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841c00/0x5dfa74784542b552 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.520866:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841c00/0x5dfa74784542b552 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.520891:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4bfa9fe600) 00010000:00010000:3.0:1788460076.520894:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788460076.520898:0:6534:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1788460076.521020:0:6534:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:3.0:1788460076.521122:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+29:10816:x1875336003374976:12345-192.168.206.5@tcp:36:bash.0 Request processed in 579us (822us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1788460076.521130:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 100 00000020:00080000:3.0:1788460076.521135:0:6534:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1788460076.523321:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460076.523428:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003375104 00000100:00100000:2.0:1788460076.523436:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003375104 00000100:00100000:2.0:1788460076.523527:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 101 00000100:00100000:2.0:1788460076.523537:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac2975c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+29:10816:x1875336003375104:12345-192.168.206.5@tcp:101:bash.0 00010000:00010000:2.0:1788460076.523563:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460076.523580:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b559 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a702 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460076.523723:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b559 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a702 expref: 30 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460076.523737:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b559 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a702 expref: 30 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460076.523755:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4bfa9fe600) 00010000:00010000:2.0:1788460076.523758:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788460076.523761:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bfadc7600, rc 0) 00000100:00100000:2.0:1788460076.523823:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac2975c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+30:10816:x1875336003375104:12345-192.168.206.5@tcp:101:bash.0 Request processed in 287us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460076.523829:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 101 00000100:00100000:2.0:1788460076.526750:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460076.527171:0:8832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003375232 00000100:00100000:0.0:1788460076.527181:0:8832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003375232 00000100:00080000:1.0:1788460076.527244:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788460076.527261:0:8832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 41 00000100:00100000:0.0:1788460076.527275:0:8832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:10816:x1875336003375232:12345-192.168.206.5@tcp:101:bash.0 00010000:00010000:0.0:1788460076.527293:0:8832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460076.527313:0:8832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2354787/0x5dfa74784542b560 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a709 expref: -99 pid: 8832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788460076.527350:0:8832:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a99bc27, atime: 0x6a99bc25, ctime: 0x6a99bc27, blocks: 0x8 00010000:00010000:0.0:1788460076.527374:0:8832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=373s v=(0 0) 00010000:00010000:0.0:1788460076.527379:0:8832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460076.527387:0:8832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2354787/0x5dfa74784542b560 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a709 expref: 7 pid: 8832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460076.527404:0:8832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c2354787/0x5dfa74784542b560 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a709 expref: 7 pid: 8832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460076.527415:0:8832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc2bd4600, rc 0) 00000100:00100000:0.0:1788460076.527472:0:8832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+7:10816:x1875336003375232:12345-192.168.206.5@tcp:101:bash.0 Request processed in 204us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460076.527479:0:8832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 41 00000100:00100000:3.0:1788460076.531805:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460076.532189:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003375360 00000100:00100000:0.0:1788460076.532200:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003375360 00002000:00010000:0.0:1788460076.532244:0:8453:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:0.0:1788460076.532249:0:8453:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c4ac41bc000 with x1875336003375360 ext(0->18446744073709551615) 00002000:00010000:0.0:1788460076.532261:0:8453:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c4ac41bc000. 00000100:00100000:0.0:1788460076.532297:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 1 00000100:00100000:0.0:1788460076.532307:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+7:2395:x1875336003375360:12345-192.168.206.5@tcp:10:bash.0 00002000:00010000:0.0:1788460076.532552:0:8453:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1788460076.532556:0:8453:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1788460071 -> 1788460075 00002000:00010000:0.0:1788460076.532559:0:8453:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 1788460069 -> 1788460069 00002000:00010000:0.0:1788460076.532561:0:8453:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1788460071 -> 1788460075 00002000:00010000:0.0:1788460076.532573:0:8453:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:0.0:1788460076.532760:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+8:2395:x1875336003375360:12345-192.168.206.5@tcp:10:bash.0 Request processed in 454us (964us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788460076.532768:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 1 00002000:00010000:0.0:1788460076.532772:0:8453:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:0.0:1788460076.532774:0:8453:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c4ac41bc000 with x1875336003375360 ext(0->18446744073709551615) 00002000:00010000:0.0:1788460076.532779:0:8453:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c4ac41bc000. 00000100:00100000:1.0:1788460076.609805:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460076.610028:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003375488 00000100:00100000:0.0:1788460076.610038:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003375488 00000100:00100000:0.0:1788460076.610187:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 102 00000100:00100000:0.0:1788460076.610209:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac2977100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+30:11313:x1875336003375488:12345-192.168.206.5@tcp:34:lfs.0 00010000:00010000:0.0:1788460076.610277:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b567 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460076.610293:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b567 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460076.610304:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b567 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460076.610319:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4000/0x5dfa74784542b56e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460076.610327:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4000/0x5dfa74784542b56e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460076.610333:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4000/0x5dfa74784542b56e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460076.610398:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542b575 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460076.610419:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542b575 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460076.610426:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542b575 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788460076.610470:0:6535:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542b575 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460076.610480:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b567 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460076.610486:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b567 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460076.610492:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b567 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460076.610498:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc2bd4200 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460076.610502:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b567 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460076.610509:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b567 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460076.610520:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8c4bc2ab7100) 00010000:00010000:0.0:1788460076.610523:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460076.610527:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b567 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460076.610533:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b567 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460076.610558:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4000/0x5dfa74784542b56e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460076.610564:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4000/0x5dfa74784542b56e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460076.610569:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4000/0x5dfa74784542b56e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460076.610574:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc2bd4000 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460076.610576:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4000/0x5dfa74784542b56e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460076.610582:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4000/0x5dfa74784542b56e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460076.610590:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8c4bc5dc1400) 00010000:00010000:0.0:1788460076.610592:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460076.610595:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4000/0x5dfa74784542b56e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460076.610601:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4000/0x5dfa74784542b56e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460076.610615:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542b575 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460076.610621:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542b575 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460076.610626:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542b575 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460076.610637:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc2bd4c00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460076.610640:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542b575 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460076.610646:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542b575 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460076.610654:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4bfa9fe600) 00010000:00010000:0.0:1788460076.610656:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460076.610659:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542b575 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460076.610677:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542b575 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460076.610809:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac2977100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+30:11313:x1875336003375488:12345-192.168.206.5@tcp:34:lfs.0 Request processed in 602us (1010us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460076.610816:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 102 00000001:00080000:0.0:1788460076.629599:0:9527:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:0.0:1788460076.629613:0:9527:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000100:00100000:2.0:1788460076.658174:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460076.658295:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003375744 00000100:00100000:3.0:1788460076.658305:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003375744 00000100:00100000:3.0:1788460076.658377:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 103 00000100:00100000:3.0:1788460076.658389:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+30:11316:x1875336003375744:12345-192.168.206.5@tcp:101:lfs.0 00010000:00010000:3.0:1788460076.658552:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460076.658574:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840400/0x5dfa74784542b57c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a710 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.659878:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841400/0x5dfa74784542b583 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.659896:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841400/0x5dfa74784542b583 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.659907:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841400/0x5dfa74784542b583 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.659924:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841600/0x5dfa74784542b58a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.659964:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841600/0x5dfa74784542b58a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.659971:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841600/0x5dfa74784542b58a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.660077:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840000/0x5dfa74784542b591 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.660087:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840000/0x5dfa74784542b591 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.660094:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840000/0x5dfa74784542b591 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788460076.660103:0:6534:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788460076.660174:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841400/0x5dfa74784542b583 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.660181:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841400/0x5dfa74784542b583 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.660188:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841400/0x5dfa74784542b583 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.660193:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac2841400 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:3.0:1788460076.660198:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841400/0x5dfa74784542b583 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.660205:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841400/0x5dfa74784542b583 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.660227:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8c4bc2ab7100) 00010000:00010000:3.0:1788460076.660230:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460076.660235:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841400/0x5dfa74784542b583 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.660241:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841400/0x5dfa74784542b583 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.660255:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841600/0x5dfa74784542b58a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.660262:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841600/0x5dfa74784542b58a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.660267:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841600/0x5dfa74784542b58a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.660272:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac2841600 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:3.0:1788460076.660275:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841600/0x5dfa74784542b58a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.660281:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841600/0x5dfa74784542b58a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.660288:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8c4bef1fe300) 00010000:00010000:3.0:1788460076.660290:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460076.660293:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841600/0x5dfa74784542b58a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.660298:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841600/0x5dfa74784542b58a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.660369:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840400/0x5dfa74784542b57c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a710 expref: 33 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.660384:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840000/0x5dfa74784542b591 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a710 expref: 32 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.660392:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4bfa9fe600) 00010000:00010000:3.0:1788460076.660394:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788460076.660397:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ac2840000, rc 0) 00000100:00100000:3.0:1788460076.660470:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+32:11316:x1875336003375744:12345-192.168.206.5@tcp:101:lfs.0 Request processed in 2084us (2305us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1788460076.660479:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 103 00000100:00100000:3.0:1788460076.664785:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460076.665010:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003375872 00000100:00100000:2.0:1788460076.665020:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003375872 00000100:00100000:2.0:1788460076.665074:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 104 00000100:00100000:2.0:1788460076.665084:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+32:11316:x1875336003375872:12345-192.168.206.5@tcp:54:lfs.0 00010000:00010000:2.0:1788460076.665148:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6800/0x5dfa74784542b59f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460076.665165:0:6533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841200/0x5dfa74784542b536 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a6f4 expref: 32 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460076.665174:0:6533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6800/0x5dfa74784542b59f lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460076.665430:0:6533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841200/0x5dfa74784542b536 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a6f4 expref: 32 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460076.665443:0:6533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841200/0x5dfa74784542b536 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a6f4 expref: 32 pid: 6533 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460076.665457:0:6533:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac41b8380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6533:1875336022333312:192.168.206.5@tcp:104: 00000100:00100000:2.0:1788460076.665557:0:6533:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc7e39480 going to sleep for 11 seconds 00000100:00100000:2.0:1788460076.672229:0:6533:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac41b8380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6533:1875336022333312:192.168.206.5@tcp:104: 00010000:00010000:2.0:1788460076.672258:0:6533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6800/0x5dfa74784542b59f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460076.674420:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460076.674810:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003376128 00000100:00100000:3.0:1788460076.674820:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003376128 00000100:00100000:3.0:1788460076.674881:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 22 00000100:00100000:3.0:1788460076.674890:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+33:6161:x1875336003376128:12345-192.168.206.5@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788460076.675179:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+34:6161:x1875336003376128:12345-192.168.206.5@tcp:35:ldlm_bl.0 Request processed in 289us (768us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1788460076.675187:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 22 00000100:00100000:1.0:1788460076.682201:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460076.682287:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003376256 00000100:00100000:3.0:1788460076.682296:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003376256 00010000:00010000:3.0:1788460076.682337:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841200/0x5dfa74784542b536 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a6f4 expref: 34 pid: 6533 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460076.682379:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 74 00000100:00100000:3.0:1788460076.682400:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac2975880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+34:2393:x1875336003376256:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788460076.682415:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788460076.682422:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841200/0x5dfa74784542b536 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a6f4 expref: 34 pid: 6533 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.682435:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841200/0x5dfa74784542b536 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a6f4 expref: 34 pid: 6533 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.682455:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841200/0x5dfa74784542b536 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a6f4 expref: 34 pid: 6533 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.682472:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4bfa9fe600) 00010000:00010000:3.0:1788460076.682477:0:6518:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6800/0x5dfa74784542b59f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.682486:0:6518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6800/0x5dfa74784542b59f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.682494:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6800/0x5dfa74784542b59f lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.682526:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788460076.682587:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac2975880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+33:2393:x1875336003376256:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 188us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460076.682595:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 74 00010000:00010000:2.0:1788460076.682763:0:6533:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6800/0x5dfa74784542b59f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460076.682772:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6800/0x5dfa74784542b59f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460076.682810:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6800/0x5dfa74784542b59f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460076.682817:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6800/0x5dfa74784542b59f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460076.682823:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6800/0x5dfa74784542b59f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460076.682828:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bfadc6800 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:2.0:1788460076.682839:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6800/0x5dfa74784542b59f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460076.682848:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6800/0x5dfa74784542b59f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460076.682857:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4bfa9fe600) 00010000:00010000:2.0:1788460076.682860:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788460076.682864:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6800/0x5dfa74784542b59f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460076.682869:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6800/0x5dfa74784542b59f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460076.682909:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+32:11316:x1875336003375872:12345-192.168.206.5@tcp:54:lfs.0 Request processed in 17827us (18133us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460076.682917:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 104 00000100:00100000:2.0:1788460076.686746:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460076.686807:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003376512 00000100:00100000:3.0:1788460076.686815:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003376512 00000100:00100000:3.0:1788460076.686873:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 23 00000100:00100000:3.0:1788460076.686883:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+32:11316:x1875336003376512:12345-192.168.206.5@tcp:35:lfs.0 00000100:00100000:3.0:1788460076.687145:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+33:11316:x1875336003376512:12345-192.168.206.5@tcp:35:lfs.0 Request processed in 263us (405us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1788460076.687153:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 23 00010000:00010000:1.0:1788460076.817163:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788460076.866140:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460076.866238:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003376768 00000100:00100000:0.0:1788460076.866248:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003376768 00000100:00100000:0.0:1788460076.866309:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 105 00000100:00100000:0.0:1788460076.866318:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac2975500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+33:11327:x1875336003376768:12345-192.168.206.5@tcp:101:cat.0 00010000:00010000:0.0:1788460076.866343:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460076.866363:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4000/0x5dfa74784542b5a6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a717 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460076.866432:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b5ad lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460076.866458:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b5ad lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460076.866470:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b5ad lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460076.866486:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542b5b4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460076.866494:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542b5b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460076.866501:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542b5b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460076.866604:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4800/0x5dfa74784542b5bb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460076.866614:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4800/0x5dfa74784542b5bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460076.866634:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4800/0x5dfa74784542b5bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788460076.866644:0:6535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:0.0:1788460076.866731:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b5ad lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460076.866739:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b5ad lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460076.866745:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b5ad lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460076.866757:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc2bd4200 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460076.866761:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b5ad lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460076.866769:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b5ad lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460076.866781:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8c4bc2ab7100) 00010000:00010000:0.0:1788460076.866783:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460076.866788:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b5ad lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460076.866795:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b5ad lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460076.866807:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542b5b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460076.866812:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542b5b4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460076.866818:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542b5b4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460076.866822:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc2bd4c00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460076.866825:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542b5b4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460076.866830:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542b5b4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460076.866849:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8c4bc5dc1400) 00010000:00010000:0.0:1788460076.866852:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460076.866854:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542b5b4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460076.866860:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542b5b4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460076.866899:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4000/0x5dfa74784542b5a6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a717 expref: 36 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460076.866913:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4800/0x5dfa74784542b5bb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a717 expref: 35 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460076.866919:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4bfa9fe600) 00010000:00010000:0.0:1788460076.866921:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788460076.866923:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc2bd4800, rc 0) 00000100:00100000:1.0:1788460076.867519:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac2975500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+35:11327:x1875336003376768:12345-192.168.206.5@tcp:101:cat.0 Request processed in 1197us (1384us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1788460076.867528:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 105 00000100:00100000:1.0:1788460076.890125:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460076.890256:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003377024 00000100:00100000:3.0:1788460076.890267:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003377024 00000100:00100000:3.0:1788460076.890363:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 24 00000100:00100000:3.0:1788460076.890375:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac2975f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+35:11327:x1875336003377024:12345-192.168.206.5@tcp:35:cat.0 00000100:00100000:3.0:1788460076.890673:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac2975f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+36:11327:x1875336003377024:12345-192.168.206.5@tcp:35:cat.0 Request processed in 300us (570us total) trans 4294967376 rc 0/0 00000100:00100000:3.0:1788460076.890681:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 24 00000100:00100000:0.0:1788460076.935757:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460076.935845:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003377280 00000100:00100000:3.0:1788460076.935855:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003377280 00000100:00100000:3.0:1788460076.935923:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 106 00000100:00100000:3.0:1788460076.935934:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac405d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+36:11328:x1875336003377280:12345-192.168.206.5@tcp:36:rm.0 00010000:00010000:3.0:1788460076.936032:0:6534:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1788460076.936058:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b559 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a702 expref: 36 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.936079:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4800/0x5dfa74784542b5bb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a717 expref: 35 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.936093:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840000/0x5dfa74784542b591 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a710 expref: 34 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.936105:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5e00/0x5dfa74784542b54b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a6fb expref: 33 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.936133:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4bfa9fe600) 00010000:00010000:3.0:1788460076.936138:0:6534:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788460076.936158:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841200/0x5dfa74784542b5c9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.936170:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841200/0x5dfa74784542b5c9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.936178:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841200/0x5dfa74784542b5c9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.936194:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840400/0x5dfa74784542b5d0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.936201:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840400/0x5dfa74784542b5d0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.936208:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840400/0x5dfa74784542b5d0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.936294:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841600/0x5dfa74784542b5d7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.936302:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841600/0x5dfa74784542b5d7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.936309:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841600/0x5dfa74784542b5d7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788460076.937266:0:6534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:3.0:1788460076.937277:0:6534:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 374040332604ns, next at 375040330043ns, rc = 0 00010000:00010000:3.0:1788460076.937336:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841400/0x5dfa74784542b5de lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.937348:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841400/0x5dfa74784542b5de lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.937356:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841400/0x5dfa74784542b5de lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.937364:0:6534:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841400/0x5dfa74784542b5de lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.937371:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841400/0x5dfa74784542b5de lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.937377:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841400/0x5dfa74784542b5de lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.937520:0:6534:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788460076.937544:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841600/0x5dfa74784542b5d7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.937550:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841600/0x5dfa74784542b5d7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.937555:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841600/0x5dfa74784542b5d7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.937560:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac2841600 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:3.0:1788460076.937565:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841600/0x5dfa74784542b5d7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.937572:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841600/0x5dfa74784542b5d7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.937589:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4bfa9fe600) 00010000:00010000:3.0:1788460076.937591:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788460076.937596:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841600/0x5dfa74784542b5d7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.937601:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841600/0x5dfa74784542b5d7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.937628:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841200/0x5dfa74784542b5c9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.937634:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841200/0x5dfa74784542b5c9 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.937639:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841200/0x5dfa74784542b5c9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.937644:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac2841200 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:3.0:1788460076.937646:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841200/0x5dfa74784542b5c9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.937652:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841200/0x5dfa74784542b5c9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.937659:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8c4bc2ab7100) 00010000:00010000:3.0:1788460076.937661:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460076.937664:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841200/0x5dfa74784542b5c9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.937670:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841200/0x5dfa74784542b5c9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788460076.937693:0:6534:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004ea63d94 reply state 00000000d47a5987 transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840400/0x5dfa74784542b5d0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.937713:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840400/0x5dfa74784542b5d0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.937720:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8c4bef1fe300) 00010000:00010000:3.0:1788460076.937722:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788460076.937724:0:6534:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788460076.937812:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac405d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+34:11328:x1875336003377280:12345-192.168.206.5@tcp:36:rm.0 Request processed in 1877us (2060us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1788460076.937821:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 106 00010000:00010000:1.0:1788460076.938881:0:9536:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788460076.938890:0:9536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841400/0x5dfa74784542b5de lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460076.939148:0:9536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac2841400 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:1.0:1788460076.939152:0:9536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841400/0x5dfa74784542b5de lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460076.939159:0:9536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841400/0x5dfa74784542b5de lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460076.939188:0:9536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4bfa9fe600) 00010000:00010000:1.0:1788460076.939190:0:9536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788460076.939195:0:9536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841400/0x5dfa74784542b5de lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460076.939201:0:9536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841400/0x5dfa74784542b5de lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460076.939216:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460076.939218:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460076.939219:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788460076.976029:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460076.976157:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003377536 00000100:00100000:2.0:1788460076.976167:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003377536 00000100:00100000:2.0:1788460076.976227:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 107 00000100:00100000:2.0:1788460076.976237:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc532c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+34:11334:x1875336003377536:12345-192.168.206.5@tcp:101:bash.0 00010000:00010000:2.0:1788460076.976260:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460076.976395:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542b5e5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a71e expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460076.976498:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542b5ec lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460076.976514:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542b5ec lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460076.976538:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542b5ec lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460076.976551:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b5f3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460076.976559:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b5f3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460076.976565:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b5f3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788460076.979821:0:6533:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:3.0:1788460076.980222:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841200/0x5dfa74784542b5fa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.980238:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841200/0x5dfa74784542b5fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.980249:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841200/0x5dfa74784542b5fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.980287:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542b5ec lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.980295:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542b5ec lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.980301:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542b5ec lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.980324:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bfadc7400 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:3.0:1788460076.980328:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542b5ec lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.980335:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542b5ec lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.980347:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8c4bc2ab7100) 00010000:00010000:3.0:1788460076.980350:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460076.980354:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542b5ec lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.980360:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542b5ec lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788460076.980371:0:6533:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000035b9ce17 reply state 000000008c6c3639 transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b5f3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.980382:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b5f3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.980388:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8c4bef1fe300) 00010000:00010000:3.0:1788460076.980390:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788460076.980394:0:6533:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788460076.980582:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542b5e5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a71e expref: 37 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.980598:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841200/0x5dfa74784542b5fa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a71e expref: 36 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.980682:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8c4bef1fe400) 00010000:00010000:3.0:1788460076.980685:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788460076.980687:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ac2841200, rc 0) 00000100:00100000:3.0:1788460076.980777:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc532c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+37:11334:x1875336003377536:12345-192.168.206.5@tcp:101:bash.0 Request processed in 4540us (4755us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1788460076.980786:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 107 00000100:00100000:2.0:1788460076.985264:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460076.985765:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003377664 00000100:00100000:0.0:1788460076.985775:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003377664 00000100:00100000:0.0:1788460076.985849:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 42 00000100:00100000:0.0:1788460076.985861:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2393:x1875336003377664:12345-192.168.206.5@tcp:101:bash.0 00010000:00010000:0.0:1788460076.985878:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460076.985897:0:8448:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000380beff1/0x5dfa74784542b608 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a725 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788460076.985920:0:8448:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788460076.985977:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=374s v=(0 0) 00010000:00010000:0.0:1788460076.985983:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460076.985993:0:8448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000380beff1/0x5dfa74784542b608 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a725 expref: 6 pid: 8448 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460076.986013:0:8448:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000380beff1/0x5dfa74784542b608 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a725 expref: 6 pid: 8448 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460076.986027:0:8448:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc2bd4c00, rc 0) 00000100:00100000:0.0:1788460076.986089:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:2393:x1875336003377664:12345-192.168.206.5@tcp:101:bash.0 Request processed in 231us (832us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460076.986100:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 42 00000100:00080000:1.0:1788460076.987393:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788460076.989343:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460076.989502:0:8832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003377792 00000100:00100000:3.0:1788460076.989512:0:8832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003377792 00000100:00100000:3.0:1788460076.989568:0:8832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 43 00000100:00100000:3.0:1788460076.989578:0:8832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc6762a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:11334:x1875336003377792:12345-192.168.206.5@tcp:101:bash.0 00010000:00010000:3.0:1788460076.989596:0:8832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460076.989611:0:8832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e6236f5e/0x5dfa74784542b60f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a72c expref: -99 pid: 8832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.989653:0:8832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000380beff1/0x5dfa74784542b608 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a725 expref: 7 pid: 8448 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.989671:0:8832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788460076.989675:0:8832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788460076.989681:0:8832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6236f5e/0x5dfa74784542b60f lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a72c expref: 7 pid: 8832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.989722:0:8832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000380beff1/0x5dfa74784542b608 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a725 expref: 7 pid: 8448 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.989752:0:8832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000380beff1/0x5dfa74784542b608 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a725 expref: 7 pid: 8448 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460076.989766:0:8832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac41bdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8832:1875336022333440:192.168.206.5@tcp:104: 00000100:00100000:3.0:1788460076.989871:0:8832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac286cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788460076.993174:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460076.993282:0:9538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003377920 00000100:00100000:1.0:1788460076.993290:0:9538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003377920 00010000:00010000:1.0:1788460076.993327:0:9538:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000380beff1/0x5dfa74784542b608 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a725 expref: 8 pid: 8448 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460076.993370:0:9538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 75 00000100:00100000:1.0:1788460076.993379:0:9538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+8:2394:x1875336003377920:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788460076.993393:0:9538:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788460076.993411:0:9538:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000380beff1/0x5dfa74784542b608 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a725 expref: 8 pid: 8448 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460076.993425:0:9538:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000380beff1/0x5dfa74784542b608 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a725 expref: 8 pid: 8448 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460076.993468:0:9538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460076.993472:0:9538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460076.993482:0:9538:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e6236f5e/0x5dfa74784542b60f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a72c expref: 8 pid: 8832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460076.993492:0:9538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6236f5e/0x5dfa74784542b60f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a72c expref: 8 pid: 8832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460076.993528:0:9538:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e6236f5e/0x5dfa74784542b60f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a72c expref: 8 pid: 8832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460076.993542:0:9538:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e62a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9538:1875336022333568:192.168.206.5@tcp:105: 00000100:00100000:1.0:1788460076.993627:0:9538:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bfa392e40 going to sleep for 11 seconds 00010000:00010000:3.0:1788460076.996204:0:8832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000380beff1/0x5dfa74784542b608 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a725 expref: 8 pid: 8448 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460076.996226:0:8832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac41bdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8832:1875336022333440:192.168.206.5@tcp:104: 00010000:00010000:3.0:1788460076.996251:0:8832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e6236f5e/0x5dfa74784542b60f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a72c expref: 7 pid: 8832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460076.996372:0:8832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ac2841600, rc 0) 00000100:00100000:3.0:1788460076.996450:0:8832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc6762a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+7:11334:x1875336003377792:12345-192.168.206.5@tcp:101:bash.0 Request processed in 6873us (7112us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460076.996458:0:8832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 43 00000100:00100000:1.0:1788460077.000780:0:9538:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e62a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:9538:1875336022333568:192.168.206.5@tcp:105: 00010000:00010000:1.0:1788460077.000804:0:9538:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788460077.000856:0:9538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:2394:x1875336003377920:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 7478us (7690us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460077.000867:0:9538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 75 00000100:00100000:1.0:1788460077.001688:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460077.002017:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003378176 00000100:00100000:3.0:1788460077.002025:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003378176 00000100:00100000:3.0:1788460077.002071:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 25 00000100:00100000:3.0:1788460077.002080:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac1e62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+37:11334:x1875336003378176:12345-192.168.206.5@tcp:35:bash.0 00000100:00100000:3.0:1788460077.002370:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac1e62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+38:11334:x1875336003378176:12345-192.168.206.5@tcp:35:bash.0 Request processed in 290us (684us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1788460077.002377:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 25 00000100:00100000:1.0:1788460077.181314:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460077.181869:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003378304 00000100:00100000:2.0:1788460077.181881:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003378304 00000100:00100000:2.0:1788460077.182168:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 108 00000100:00100000:2.0:1788460077.182179:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac1e60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+38:11350:x1875336003378304:12345-192.168.206.5@tcp:101:lfs.0 00010000:00010000:2.0:1788460077.182202:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460077.182222:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542b616 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a733 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460077.182287:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b61d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460077.182303:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b61d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460077.182313:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b61d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788460077.182368:0:6535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1788460077.182373:0:6535:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788460077.182392:0:6535:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b61d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460077.182416:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542b616 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a733 expref: 40 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460077.182433:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b61d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a733 expref: 39 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460077.182441:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8c4bc2ab7100) 00010000:00010000:2.0:1788460077.182444:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788460077.182447:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bfadc6400, rc 0) 00000100:00100000:2.0:1788460077.182512:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac1e60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+39:11350:x1875336003378304:12345-192.168.206.5@tcp:101:lfs.0 Request processed in 334us (1206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460077.182520:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 108 00000100:00100000:1.0:1788460077.187203:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460077.187298:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003378560 00000100:00100000:3.0:1788460077.187308:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003378560 00000100:00100000:3.0:1788460077.187397:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 109 00000100:00100000:3.0:1788460077.187407:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac1e62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+39:11350:x1875336003378560:12345-192.168.206.5@tcp:101:lfs.0 00010000:00010000:3.0:1788460077.187427:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460077.187444:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840000/0x5dfa74784542b624 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a73a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460077.187542:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841400/0x5dfa74784542b62b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460077.187555:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841400/0x5dfa74784542b62b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460077.187566:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841400/0x5dfa74784542b62b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788460077.187576:0:6534:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788460077.187683:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840000/0x5dfa74784542b624 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a73a expref: 42 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460077.187712:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841400/0x5dfa74784542b62b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a73a expref: 41 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460077.187720:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8c4bef1fe400) 00010000:00010000:3.0:1788460077.187723:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788460077.187726:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ac2841400, rc 0) 00000100:00100000:3.0:1788460077.187827:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac1e62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+41:11350:x1875336003378560:12345-192.168.206.5@tcp:101:lfs.0 Request processed in 421us (630us total) trans 4294967380 rc 0/0 00000100:00100000:3.0:1788460077.187851:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 109 00000100:00100000:1.0:1788460077.191914:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460077.191976:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460077.192081:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003378944 00000100:00100000:0.0:1788460077.192091:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003378944 00000100:00100000:0.0:1788460077.192174:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 5 00000100:00100000:0.0:1788460077.192184:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac1e63800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+41:2394:x1875336003378944:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788460077.192199:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788460077.192222:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841400/0x5dfa74784542b62b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a73a expref: 41 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460077.192240:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8c4bef1fe400) 00010000:00010000:0.0:1788460077.192245:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788460077.192297:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac1e63800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+40:2394:x1875336003378944:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 114us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460077.192304:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 5 00000100:00100000:3.0:1788460077.193517:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003378816 00000100:00100000:3.0:1788460077.193527:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003378816 00000100:00100000:3.0:1788460077.193628:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 110 00000100:00100000:3.0:1788460077.193638:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac1e63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+40:11350:x1875336003378816:12345-192.168.206.5@tcp:101:lfs.0 00010000:00010000:3.0:1788460077.193660:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460077.193679:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f600/0x5dfa74784542b639 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a741 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460077.193796:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f400/0x5dfa74784542b640 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460077.193810:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f400/0x5dfa74784542b640 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460077.193820:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f400/0x5dfa74784542b640 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788460077.193831:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788460077.193937:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f600/0x5dfa74784542b639 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a741 expref: 43 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460077.194361:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f400/0x5dfa74784542b640 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a741 expref: 42 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460077.194371:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8c4bef1fe400) 00010000:00010000:3.0:1788460077.194374:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788460077.194378:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ac395f400, rc 0) 00000100:00100000:3.0:1788460077.194454:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac1e63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+42:11350:x1875336003378816:12345-192.168.206.5@tcp:101:lfs.0 Request processed in 816us (2548us total) trans 4294967381 rc 0/0 00000100:00100000:3.0:1788460077.194463:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 110 00000100:00100000:1.0:1788460077.200220:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460077.200289:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003379072 00000100:00100000:0.0:1788460077.200298:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003379072 00000100:00100000:0.0:1788460077.200354:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 44 00000100:00100000:0.0:1788460077.200364:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac1e61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:2396:x1875336003379072:12345-192.168.206.5@tcp:1:lfs.0 00010000:00010000:0.0:1788460077.200406:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ecd5c5d2/0x5dfa74784542b64e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460077.200425:0:8448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e6236f5e/0x5dfa74784542b60f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a72c expref: 6 pid: 8832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460077.200433:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460077.200437:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788460077.200442:0:8448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ecd5c5d2/0x5dfa74784542b64e lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460077.200474:0:8448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e6236f5e/0x5dfa74784542b60f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a72c expref: 6 pid: 8832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460077.200488:0:8448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e6236f5e/0x5dfa74784542b60f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a72c expref: 6 pid: 8832 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460077.200500:0:8448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3bdb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8448:1875336022333696:192.168.206.5@tcp:104: 00000100:00100000:0.0:1788460077.200594:0:8448:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc65d76c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788460077.204017:0:8448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3bdb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8448:1875336022333696:192.168.206.5@tcp:104: 00010000:00010000:0.0:1788460077.204048:0:8448:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ecd5c5d2/0x5dfa74784542b64e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460077.205653:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460077.205916:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003379200 00000100:00100000:3.0:1788460077.205925:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003379200 00002000:00100000:3.0:1788460077.206013:0:8455:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff8c4ac1e60a80 x1875336003379200/t0(0) o4->f8767d3e-bfef-4d3d-8163-ef8ae18a3514@192.168.206.5@tcp:233/0 lens 504/0 e 0 to 0 dl 1788460088 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788460077.206024:0:8455:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c4ac1e60a80 with x1875336003379200 ext(0->8) 00010000:00010000:3.0:1788460077.206032:0:8455:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000e6236f5e/0x5dfa74784542b60f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a72c expref: 7 pid: 8832 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460077.206048:0:8455:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000e6236f5e/0x5dfa74784542b60f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a72c expref: 7 pid: 8832 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788460077.206055:0:8455:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8c4ac1e60a80 00000100:00100000:3.0:1788460077.206086:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 1 00000100:00100000:3.0:1788460077.206094:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac1e60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+7:2393:x1875336003379200:12345-192.168.206.5@tcp:4:lfs.0 00000100:00100000:3.0:1788460077.207238:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac1e60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+9:2393:x1875336003379200:12345-192.168.206.5@tcp:4:lfs.0 Request processed in 1139us (1586us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1788460077.207249:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 1 00002000:00100000:3.0:1788460077.207259:0:8455:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff8c4ac1e60a80 x1875336003379200/t4294967303(0) o4->f8767d3e-bfef-4d3d-8163-ef8ae18a3514@192.168.206.5@tcp:233/0 lens 504/448 e 0 to 0 dl 1788460088 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788460077.207268:0:8455:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c4ac1e60a80 with x1875336003379200 ext(0->8) 00010000:00010000:3.0:1788460077.207277:0:8455:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000e6236f5e/0x5dfa74784542b60f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a72c expref: 9 pid: 8832 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460077.207307:0:8455:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000e6236f5e/0x5dfa74784542b60f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a72c expref: 9 pid: 8832 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788460077.207316:0:8455:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8c4ac1e60a80 00000100:00100000:1.0:1788460077.213725:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460077.213876:0:9549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003379328 00000100:00100000:0.0:1788460077.213886:0:9549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003379328 00010000:00010000:0.0:1788460077.213937:0:9549:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e6236f5e/0x5dfa74784542b60f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a72c expref: 9 pid: 8832 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460077.214026:0:9549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 76 00000100:00100000:0.0:1788460077.214036:0:9549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac1e60380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+9:2394:x1875336003379328:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788460077.214069:0:9549:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788460077.214086:0:9549:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788460077.214089:0:9549:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788460075 00002000:00010000:0.0:1788460077.214091:0:9549:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788460076 00002000:00010000:0.0:1788460077.214093:0:9549:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1788460075 00002000:00010000:0.0:1788460077.214096:0:9549:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1788460077.214102:0:9549:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e6236f5e/0x5dfa74784542b60f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a72c expref: 9 pid: 8832 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460077.214116:0:9549:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e6236f5e/0x5dfa74784542b60f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a72c expref: 9 pid: 8832 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460077.214138:0:9549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6236f5e/0x5dfa74784542b60f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a72c expref: 9 pid: 8832 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460077.214156:0:9549:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788460077.214160:0:9549:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788460077.214167:0:9549:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ecd5c5d2/0x5dfa74784542b64e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460077.214185:0:9549:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ecd5c5d2/0x5dfa74784542b64e lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460077.214212:0:9549:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788460077.214265:0:9549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac1e60380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+8:2394:x1875336003379328:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 231us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460077.214274:0:9549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 76 00010000:00010000:1.0:1788460077.214641:0:8448:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ecd5c5d2/0x5dfa74784542b64e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460077.214651:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ecd5c5d2/0x5dfa74784542b64e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460077.214670:0:8448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ecd5c5d2/0x5dfa74784542b64e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460077.214678:0:8448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ecd5c5d2/0x5dfa74784542b64e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460077.214685:0:8448:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ecd5c5d2/0x5dfa74784542b64e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460077.214692:0:8448:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc2bd5000 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:1.0:1788460077.214706:0:8448:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ecd5c5d2/0x5dfa74784542b64e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460077.214715:0:8448:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ecd5c5d2/0x5dfa74784542b64e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460077.214727:0:8448:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ecd5c5d2/0x5dfa74784542b64e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460077.214734:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ecd5c5d2/0x5dfa74784542b64e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460077.214812:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac1e61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+7:2396:x1875336003379072:12345-192.168.206.5@tcp:1:lfs.0 Request processed in 14450us (14600us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460077.214820:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 44 00000100:00100000:1.0:1788460077.218287:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460077.218360:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003379584 00000100:00100000:3.0:1788460077.218369:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003379584 00000100:00100000:3.0:1788460077.218420:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 26 00000100:00100000:3.0:1788460077.218429:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc6be3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+42:11350:x1875336003379584:12345-192.168.206.5@tcp:35:lfs.0 00000004:00010000:3.0:1788460077.218487:0:6537:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f400/0x5dfa74784542b640 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a741 expref: 42 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788460077.218669:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:3.0:1788460077.218713:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:2.0:1788460077.222414:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:2.0:1788460077.222485:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542b655 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460077.222506:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841200/0x5dfa74784542b5fa lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a71e expref: 46 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460077.222515:0:6537:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542b655 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460077.222552:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841200/0x5dfa74784542b5fa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a71e expref: 46 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460077.222581:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841200/0x5dfa74784542b5fa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a71e expref: 46 pid: 6533 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460077.222597:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac41b9f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6537:1875336022333824:192.168.206.5@tcp:104: 00000100:00100000:2.0:1788460077.222859:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc7e393c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788460077.227282:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460077.227514:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac41b9f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6537:1875336022333824:192.168.206.5@tcp:104: 00010000:00010000:2.0:1788460077.227541:0:6537:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542b655 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460077.228162:0:9538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003379712 00000100:00100000:1.0:1788460077.228171:0:9538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003379712 00010000:00010000:1.0:1788460077.228208:0:9538:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841200/0x5dfa74784542b5fa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a71e expref: 47 pid: 6533 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460077.228293:0:9538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 77 00000100:00100000:1.0:1788460077.228302:0:9538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bedf6e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+47:2394:x1875336003379712:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788460077.228317:0:9538:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788460077.228324:0:9538:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841200/0x5dfa74784542b5fa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a71e expref: 47 pid: 6533 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460077.228336:0:9538:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841200/0x5dfa74784542b5fa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a71e expref: 47 pid: 6533 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460077.228355:0:9538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841200/0x5dfa74784542b5fa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a71e expref: 47 pid: 6533 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460077.228369:0:9538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8c4bef1fe400) 00010000:00010000:1.0:1788460077.228374:0:9538:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542b655 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460077.228382:0:9538:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542b655 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460077.228401:0:9538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542b655 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460077.228432:0:9538:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788460077.228488:0:9538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bedf6e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+46:2394:x1875336003379712:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 187us (1215us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460077.228496:0:9538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 77 00010000:00010000:2.0:1788460077.228570:0:6537:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542b655 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460077.228578:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542b655 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788460077.228686:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:2.0:1788460077.228798:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:2.0:1788460077.228874:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac41b9f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6537:1875336022333952:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788460077.228937:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460077.229000:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc7e39c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788460077.234152:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022333952 00000100:00100000:0.0:1788460077.234166:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022333952 00000100:00100000:0.0:1788460077.234247:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788460077.234258:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6537:x1875336022333952:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788460077.234379:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6537:x1875336022333952:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 124us (5442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460077.234388:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00080000:2.0:1788460077.234457:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788460077.234491:0:6537:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967302 gen 2 00000004:00080000:2.0:1788460077.234496:0:6537:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967302 00000004:00080000:2.0:1788460077.234514:0:6537:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8c4bc471b480, transno 4294967302 00000100:00100000:2.0:1788460077.234535:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac41b9f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6537:1875336022333952:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788460077.234676:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:2.0:1788460077.234764:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac41b9f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6537:1875336022334080:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788460077.234799:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460077.234818:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc7e39480 going to sleep for 11 seconds 00000100:00100000:0.0:1788460077.235142:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022334080 00000100:00100000:0.0:1788460077.235147:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022334080 00000100:00100000:0.0:1788460077.235185:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788460077.235194:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6537:x1875336022334080:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788460077.235298:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6537:x1875336022334080:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 105us (497us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788460077.235305:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788460077.235380:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac41b9f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6537:1875336022334080:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788460077.235421:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:2.0:1788460077.235453:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542b655 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460077.235464:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542b655 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460077.235472:0:6537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542b655 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460077.235479:0:6537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bfadc7800 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:2.0:1788460077.235483:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542b655 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460077.235490:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542b655 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460077.235505:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8c4bef1fe400) 00010000:00010000:2.0:1788460077.235509:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788460077.235514:0:6537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542b655 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460077.235519:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542b655 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788460077.235598:0:6537:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788460077.235669:0:6537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:2.0:1788460077.235690:0:6537:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 374338745624ns, next at 375338743616ns, rc = 0 00000001:00080000:2.0:1788460077.235709:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:2.0:1788460077.235732:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8c4bef1fe400) 00010000:00010000:2.0:1788460077.235735:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788460077.235742:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f400/0x5dfa74784542b640 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a741 expref: 50 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460077.235834:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc6be3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+49:11350:x1875336003379584:12345-192.168.206.5@tcp:35:lfs.0 Request processed in 17405us (17554us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1788460077.235842:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 26 00000020:00080000:2.0:1788460077.235846:0:6537:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788460077.239775:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460077.239852:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003379840 00000100:00100000:2.0:1788460077.239862:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003379840 00000100:00100000:2.0:1788460077.239925:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 111 00000100:00100000:2.0:1788460077.239936:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3bdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+49:11350:x1875336003379840:12345-192.168.206.5@tcp:101:lfs.0 00010000:00010000:2.0:1788460077.239988:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460077.240008:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542b65c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a748 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460077.240060:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542b65c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a748 expref: 50 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460077.240073:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542b65c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a748 expref: 50 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460077.240090:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8c4bfa9fe700) 00010000:00010000:2.0:1788460077.240093:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788460077.240096:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bfadc7400, rc 0) 00000100:00100000:2.0:1788460077.240166:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3bdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+50:11350:x1875336003379840:12345-192.168.206.5@tcp:101:lfs.0 Request processed in 231us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460077.240174:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 111 00000100:00100000:0.0:1788460077.244141:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460077.244222:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003380096 00000100:00100000:2.0:1788460077.244231:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003380096 00000100:00100000:2.0:1788460077.244287:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 27 00000100:00100000:2.0:1788460077.244296:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3bd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+50:11350:x1875336003380096:12345-192.168.206.5@tcp:35:lfs.0 00000100:00100000:2.0:1788460077.244501:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3bd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+51:11350:x1875336003380096:12345-192.168.206.5@tcp:35:lfs.0 Request processed in 205us (367us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1788460077.244509:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 27 00000100:00100000:3.0:1788460077.354210:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460077.354353:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003380224 00000100:00100000:1.0:1788460077.354363:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003380224 00000100:00100000:1.0:1788460077.354424:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 112 00000100:00100000:1.0:1788460077.354434:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+51:11360:x1875336003380224:12345-192.168.206.5@tcp:34:lfs.0 00010000:00010000:1.0:1788460077.354514:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677e00/0x5dfa74784542b663 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460077.354530:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677e00/0x5dfa74784542b663 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460077.354542:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677e00/0x5dfa74784542b663 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460077.354553:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676a00/0x5dfa74784542b66a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460077.354561:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676a00/0x5dfa74784542b66a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460077.354568:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676a00/0x5dfa74784542b66a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460077.354641:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676000/0x5dfa74784542b671 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460077.354660:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676000/0x5dfa74784542b671 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460077.354667:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676000/0x5dfa74784542b671 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788460077.354721:0:6534:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676000/0x5dfa74784542b671 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460077.354735:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677e00/0x5dfa74784542b663 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460077.354742:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677e00/0x5dfa74784542b663 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460077.354748:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677e00/0x5dfa74784542b663 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460077.354755:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac3677e00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:1.0:1788460077.354759:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677e00/0x5dfa74784542b663 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460077.354766:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677e00/0x5dfa74784542b663 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460077.354779:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8c4bc2ab7100) 00010000:00010000:1.0:1788460077.354782:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788460077.354787:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677e00/0x5dfa74784542b663 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460077.354793:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677e00/0x5dfa74784542b663 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460077.354815:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676a00/0x5dfa74784542b66a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460077.354820:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676a00/0x5dfa74784542b66a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460077.354826:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676a00/0x5dfa74784542b66a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460077.354831:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac3676a00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:1.0:1788460077.354835:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676a00/0x5dfa74784542b66a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460077.354841:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676a00/0x5dfa74784542b66a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460077.354849:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8c4bef1fe300) 00010000:00010000:1.0:1788460077.354852:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788460077.354855:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676a00/0x5dfa74784542b66a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460077.354861:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676a00/0x5dfa74784542b66a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460077.354870:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676000/0x5dfa74784542b671 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460077.354875:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676000/0x5dfa74784542b671 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460077.354880:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676000/0x5dfa74784542b671 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460077.354891:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac3676000 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:1.0:1788460077.354893:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676000/0x5dfa74784542b671 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460077.354910:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676000/0x5dfa74784542b671 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460077.354919:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8c4bfa9fe700) 00010000:00010000:1.0:1788460077.354921:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788460077.354924:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676000/0x5dfa74784542b671 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460077.354928:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676000/0x5dfa74784542b671 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460077.355055:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+51:11360:x1875336003380224:12345-192.168.206.5@tcp:34:lfs.0 Request processed in 621us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460077.355063:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 112 00000100:00100000:1.0:1788460077.401147:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460077.401229:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003380480 00000100:00100000:3.0:1788460077.401240:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003380480 00000100:00100000:3.0:1788460077.401301:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 113 00000100:00100000:3.0:1788460077.401311:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac1e63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+51:11363:x1875336003380480:12345-192.168.206.5@tcp:101:lfs.0 00010000:00010000:3.0:1788460077.401330:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460077.401350:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f600/0x5dfa74784542b678 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a74f expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460077.401421:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f400/0x5dfa74784542b67f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460077.401523:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f400/0x5dfa74784542b67f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460077.401548:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f400/0x5dfa74784542b67f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460077.401562:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f1e00/0x5dfa74784542b686 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460077.401570:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f1e00/0x5dfa74784542b686 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460077.401577:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f1e00/0x5dfa74784542b686 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460077.401687:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209800/0x5dfa74784542b68d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460077.401708:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209800/0x5dfa74784542b68d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460077.401716:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209800/0x5dfa74784542b68d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788460077.401725:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788460077.401797:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f400/0x5dfa74784542b67f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460077.401805:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f400/0x5dfa74784542b67f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460077.401811:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f400/0x5dfa74784542b67f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460077.401817:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac395f400 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:3.0:1788460077.401828:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f400/0x5dfa74784542b67f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460077.401835:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f400/0x5dfa74784542b67f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460077.401848:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8c4bc2ab7100) 00010000:00010000:3.0:1788460077.401851:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460077.401855:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f400/0x5dfa74784542b67f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460077.401861:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f400/0x5dfa74784542b67f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460077.401874:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f1e00/0x5dfa74784542b686 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460077.401880:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f1e00/0x5dfa74784542b686 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460077.401886:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f1e00/0x5dfa74784542b686 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460077.401891:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc14f1e00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:3.0:1788460077.401894:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f1e00/0x5dfa74784542b686 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460077.401899:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f1e00/0x5dfa74784542b686 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460077.401907:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8c4bef1fe300) 00010000:00010000:3.0:1788460077.401910:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460077.401919:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f1e00/0x5dfa74784542b686 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460077.401925:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f1e00/0x5dfa74784542b686 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460077.402009:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f600/0x5dfa74784542b678 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a74f expref: 54 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460077.402024:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209800/0x5dfa74784542b68d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a74f expref: 53 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460077.402032:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8c4bfa9fe700) 00010000:00010000:3.0:1788460077.402034:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788460077.402037:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bef209800, rc 0) 00000100:00100000:3.0:1788460077.402352:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac1e63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+53:11363:x1875336003380480:12345-192.168.206.5@tcp:101:lfs.0 Request processed in 1041us (1211us total) trans 4294967392 rc 0/0 00000100:00100000:3.0:1788460077.402361:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 113 00000100:00100000:3.0:1788460077.412828:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460077.412932:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003380608 00000100:00100000:0.0:1788460077.412986:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003380608 00000100:00100000:0.0:1788460077.413045:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 114 00000100:00100000:0.0:1788460077.413055:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4138e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+53:11363:x1875336003380608:12345-192.168.206.5@tcp:54:lfs.0 00010000:00010000:0.0:1788460077.413120:0:13560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542b69b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460077.413136:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542b69b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460077.413147:0:13560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542b69b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460077.413181:0:13560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542b69b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460077.413188:0:13560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542b69b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460077.413195:0:13560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542b69b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460077.413201:0:13560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc2bd5c00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460077.413205:0:13560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542b69b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460077.413212:0:13560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542b69b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460077.413222:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8c4bfa9fe700) 00010000:00010000:0.0:1788460077.413225:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788460077.413229:0:13560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542b69b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460077.413245:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542b69b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460077.413326:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4138e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+53:11363:x1875336003380608:12345-192.168.206.5@tcp:54:lfs.0 Request processed in 271us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460077.413333:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 114 00000100:00100000:1.0:1788460077.415766:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460077.415854:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003380864 00000100:00100000:2.0:1788460077.415864:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003380864 00000100:00100000:2.0:1788460077.415927:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 28 00000100:00100000:2.0:1788460077.415937:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac1e60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+53:11363:x1875336003380864:12345-192.168.206.5@tcp:35:lfs.0 00000100:00100000:2.0:1788460077.416182:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac1e60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+54:11363:x1875336003380864:12345-192.168.206.5@tcp:35:lfs.0 Request processed in 246us (423us total) trans 4294967393 rc 0/0 00000100:00100000:2.0:1788460077.416190:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 28 00000100:00100000:2.0:1788460077.515815:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460077.515905:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003381120 00000100:00100000:3.0:1788460077.515914:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003381120 00000100:00100000:3.0:1788460077.516004:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 115 00000100:00100000:3.0:1788460077.516015:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+54:11373:x1875336003381120:12345-192.168.206.5@tcp:101:bash.0 00010000:00010000:3.0:1788460077.516038:0:7760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460077.516042:0:7760:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788460077.516068:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b61d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a733 expref: 54 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460077.516086:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8c4bc2ab7100) 00010000:00010000:3.0:1788460077.516105:0:7760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788460077.516120:0:7760:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208c00/0x5dfa74784542b6a2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a756 expref: -99 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460077.516226:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542b6a9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460077.516241:0:7760:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209800/0x5dfa74784542b68d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a74f expref: 54 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460077.516249:0:7760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542b6a9 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460077.516282:0:7760:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209800/0x5dfa74784542b68d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a74f expref: 54 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460077.516297:0:7760:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209800/0x5dfa74784542b68d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a74f expref: 54 pid: 6533 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460077.516310:0:7760:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4138000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7760:1875336022334208:192.168.206.5@tcp:104: 00000100:00100000:3.0:1788460077.516406:0:7760:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac286c600 going to sleep for 11 seconds 00000100:00100000:3.0:1788460077.531005:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460077.531112:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003381248 00000100:00100000:0.0:1788460077.531122:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003381248 00010000:00010000:0.0:1788460077.531160:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209800/0x5dfa74784542b68d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a74f expref: 55 pid: 6533 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460077.531205:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 78 00000100:00100000:0.0:1788460077.531215:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac42f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+55:2394:x1875336003381248:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788460077.531228:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788460077.531235:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209800/0x5dfa74784542b68d lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a74f expref: 55 pid: 6533 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460077.531246:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209800/0x5dfa74784542b68d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a74f expref: 55 pid: 6533 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460077.531266:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8c4bfa9fe700) 00010000:00010000:0.0:1788460077.531271:0:6518:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542b6a9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460077.531279:0:6518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542b6a9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460077.531285:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542b6a9 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460077.531310:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788460077.531362:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac42f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+55:2394:x1875336003381248:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 148us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460077.531369:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 78 00010000:00010000:2.0:1788460077.531469:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209800/0x5dfa74784542b68d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a74f expref: 54 pid: 6533 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460077.531485:0:7760:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4138000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7760:1875336022334208:192.168.206.5@tcp:104: 00010000:00010000:2.0:1788460077.531504:0:7760:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542b6a9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460077.531514:0:7760:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542b6a9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460077.531527:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542b6a9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788460077.531544:0:7760:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788460077.531661:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208c00/0x5dfa74784542b6a2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a756 expref: 55 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460077.531675:0:7760:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542b6a9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a756 expref: 54 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460077.531682:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8c4bfa9fe700) 00010000:00010000:2.0:1788460077.531685:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788460077.531687:0:7760:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bef208400, rc 0) 00000100:00100000:2.0:1788460077.531722:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+54:11373:x1875336003381120:12345-192.168.206.5@tcp:101:bash.0 Request processed in 15710us (15916us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1788460077.531729:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 115 00000100:00100000:1.0:1788460077.537241:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460077.537331:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003381376 00000100:00100000:3.0:1788460077.537341:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003381376 00000100:00100000:3.0:1788460077.537397:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 116 00000100:00100000:3.0:1788460077.537408:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac1e62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+54:11373:x1875336003381376:12345-192.168.206.5@tcp:101:bash.0 00010000:00010000:3.0:1788460077.537432:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460077.537453:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209e00/0x5dfa74784542b6b7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a75d expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460077.537503:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208200/0x5dfa74784542b6be lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460077.537516:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208200/0x5dfa74784542b6be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460077.537526:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208200/0x5dfa74784542b6be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460077.537626:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209e00/0x5dfa74784542b6b7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a75d expref: 56 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460077.537643:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208200/0x5dfa74784542b6be lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a75d expref: 55 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460077.537651:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8c4bfa9fe700) 00010000:00010000:3.0:1788460077.537654:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788460077.537657:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bef208200, rc 0) 00000100:00100000:3.0:1788460077.537734:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac1e62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+55:11373:x1875336003381376:12345-192.168.206.5@tcp:101:bash.0 Request processed in 329us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460077.537742:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 116 00000100:00100000:3.0:1788460077.541810:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460077.541915:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003381632 00000100:00100000:1.0:1788460077.541926:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003381632 00000100:00100000:2.0:1788460077.542245:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 117 00000100:00100000:2.0:1788460077.542260:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac42f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+55:11373:x1875336003381632:12345-192.168.206.5@tcp:36:bash.0 00010000:00010000:2.0:1788460077.542492:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6800/0x5dfa74784542b6c5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460077.542509:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6800/0x5dfa74784542b6c5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460077.542519:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6800/0x5dfa74784542b6c5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788460077.542558:0:6535:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:2.0:1788460077.542595:0:6535:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004186b6a3 reply state 00000000f1b68333 transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6800/0x5dfa74784542b6c5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460077.542606:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6800/0x5dfa74784542b6c5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460077.542612:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8c4bfa9fe700) 00010000:00010000:2.0:1788460077.542614:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788460077.542618:0:6535:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788460077.542720:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac42f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+58:11373:x1875336003381632:12345-192.168.206.5@tcp:36:bash.0 Request processed in 464us (917us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1788460077.542726:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 117 00000020:00080000:2.0:1788460077.542731:0:6535:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788460077.548370:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460077.548457:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003381760 00000100:00100000:2.0:1788460077.548467:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003381760 00000100:00100000:2.0:1788460077.548573:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 118 00000100:00100000:2.0:1788460077.548585:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac2975f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+58:11373:x1875336003381760:12345-192.168.206.5@tcp:101:bash.0 00010000:00010000:2.0:1788460077.548608:0:7760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460077.548629:0:7760:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b6cc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a764 expref: -99 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460077.548731:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542b6d3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460077.548745:0:7760:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542b6a9 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a756 expref: 59 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460077.548754:0:7760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542b6d3 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460077.548785:0:7760:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542b6a9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a756 expref: 59 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460077.548816:0:7760:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542b6a9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a756 expref: 59 pid: 7760 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460077.548830:0:7760:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac41bbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7760:1875336022334336:192.168.206.5@tcp:104: 00000100:00100000:2.0:1788460077.548926:0:7760:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc7e399c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788460077.551194:0:7760:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac41bbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7760:1875336022334336:192.168.206.5@tcp:104: 00010000:00010000:2.0:1788460077.551221:0:7760:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542b6d3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460077.552993:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460077.553180:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003381888 00000100:00100000:2.0:1788460077.553189:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003381888 00010000:00010000:2.0:1788460077.553229:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542b6a9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a756 expref: 60 pid: 7760 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460077.553270:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 79 00000100:00100000:2.0:1788460077.553281:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac2975880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+60:2394:x1875336003381888:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788460077.553304:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460077.553312:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542b6a9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a756 expref: 60 pid: 7760 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460077.553324:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542b6a9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a756 expref: 60 pid: 7760 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460077.553344:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542b6a9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a756 expref: 60 pid: 7760 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460077.553377:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8c4bfa9fe700) 00010000:00010000:2.0:1788460077.553383:0:6519:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542b6d3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460077.553391:0:6519:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542b6d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460077.553399:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542b6d3 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460077.553426:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788460077.553592:0:7760:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542b6d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460077.553601:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542b6d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460077.553740:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac2975880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+59:2394:x1875336003381888:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 460us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460077.553748:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 79 00000004:00200000:3.0:1788460077.555315:0:7760:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788460077.555336:0:7760:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788460077.555362:0:7760:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542b6d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460077.555399:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b6cc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a764 expref: 59 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460077.555416:0:7760:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542b6d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a764 expref: 58 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460077.555425:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8c4bfa9fe700) 00010000:00010000:3.0:1788460077.555428:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788460077.555431:0:7760:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bfadc7e00, rc 0) 00000100:00100000:3.0:1788460077.555480:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac2975f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+58:11373:x1875336003381760:12345-192.168.206.5@tcp:101:bash.0 Request processed in 6898us (7120us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460077.555488:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 118 00000100:00100000:3.0:1788460077.566419:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460077.566734:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003382144 00000100:00100000:2.0:1788460077.566744:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003382144 00000100:00100000:2.0:1788460077.566801:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 29 00000100:00100000:2.0:1788460077.566812:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac42f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+58:11373:x1875336003382144:12345-192.168.206.5@tcp:35:bash.0 00000100:00100000:2.0:1788460077.567042:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac42f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+59:11373:x1875336003382144:12345-192.168.206.5@tcp:35:bash.0 Request processed in 231us (630us total) trans 4294967397 rc 0/0 00000100:00100000:2.0:1788460077.567051:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 29 00000100:00100000:0.0:1788460077.649404:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788460077.649426:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac42fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022334464:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788460077.649486:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460077.649594:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022334464 00000100:00100000:1.0:1788460077.649601:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022334464 00000100:00100000:1.0:1788460077.649669:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788460077.649680:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3bd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3661:x1875336022334464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788460077.649723:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788460077.649779:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3bd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3661:x1875336022334464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460077.649787:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788460077.649927:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac42fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022334464:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788460077.650200:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788460077.687858:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460077.687976:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003382272 00000100:00100000:0.0:1788460077.687985:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003382272 00000100:00100000:0.0:1788460077.688041:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 119 00000100:00100000:0.0:1788460077.688050:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac42fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+59:11379:x1875336003382272:12345-192.168.206.5@tcp:101:lfs.0 00010000:00010000:0.0:1788460077.688072:0:13560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460077.688090:0:13560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5800/0x5dfa74784542b6da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a76b expref: -99 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460077.688148:0:13560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4400/0x5dfa74784542b6e1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460077.688162:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4400/0x5dfa74784542b6e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460077.688171:0:13560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4400/0x5dfa74784542b6e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788460077.688209:0:13560:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1788460077.688212:0:13560:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788460077.688242:0:13560:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4400/0x5dfa74784542b6e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460077.688264:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5800/0x5dfa74784542b6da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a76b expref: 61 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460077.688280:0:13560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4400/0x5dfa74784542b6e1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a76b expref: 60 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460077.688289:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8c4bc2ab7100) 00010000:00010000:0.0:1788460077.688292:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788460077.688295:0:13560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc2bd4400, rc 0) 00000100:00100000:0.0:1788460077.688481:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac42fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+60:11379:x1875336003382272:12345-192.168.206.5@tcp:101:lfs.0 Request processed in 431us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460077.688488:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 119 00000100:00100000:1.0:1788460077.693217:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460077.693390:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003382400 00000100:00100000:3.0:1788460077.693400:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003382400 00000100:00100000:3.0:1788460077.693461:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 120 00000100:00100000:3.0:1788460077.693471:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac42fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+60:11379:x1875336003382400:12345-192.168.206.5@tcp:101:lfs.0 00010000:00010000:3.0:1788460077.693491:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460077.693511:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209400/0x5dfa74784542b6e8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a772 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460077.693576:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209e00/0x5dfa74784542b6ef lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460077.693607:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209e00/0x5dfa74784542b6ef lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460077.693619:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209e00/0x5dfa74784542b6ef lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460077.693642:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542b6f6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460077.693650:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542b6f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460077.693657:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542b6f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460077.693736:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208c00/0x5dfa74784542b6fd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460077.693746:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208c00/0x5dfa74784542b6fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460077.693753:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208c00/0x5dfa74784542b6fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788460077.693792:0:6534:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788460077.693796:0:6534:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788460077.693815:0:6534:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208c00/0x5dfa74784542b6fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460077.693826:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208c00/0x5dfa74784542b6fd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460077.693844:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209e00/0x5dfa74784542b6ef lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460077.693851:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209e00/0x5dfa74784542b6ef lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460077.693858:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209e00/0x5dfa74784542b6ef lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460077.693864:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bef209e00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:3.0:1788460077.693868:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209e00/0x5dfa74784542b6ef lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460077.693876:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209e00/0x5dfa74784542b6ef lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460077.693888:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8c4bc2ab7100) 00010000:00010000:3.0:1788460077.693891:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460077.693896:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209e00/0x5dfa74784542b6ef lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460077.693902:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209e00/0x5dfa74784542b6ef lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460077.693914:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542b6f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460077.693921:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542b6f6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460077.693927:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542b6f6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460077.693938:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bef208400 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:3.0:1788460077.693989:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542b6f6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460077.693998:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542b6f6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460077.694008:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8c4bef1fe300) 00010000:00010000:3.0:1788460077.694011:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460077.694014:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542b6f6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460077.694020:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542b6f6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460077.694047:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209400/0x5dfa74784542b6e8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a772 expref: 62 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460077.694060:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208c00/0x5dfa74784542b6fd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a772 expref: 61 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460077.694068:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8c4bfa9fe700) 00010000:00010000:3.0:1788460077.694070:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788460077.694072:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bef208c00, rc 0) 00000100:00100000:3.0:1788460077.694136:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac42fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+61:11379:x1875336003382400:12345-192.168.206.5@tcp:101:lfs.0 Request processed in 667us (928us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460077.694144:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 120 00000100:00100000:3.0:1788460077.701301:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460077.701361:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460077.701494:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003382784 00000100:00100000:2.0:1788460077.701504:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003382784 00000100:00100000:2.0:1788460077.701776:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 121 00000100:00100000:2.0:1788460077.701792:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac42f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+61:11379:x1875336003382784:12345-192.168.206.5@tcp:101:lfs.0 00010000:00010000:2.0:1788460077.701813:0:7760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460077.701840:0:7760:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b704 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a779 expref: -99 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460077.701907:0:9538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003382528 00000100:00100000:1.0:1788460077.701913:0:9538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003382528 00010000:00010000:2.0:1788460077.701973:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b70b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460077.701983:0:9538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 6 00010000:00010000:2.0:1788460077.701989:0:7760:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542b6d3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a764 expref: 63 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460077.701996:0:9538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac42f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+63:2393:x1875336003382528:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788460077.702005:0:7760:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208c00/0x5dfa74784542b6fd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a772 expref: 63 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460077.702008:0:9538:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460077.702018:0:7760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b70b lrc: 5/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460077.707017:0:7760:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208c00/0x5dfa74784542b6fd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50201000000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a772 expref: 63 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460077.707045:0:7760:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac41bbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7760:1875336022334592:192.168.206.5@tcp:104: 00010000:00010000:2.0:1788460077.707152:0:7760:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542b6d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a764 expref: 63 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460077.707165:0:7760:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542b6d3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a764 expref: 63 pid: 7760 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460077.707175:0:7760:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac41b9500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7760:1875336022334720:192.168.206.5@tcp:104: 00000100:00100000:2.0:1788460077.707198:0:7760:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc7e39e40 going to sleep for 11 seconds 00010000:00010000:2.0:1788460077.711771:0:7760:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.206.5@tcp) returned -22 from blocking AST (req@000000009103130e x1875336022334592) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208c00/0x5dfa74784542b6fd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40201400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a772 expref: 63 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460077.712764:0:9538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8c4bfa9fe700) 00010000:00010000:1.0:1788460077.712773:0:9538:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b70b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460077.712784:0:9538:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b70b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460077.712791:0:9538:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788460077.712861:0:9538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac42f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+63:2393:x1875336003382528:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 10867us (11568us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460077.712881:0:9538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 6 00010000:00010000:2.0:1788460077.714251:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208c00/0x5dfa74784542b6fd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a772 expref: 62 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460077.714275:0:7760:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac41bbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7760:1875336022334592:192.168.206.5@tcp:104: 00000100:00100000:2.0:1788460077.714306:0:7760:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac41b9500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7760:1875336022334720:192.168.206.5@tcp:104: 00010000:00010000:2.0:1788460077.714329:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8c4bfa9fe700) 00010000:00010000:2.0:1788460077.714335:0:7760:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b70b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460077.714343:0:7760:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b70b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460077.714363:0:7760:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b70b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460077.715637:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460077.715735:0:9549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003382912 00000100:00100000:1.0:1788460077.715744:0:9549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003382912 00010000:00010000:1.0:1788460077.715783:0:9549:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542b6d3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a764 expref: 62 pid: 7760 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460077.715822:0:9549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 80 00000100:00100000:1.0:1788460077.715847:0:9549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac42f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+62:2394:x1875336003382912:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788460077.715860:0:9549:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788460077.715867:0:9549:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542b6d3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a764 expref: 62 pid: 7760 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460077.715879:0:9549:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542b6d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a764 expref: 62 pid: 7760 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460077.715899:0:9549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542b6d3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a764 expref: 62 pid: 7760 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460077.715914:0:9549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8c4bfa9fe700) 00010000:00010000:1.0:1788460077.715918:0:9549:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b70b lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460077.715927:0:9549:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b70b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460077.715934:0:9549:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b70b lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460077.716008:0:9549:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788460077.716055:0:7760:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b70b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460077.716055:0:9549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac42f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+61:2394:x1875336003382912:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 209us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460077.716062:0:9549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 80 00010000:00010000:3.0:1788460077.716063:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b70b lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788460077.716080:0:7760:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788460077.716198:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b704 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a779 expref: 62 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460077.716213:0:7760:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b70b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a779 expref: 61 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460077.716220:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8c4bfa9fe700) 00010000:00010000:3.0:1788460077.716223:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788460077.716225:0:7760:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bfadc6400, rc 0) 00000100:00100000:3.0:1788460077.716266:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac42f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+61:11379:x1875336003382784:12345-192.168.206.5@tcp:101:lfs.0 Request processed in 14479us (14904us total) trans 4294967398 rc 0/0 00000100:00100000:3.0:1788460077.716274:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 121 00000100:00100000:3.0:1788460077.733396:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460077.733547:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003383168 00000100:00100000:0.0:1788460077.733557:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003383168 00000100:00100000:0.0:1788460077.733625:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 7 00000100:00100000:0.0:1788460077.733635:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac42f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+61:11379:x1875336003383168:12345-192.168.206.5@tcp:103:lfs.0 00010000:00010000:0.0:1788460077.733648:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788460077.733671:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542b65c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a748 expref: 61 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460077.733690:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8c4bfa9fe700) 00010000:00010000:0.0:1788460077.733707:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788460077.733760:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac42f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+60:11379:x1875336003383168:12345-192.168.206.5@tcp:103:lfs.0 Request processed in 126us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460077.733768:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 7 00000100:00100000:1.0:1788460077.736500:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460077.736814:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003383296 00000100:00100000:0.0:1788460077.736824:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003383296 00000100:00100000:0.0:1788460077.736881:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 122 00000100:00100000:0.0:1788460077.736891:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac42fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+60:11379:x1875336003383296:12345-192.168.206.5@tcp:58:lfs.0 00010000:00010000:0.0:1788460077.737021:0:13560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542b719 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460077.737039:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542b719 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460077.737051:0:13560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542b719 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788460077.737143:0:13560:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:0.0:1788460077.737233:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac42fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+60:11379:x1875336003383296:12345-192.168.206.5@tcp:58:lfs.0 Request processed in 342us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460077.737241:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 122 00000100:00100000:1.0:1788460077.739405:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460077.739542:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003383424 00000100:00100000:3.0:1788460077.739552:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003383424 00000100:00100000:3.0:1788460077.739604:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 123 00000100:00100000:3.0:1788460077.739613:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac42fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+60:11379:x1875336003383424:12345-192.168.206.5@tcp:101:lfs.0 00010000:00010000:3.0:1788460077.739631:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460077.739649:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209e00/0x5dfa74784542b720 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a780 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460077.739730:0:6533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542b719 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460077.739741:0:6533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209e00/0x5dfa74784542b720 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a780 expref: 61 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460077.739758:0:6533:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542b719 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460077.739771:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209e00/0x5dfa74784542b720 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a780 expref: 61 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460077.739783:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8c4bfa9fe700) 00010000:00010000:3.0:1788460077.739786:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788460077.739789:0:6533:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209e00/0x5dfa74784542b720 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a780 expref: 61 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460077.739796:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bef209e00, rc 0) 00000100:00100000:3.0:1788460077.739848:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac42fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+61:11379:x1875336003383424:12345-192.168.206.5@tcp:101:lfs.0 Request processed in 236us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460077.739855:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 123 00010000:00010000:1.0:1788460077.841178:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788460078.161545:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3bdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022334848:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788460078.161625:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460078.161759:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022334848 00000100:00100000:0.0:1788460078.161766:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022334848 00000100:00100000:0.0:1788460078.161830:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788460078.161839:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac42fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022334848:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788460078.161858:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788460078.161905:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac42fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022334848:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460078.161912:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788460078.162089:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac41b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022334976:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788460078.162118:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460078.162304:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022334976 00000100:00100000:0.0:1788460078.162309:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022334976 00000100:00100000:0.0:1788460078.162346:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788460078.162353:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac42f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022334976:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788460078.162385:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1788460078.162428:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac42f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022334976:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460078.162434:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:1.0:1788460078.162596:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788460078.162636:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3bdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022334848:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788460078.163526:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac41b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022334976:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1788460078.482842:0:13811:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788460078.482850:0:13811:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788460078.482894:0:13811:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1788460078.482911:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788460078.484622:0:13811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3bdb100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13811:1875336022335104:192.168.206.5@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788460078.484867:0:13811:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc65d7cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788460078.496572:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460078.496647:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003383552 00000100:00100000:3.0:1788460078.496664:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003383552 00000100:00100000:3.0:1788460078.496804:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 124 00000100:00100000:3.0:1788460078.496815:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac42ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+62:11380:x1875336003383552:12345-192.168.206.5@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788460078.496845:0:7760:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788460078.497001:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac42ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+62:11380:x1875336003383552:12345-192.168.206.5@tcp:53:lhsmtool_posix.0 Request processed in 187us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460078.497009:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 124 00000100:00100000:0.0:1788460078.497231:0:13811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3bdb100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13811:1875336022335104:192.168.206.5@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788460078.501077:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00080000:1.0:1788460078.501205:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788460078.501431:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003383680 00000100:00100000:0.0:1788460078.501440:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003383680 00000100:00100000:0.0:1788460078.501496:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 125 00000100:00100000:0.0:1788460078.501506:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac42f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+61:11380:x1875336003383680:12345-192.168.206.5@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788460078.501572:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4a00/0x5dfa74784542b727 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.501587:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4a00/0x5dfa74784542b727 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.501600:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4a00/0x5dfa74784542b727 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.501621:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5800/0x5dfa74784542b72e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.501627:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5800/0x5dfa74784542b72e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.501646:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5800/0x5dfa74784542b72e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.501669:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542b735 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.501677:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542b735 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.501683:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542b735 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788460078.504154:0:6534:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788460078.504163:0:6534:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788460078.504275:0:6534:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542b735 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.504294:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4a00/0x5dfa74784542b727 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.504301:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4a00/0x5dfa74784542b727 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.504309:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4a00/0x5dfa74784542b727 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.504315:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc2bd4a00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460078.504319:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4a00/0x5dfa74784542b727 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.504326:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4a00/0x5dfa74784542b727 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.504357:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c4bef1fde00) 00010000:00010000:0.0:1788460078.504359:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460078.504365:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4a00/0x5dfa74784542b727 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.504371:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4a00/0x5dfa74784542b727 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.504384:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5800/0x5dfa74784542b72e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.504390:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5800/0x5dfa74784542b72e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.504407:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5800/0x5dfa74784542b72e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.504413:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc2bd5800 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460078.504416:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5800/0x5dfa74784542b72e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.504422:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5800/0x5dfa74784542b72e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.504429:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff8c4bc5dc1b00) 00010000:00010000:0.0:1788460078.504432:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460078.504434:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5800/0x5dfa74784542b72e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.504439:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5800/0x5dfa74784542b72e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.504467:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542b735 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.504473:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542b735 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.504478:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542b735 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.504483:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc2bd5c00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460078.504486:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542b735 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.504491:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542b735 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.504498:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8c4bfa9fe700) 00010000:00010000:0.0:1788460078.504501:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460078.504503:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542b735 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.504509:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542b735 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460078.505110:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac42f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+61:11380:x1875336003383680:12345-192.168.206.5@tcp:34:lhsmtool_posix.0 Request processed in 3600us (4049us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460078.505122:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 125 00000100:00100000:3.0:1788460078.513284:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460078.513731:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003383936 00000100:00100000:2.0:1788460078.513742:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003383936 00000100:00100000:2.0:1788460078.513804:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 126 00000100:00100000:2.0:1788460078.513814:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac42f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+61:11380:x1875336003383936:12345-192.168.206.5@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788460078.513833:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460078.513852:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542b73c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a787 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460078.514060:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542b743 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460078.514094:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542b743 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460078.514106:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542b743 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788460078.514119:0:6535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788460078.514190:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542b743 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460078.514198:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542b743 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460078.514205:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542b743 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460078.514211:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bfadc7c00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:2.0:1788460078.514215:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542b743 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460078.514222:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542b743 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460078.514234:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8c4bfa9fe700) 00010000:00010000:2.0:1788460078.514238:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788460078.514242:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542b743 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460078.514248:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542b743 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460078.514285:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542b73c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a787 expref: 63 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460078.514303:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c4bef1fde00) 00010000:00010000:2.0:1788460078.514305:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788460078.514310:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542b73c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a787 expref: 63 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460078.514320:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bfadc7800, rc 0) 00000100:00100000:2.0:1788460078.514374:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac42f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+62:11380:x1875336003383936:12345-192.168.206.5@tcp:101:lhsmtool_posix.0 Request processed in 562us (1099us total) trans 4294967399 rc 301/301 00000100:00100000:2.0:1788460078.514382:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 126 00000100:00100000:1.0:1788460078.519367:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460078.520563:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003384064 00000100:00100000:2.0:1788460078.520575:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003384064 00000100:00100000:2.0:1788460078.520760:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 127 00000100:00100000:2.0:1788460078.520773:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac42fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+62:11380:x1875336003384064:12345-192.168.206.5@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788460078.520807:0:13560:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788460078.521236:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac42fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+62:11380:x1875336003384064:12345-192.168.206.5@tcp:53:lhsmtool_posix.0 Request processed in 465us (1881us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460078.521245:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 127 00000100:00100000:0.0:1788460078.532829:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460078.532934:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003384320 00000100:00100000:3.0:1788460078.532976:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003384320 00000100:00100000:3.0:1788460078.533089:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 128 00000100:00100000:3.0:1788460078.533099:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3bdb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+62:11380:x1875336003384320:12345-192.168.206.5@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788460078.533119:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460078.533122:0:6534:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788460078.533147:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4400/0x5dfa74784542b6e1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a76b expref: 62 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460078.533166:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8c4bc2ab7100) 00010000:00010000:3.0:1788460078.533171:0:6534:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788460078.533183:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209400/0x5dfa74784542b751 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a78e expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788460078.533515:0:6534:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:2.0:1788460078.534236:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542b758 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460078.534254:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542b758 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460078.534265:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542b758 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460078.534329:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209400/0x5dfa74784542b751 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a78e expref: 64 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460078.534363:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542b758 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a78e expref: 63 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460078.534372:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8c4bef1fe600) 00010000:00010000:2.0:1788460078.534375:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788460078.534378:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bfadc7800, rc 0) 00000100:00100000:2.0:1788460078.534446:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3bdb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+63:11380:x1875336003384320:12345-192.168.206.5@tcp:101:lhsmtool_posix.0 Request processed in 1348us (1626us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1788460078.534455:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 128 00000100:00100000:3.0:1788460078.542871:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460078.542973:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003384576 00000100:00100000:2.0:1788460078.542983:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003384576 00000100:00100000:2.0:1788460078.543041:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 129 00000100:00100000:2.0:1788460078.543051:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac42f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+63:11380:x1875336003384576:12345-192.168.206.5@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788460078.543104:0:7760:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460078.543129:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542b758 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a78e expref: 63 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460078.543160:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8c4bef1fe600) 00010000:00010000:2.0:1788460078.543170:0:7760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788460078.543189:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542b766 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460078.543203:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542b766 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460078.543212:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542b766 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460078.543285:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542b76d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x656b5daa bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460078.543294:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542b76d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x656b5daa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460078.543301:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542b76d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x656b5daa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460078.543340:0:7760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542b766 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460078.543348:0:7760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542b766 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460078.543354:0:7760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542b766 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460078.543371:0:7760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bfadc7c00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:2.0:1788460078.543376:0:7760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542b766 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460078.543383:0:7760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542b766 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460078.543391:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8c4bc2ab7100) 00010000:00010000:2.0:1788460078.543394:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460078.543398:0:7760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542b766 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460078.543404:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542b766 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460078.543421:0:7760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542b76d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x656b5daa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460078.543427:0:7760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542b76d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x656b5daa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460078.543432:0:7760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542b76d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x656b5daa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460078.543437:0:7760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bfadc7400 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:2.0:1788460078.543440:0:7760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542b76d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x656b5daa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460078.543446:0:7760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542b76d lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x656b5daa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460078.543454:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x656b5daa (ffff8c4bfa9fe200) 00010000:00010000:2.0:1788460078.543457:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460078.543460:0:7760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542b76d lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x656b5daa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460078.543466:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542b76d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x656b5daa bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460078.543547:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac42f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+62:11380:x1875336003384576:12345-192.168.206.5@tcp:36:lhsmtool_posix.0 Request processed in 496us (683us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788460078.543555:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 129 00000100:00100000:1.0:1788460078.549169:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460078.549252:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003384704 00000100:00100000:2.0:1788460078.549262:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003384704 00000100:00100000:2.0:1788460078.549325:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 130 00000100:00100000:2.0:1788460078.549348:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac42fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+62:11380:x1875336003384704:12345-192.168.206.5@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788460078.549367:0:13560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460078.549399:0:13560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b774 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a795 expref: -99 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460078.549434:0:13560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542b77b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460078.549448:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542b77b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460078.549459:0:13560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542b77b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460078.549575:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b774 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a795 expref: 64 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460078.549593:0:13560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542b77b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a795 expref: 63 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460078.549602:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8c4bfa9fec00) 00010000:00010000:2.0:1788460078.549604:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788460078.549608:0:13560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bfadc7e00, rc 0) 00000100:00100000:2.0:1788460078.549823:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac42fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+63:11380:x1875336003384704:12345-192.168.206.5@tcp:101:lhsmtool_posix.0 Request processed in 476us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460078.549829:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 130 00000100:00100000:1.0:1788460078.557031:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460078.557988:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003384960 00000100:00100000:2.0:1788460078.557999:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003384960 00000100:00100000:2.0:1788460078.558063:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 131 00000100:00100000:2.0:1788460078.558088:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac42fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+63:11380:x1875336003384960:12345-192.168.206.5@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788460078.558166:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b782 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460078.558183:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b782 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460078.558193:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b782 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788460078.558348:0:6534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:2.0:1788460078.558373:0:6534:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 375661428068ns, next at 376661425407ns, rc = 0 00000004:00010000:2.0:1788460078.558432:0:6534:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002da8e1ed reply state 00000000f03fa33e transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b782 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460078.558446:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b782 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460078.558454:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8c4bfa9fec00) 00010000:00010000:2.0:1788460078.558457:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788460078.558461:0:6534:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788460078.558566:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac42fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+65:11380:x1875336003384960:12345-192.168.206.5@tcp:36:lhsmtool_posix.0 Request processed in 479us (1542us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1788460078.558574:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 131 00000100:00100000:1.0:1788460078.564222:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460078.564339:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003385088 00000100:00100000:3.0:1788460078.564349:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003385088 00000100:00100000:3.0:1788460078.564416:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 132 00000100:00100000:3.0:1788460078.564442:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac42fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+65:11380:x1875336003385088:12345-192.168.206.5@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788460078.564468:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460078.564488:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542b789 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a79c expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460078.564562:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542b789 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a79c expref: 66 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460078.564575:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542b789 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a79c expref: 66 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460078.564593:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8c4bfa9fec00) 00010000:00010000:3.0:1788460078.564596:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788460078.564600:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bef208400, rc 0) 00000100:00100000:3.0:1788460078.564864:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac42fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+66:11380:x1875336003385088:12345-192.168.206.5@tcp:101:lhsmtool_posix.0 Request processed in 425us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460078.564872:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 132 00000100:00100000:1.0:1788460078.573533:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460078.573629:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003385216 00000100:00100000:2.0:1788460078.573638:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003385216 00000100:00100000:2.0:1788460078.573877:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 45 00000100:00100000:2.0:1788460078.573887:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac42fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+8:2393:x1875336003385216:12345-192.168.206.5@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788460078.574318:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac42fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+9:2393:x1875336003385216:12345-192.168.206.5@tcp:2:lhsmtool_posix.0 Request processed in 431us (803us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788460078.574339:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 45 00000100:00080000:1.0:1788460078.574668:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788460078.585282:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460078.585991:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003385472 00000100:00100000:2.0:1788460078.586002:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003385472 00000100:00100000:2.0:1788460078.586073:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 30 00000100:00100000:2.0:1788460078.586083:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac42ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+66:11380:x1875336003385472:12345-192.168.206.5@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788460078.586428:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac42ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+67:11380:x1875336003385472:12345-192.168.206.5@tcp:35:lhsmtool_posix.0 Request processed in 345us (1154us total) trans 4294967402 rc 0/0 00000100:00100000:2.0:1788460078.586436:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 30 00000100:00100000:3.0:1788460078.605435:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460078.605625:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003385728 00000100:00100000:2.0:1788460078.605635:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003385728 00000100:00100000:2.0:1788460078.605928:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 133 00000100:00100000:2.0:1788460078.605939:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac42f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+67:11380:x1875336003385728:12345-192.168.206.5@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788460078.606069:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac42f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+67:11380:x1875336003385728:12345-192.168.206.5@tcp:57:lhsmtool_posix.0 Request processed in 132us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460078.606077:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 133 00000100:00100000:1.0:1788460078.612482:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460078.612583:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003385856 00000100:00100000:3.0:1788460078.612593:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003385856 00000100:00100000:3.0:1788460078.612649:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 134 00000100:00100000:3.0:1788460078.612664:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac42fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+67:11380:x1875336003385856:12345-192.168.206.5@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788460078.612684:0:7760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460078.612711:0:7760:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209800/0x5dfa74784542b790 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a7a3 expref: -99 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460078.612847:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209400/0x5dfa74784542b797 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460078.612876:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209400/0x5dfa74784542b797 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460078.612888:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209400/0x5dfa74784542b797 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788460078.612930:0:7760:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788460078.612980:0:7760:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209400/0x5dfa74784542b797 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460078.613007:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209800/0x5dfa74784542b790 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a7a3 expref: 69 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460078.613024:0:7760:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209400/0x5dfa74784542b797 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a7a3 expref: 68 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460078.613032:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8c4bfa9fec00) 00010000:00010000:3.0:1788460078.613035:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788460078.613039:0:7760:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bef209400, rc 0) 00000100:00100000:3.0:1788460078.613095:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac42fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+68:11380:x1875336003385856:12345-192.168.206.5@tcp:101:lhsmtool_posix.0 Request processed in 437us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460078.613103:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 134 00000100:00100000:1.0:1788460078.621864:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460078.622215:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003385984 00000100:00100000:3.0:1788460078.622225:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003385984 00000100:00100000:3.0:1788460078.622342:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 46 00000100:00100000:3.0:1788460078.622352:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac42ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+9:2394:x1875336003385984:12345-192.168.206.5@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788460078.622380:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460078.622400:0:8450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d609de44/0x5dfa74784542b79e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a7aa expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788460078.622437:0:8450:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a99bc2d, blocks: 0x0 00010000:00010000:3.0:1788460078.622456:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=375s v=(0 0) 00010000:00010000:3.0:1788460078.622460:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788460078.622469:0:8450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d609de44/0x5dfa74784542b79e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a7aa expref: 10 pid: 8450 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460078.622486:0:8450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d609de44/0x5dfa74784542b79e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a7aa expref: 10 pid: 8450 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460078.622497:0:8450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bef209800, rc 0) 00000100:00100000:3.0:1788460078.623547:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac42ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+10:2394:x1875336003385984:12345-192.168.206.5@tcp:101:lhsmtool_posix.0 Request processed in 1190us (1685us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460078.623557:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 46 00000100:00100000:2.0:1788460078.633395:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460078.633513:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003386240 00000100:00100000:0.0:1788460078.633523:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003386240 00000100:00100000:0.0:1788460078.633598:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 135 00000100:00100000:0.0:1788460078.633607:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+68:11380:x1875336003386240:12345-192.168.206.5@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788460078.633890:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+68:11380:x1875336003386240:12345-192.168.206.5@tcp:57:lhsmtool_posix.0 Request processed in 283us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460078.634521:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 135 00000100:00100000:1.0:1788460078.643818:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460078.647517:0:8832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003386368 00000100:00100000:3.0:1788460078.647533:0:8832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003386368 00000100:00100000:2.0:1788460078.647848:0:8832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 47 00000100:00100000:2.0:1788460078.647859:0:8832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac42fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+10:11380:x1875336003386368:12345-192.168.206.5@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788460078.647878:0:8832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460078.647906:0:8832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000004318ad/0x5dfa74784542b7a5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a7b1 expref: -99 pid: 8832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460078.647941:0:8832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d609de44/0x5dfa74784542b79e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a7aa expref: 11 pid: 8450 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460078.647989:0:8832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788460078.647993:0:8832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788460078.647999:0:8832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000004318ad/0x5dfa74784542b7a5 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a7b1 expref: 11 pid: 8832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460078.648033:0:8832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d609de44/0x5dfa74784542b79e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a7aa expref: 11 pid: 8450 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460078.648045:0:8832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d609de44/0x5dfa74784542b79e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a7aa expref: 11 pid: 8450 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460078.648068:0:8832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac41baa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8832:1875336022335232:192.168.206.5@tcp:104: 00000100:00100000:2.0:1788460078.648187:0:8832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc7e39e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788460078.653461:0:8832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac41baa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8832:1875336022335232:192.168.206.5@tcp:104: 00010000:00010000:2.0:1788460078.653496:0:8832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000004318ad/0x5dfa74784542b7a5 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a7b1 expref: 11 pid: 8832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460078.653514:0:8832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bfadc7c00, rc 0) 00000100:00100000:2.0:1788460078.653571:0:8832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac42fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+11:11380:x1875336003386368:12345-192.168.206.5@tcp:101:lhsmtool_posix.0 Request processed in 5713us (9760us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460078.653579:0:8832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 47 00000100:00100000:3.0:1788460078.654417:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460078.654498:0:9538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003386496 00000100:00100000:1.0:1788460078.654505:0:9538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003386496 00010000:00010000:1.0:1788460078.654537:0:9538:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d609de44/0x5dfa74784542b79e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a7aa expref: 11 pid: 8450 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460078.654576:0:9538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 81 00000100:00100000:1.0:1788460078.654585:0:9538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac42f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+11:2393:x1875336003386496:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788460078.654597:0:9538:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788460078.654627:0:9538:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d609de44/0x5dfa74784542b79e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a7aa expref: 11 pid: 8450 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460078.654640:0:9538:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d609de44/0x5dfa74784542b79e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a7aa expref: 11 pid: 8450 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460078.654676:0:9538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d609de44/0x5dfa74784542b79e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a7aa expref: 11 pid: 8450 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460078.654701:0:9538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460078.654706:0:9538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460078.654714:0:9538:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000004318ad/0x5dfa74784542b7a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a7b1 expref: 10 pid: 8832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460078.654724:0:9538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000004318ad/0x5dfa74784542b7a5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a7b1 expref: 10 pid: 8832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460078.654757:0:9538:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000004318ad/0x5dfa74784542b7a5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a7b1 expref: 10 pid: 8832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460078.654771:0:9538:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac42fdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9538:1875336022335360:192.168.206.5@tcp:105: 00000100:00100000:1.0:1788460078.654842:0:9538:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bfa392600 going to sleep for 11 seconds 00000100:00100000:1.0:1788460078.659971:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460078.660040:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003386624 00000100:00100000:0.0:1788460078.660049:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003386624 00002000:00100000:0.0:1788460078.660107:0:8453:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff8c4ac42ff800 x1875336003386624/t0(0) o4->f8767d3e-bfef-4d3d-8163-ef8ae18a3514@192.168.206.5@tcp:234/0 lens 504/0 e 0 to 0 dl 1788460089 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788460078.660117:0:8453:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c4ac42ff800 with x1875336003386624 ext(0->12) 00002000:00010000:0.0:1788460078.660133:0:8453:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c4ac42ff800 00000100:00100000:0.0:1788460078.660168:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 2 00000100:00100000:0.0:1788460078.660177:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac42ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+11:2393:x1875336003386624:12345-192.168.206.5@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788460078.661467:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac42ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+13:2393:x1875336003386624:12345-192.168.206.5@tcp:4:lhsmtool_posix.0 Request processed in 1285us (1522us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1788460078.661479:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 2 00002000:00100000:0.0:1788460078.661490:0:8453:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff8c4ac42ff800 x1875336003386624/t4294967309(0) o4->f8767d3e-bfef-4d3d-8163-ef8ae18a3514@192.168.206.5@tcp:234/0 lens 504/448 e 0 to 0 dl 1788460089 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788460078.661499:0:8453:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c4ac42ff800 with x1875336003386624 ext(0->12) 00002000:00010000:0.0:1788460078.661504:0:8453:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c4ac42ff800 00000100:00100000:2.0:1788460078.663203:0:9538:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac42fdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9538:1875336022335360:192.168.206.5@tcp:105: 00010000:00010000:2.0:1788460078.663230:0:9538:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788460078.663346:0:9538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac42f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+12:2393:x1875336003386496:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 8761us (8930us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460078.663357:0:9538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 81 00000100:00100000:2.0:1788460078.665518:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460078.665586:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003386752 00000100:00100000:3.0:1788460078.665596:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003386752 00000100:00100000:3.0:1788460078.665665:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 136 00000100:00100000:3.0:1788460078.665673:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+68:11380:x1875336003386752:12345-192.168.206.5@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788460078.667995:0:6513:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:3.0:1788460078.668011:0:6513:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:3.0:1788460078.668037:0:6513:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:3.0:1788460078.668050:0:6513:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8c4bc7e39c00 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1788460078.668060:0:6513:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8c4ac3b96600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8c4bc7e390c0 00000020:00080000:3.0:1788460078.668073:0:6513:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8c4ac3b96500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8c4bedd9da00 00000004:00080000:3.0:1788460078.668098:0:6513:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00010000:00010000:0.0:1788460078.668235:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841800/0x5dfa74784542b4aa lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.668247:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841800/0x5dfa74784542b4aa lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.668267:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841800/0x5dfa74784542b4aa lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.668273:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac2841800 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460078.668278:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841800/0x5dfa74784542b4aa lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.668286:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841800/0x5dfa74784542b4aa lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.668300:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8c4bef200000) 00010000:00010000:0.0:1788460078.668303:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460078.668308:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841800/0x5dfa74784542b4aa lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.668314:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841800/0x5dfa74784542b4aa lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.668340:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841c00/0x5dfa74784542b552 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.668346:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841c00/0x5dfa74784542b552 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.668352:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841c00/0x5dfa74784542b552 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.668357:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac2841c00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460078.668360:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841c00/0x5dfa74784542b552 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.668376:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841c00/0x5dfa74784542b552 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.668385:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8c4bfa9fe600) 00010000:00010000:0.0:1788460078.668387:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460078.668390:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841c00/0x5dfa74784542b552 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.668395:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2841c00/0x5dfa74784542b552 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.668411:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840400/0x5dfa74784542b5d0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.668417:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840400/0x5dfa74784542b5d0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.668423:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840400/0x5dfa74784542b5d0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.668430:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac2840400 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460078.668433:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840400/0x5dfa74784542b5d0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.668438:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840400/0x5dfa74784542b5d0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.668446:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8c4bef1fe300) 00010000:00010000:0.0:1788460078.668448:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460078.668451:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840400/0x5dfa74784542b5d0 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.668463:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac2840400/0x5dfa74784542b5d0 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.668475:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b5f3 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.668481:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b5f3 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.668487:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b5f3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.668493:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bfadc7200 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460078.668496:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b5f3 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.668502:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b5f3 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.668509:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8c4bef1fe300) 00010000:00010000:0.0:1788460078.668512:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460078.668515:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b5f3 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.668520:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b5f3 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.668534:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6800/0x5dfa74784542b6c5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.668540:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6800/0x5dfa74784542b6c5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.668552:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6800/0x5dfa74784542b6c5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.668558:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bfadc6800 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460078.668561:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6800/0x5dfa74784542b6c5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.668567:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6800/0x5dfa74784542b6c5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.668575:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8c4bfa9fe700) 00010000:00010000:0.0:1788460078.668577:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460078.668581:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6800/0x5dfa74784542b6c5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.668586:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6800/0x5dfa74784542b6c5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.668598:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b782 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.668604:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b782 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.668621:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b782 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.668627:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bfadc7600 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460078.668630:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b782 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.668646:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b782 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.668655:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8c4bfa9fec00) 00010000:00010000:0.0:1788460078.668657:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788460078.668660:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b782 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.668666:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b782 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460078.668846:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788460078.668862:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4364000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022335744:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788460078.668923:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460078.668997:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4364380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022335488:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788460078.669022:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460078.669041:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788460078.669046:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4367b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022335616:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788460078.669066:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460078.669093:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022335744 00000100:00100000:0.0:1788460078.669100:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022335744 00000020:00080000:3.0:1788460078.669330:0:6513:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8c4ac286c9c0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:3.0:1788460078.669335:0:6513:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8c4ac25cdc00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8c4ac286ca80 00000020:00080000:3.0:1788460078.669338:0:6513:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8c4ac25cd100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8c4ac36f4600 00000020:00080000:3.0:1788460078.669364:0:6565:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:3.0:1788460078.669413:0:6565:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1788460078.669532:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022335488 00000100:00100000:0.0:1788460078.669536:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022335488 00000100:00100000:0.0:1788460078.669549:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022335616 00000100:00100000:0.0:1788460078.669552:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022335616 00000100:00100000:0.0:1788460078.669563:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788460078.669570:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4365c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3660:x1875336022335744:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788460078.669592:0:8449:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00002000:00010000:0.0:1788460078.669640:0:8449:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a99bc2b, atime: 0x6a99bc2c, ctime: 0x6a99bc2b, blocks: 0x8 00010000:00010000:0.0:1788460078.669647:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f19e6968/0x5dfa74784542b7ac lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.669661:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=375s v=(0 0) 00010000:00010000:0.0:1788460078.669665:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460078.669670:0:8449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f19e6968/0x5dfa74784542b7ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.669684:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f19e6968/0x5dfa74784542b7ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.669704:0:8449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f19e6968/0x5dfa74784542b7ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.669711:0:8449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f19e6968/0x5dfa74784542b7ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.669729:0:8449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788460078.669829:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4365c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3660:x1875336022335744:12345-0@lo:6:osp-syn-1-0.0 Request processed in 259us (906us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1788460078.669836:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788460078.669852:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788460078.669859:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4367800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3661:x1875336022335488:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788460078.669870:0:8449:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00010000:00010000:0.0:1788460078.669896:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc96185f/0x5dfa74784542b7b3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.669920:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c2354787/0x5dfa74784542b560 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a709 expref: 11 pid: 8832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.669928:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1788460078.669931:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788460078.669934:0:8449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc96185f/0x5dfa74784542b7b3 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.669983:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c2354787/0x5dfa74784542b560 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a709 expref: 11 pid: 8832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.669997:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c2354787/0x5dfa74784542b560 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a709 expref: 11 pid: 8832 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460078.670008:0:8449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4364e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1875336022335872:192.168.206.5@tcp:104: 00000100:00100000:3.0:1788460078.670490:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+16:11380:x1875336003386752:12345-192.168.206.5@tcp:44:lhsmtool_posix.0 Request processed in 4814us (4976us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460078.670499:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 136 00000100:00100000:0.0:1788460078.670576:0:8449:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc65d7e40 going to sleep for 11 seconds 00010000:00010000:0.0:1788460078.670591:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788460078.670598:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f19e6968/0x5dfa74784542b7ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.670616:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc2bd5800 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:0.0:1788460078.670620:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f19e6968/0x5dfa74784542b7ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.670629:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f19e6968/0x5dfa74784542b7ac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.670652:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f19e6968/0x5dfa74784542b7ac lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.670661:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f19e6968/0x5dfa74784542b7ac lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.670677:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460078.670679:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460078.670680:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788460078.670725:0:3660:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8c4ac4364000/2, rc 0, transno 4294967305 00000100:00100000:0.0:1788460078.670731:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4364000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022335744:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788460078.670751:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788460078.670760:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4365f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3661:x1875336022335616:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1788460078.670839:0:8450:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788460078.670843:0:8450:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788460077 00002000:00010000:0.0:1788460078.670845:0:8450:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788460078.670846:0:8450:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1788460077 -> 1788460077 00002000:00010000:0.0:1788460078.670849:0:8450:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1788460078.670912:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4365f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3661:x1875336022335616:12345-0@lo:2:osp-syn-0-0.0 Request processed in 153us (1844us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788460078.670919:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000004:00080000:3.0:1788460078.671521:0:3661:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8c4ac4367b80/2, rc 0, transno 4294967310 00000100:00100000:3.0:1788460078.671529:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4367b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022335616:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788460078.675736:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460078.675842:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460078.675933:0:8449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4364e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1875336022335872:192.168.206.5@tcp:104: 00010000:00010000:3.0:1788460078.675987:0:8449:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000cc96185f/0x5dfa74784542b7b3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460078.676488:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003387008 00000100:00100000:2.0:1788460078.676495:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003387008 00010000:00010000:2.0:1788460078.676527:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c2354787/0x5dfa74784542b560 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a709 expref: 12 pid: 8832 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460078.676564:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 82 00000100:00100000:2.0:1788460078.676572:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bedf6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+12:2394:x1875336003387008:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788460078.676584:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460078.676589:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c2354787/0x5dfa74784542b560 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a709 expref: 12 pid: 8832 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460078.676602:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c2354787/0x5dfa74784542b560 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a709 expref: 12 pid: 8832 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460078.676696:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2354787/0x5dfa74784542b560 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a709 expref: 12 pid: 8832 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460078.676712:0:6519:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788460078.676716:0:6519:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788460078.676722:0:6519:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cc96185f/0x5dfa74784542b7b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460078.676731:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc96185f/0x5dfa74784542b7b3 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460078.676840:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788460078.676896:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bedf6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+11:2394:x1875336003387008:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 319us (1049us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460078.676904:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 82 00000100:00100000:0.0:1788460078.677917:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003386880 00000100:00100000:0.0:1788460078.677926:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003386880 00000100:00100000:0.0:1788460078.677984:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 51 00000100:00100000:0.0:1788460078.677992:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfaf6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+11:2394:x1875336003386880:12345-192.168.206.5@tcp:16:lhsmtool_posix.0 00010000:00010000:3.0:1788460078.680257:0:8449:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000cc96185f/0x5dfa74784542b7b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460078.680277:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc96185f/0x5dfa74784542b7b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460078.680291:0:8449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc96185f/0x5dfa74784542b7b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460078.680317:0:8449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cc96185f/0x5dfa74784542b7b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460078.680382:0:8449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788460078.680575:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4367800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3661:x1875336022335488:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10713us (11548us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1788460078.680586:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000004:00080000:3.0:1788460078.682526:0:3661:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8c4ac4364380/2, rc 0, transno 4294967311 00000100:00100000:3.0:1788460078.682539:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4364380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022335488:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1788460078.682678:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788460078.682697:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cc96185f/0x5dfa74784542b7b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460078.682709:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc2bd4a00 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:1.0:1788460078.682714:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc96185f/0x5dfa74784542b7b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460078.682748:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc96185f/0x5dfa74784542b7b3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460078.682767:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cc96185f/0x5dfa74784542b7b3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460078.682774:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc96185f/0x5dfa74784542b7b3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460078.682793:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460078.682795:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460078.682797:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788460078.683084:0:8443:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:0.0:1788460078.683093:0:8443:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:3.0:1788460078.683299:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfaf6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:2394:x1875336003386880:12345-192.168.206.5@tcp:16:lhsmtool_posix.0 Request processed in 5305us (7567us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460078.683309:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 51 00000100:00100000:1.0:1788460078.692386:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460078.692474:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003387264 00000100:00100000:2.0:1788460078.692484:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003387264 00000100:00100000:2.0:1788460078.692541:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 137 00000100:00100000:2.0:1788460078.692551:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac42fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+16:11380:x1875336003387264:12345-192.168.206.5@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788460078.692604:0:6533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460078.692640:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209400/0x5dfa74784542b797 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a7a3 expref: 16 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460078.692657:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8c4bfa9fec00) 00010000:00010000:2.0:1788460078.692662:0:6533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788460078.692701:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542b7ba lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460078.692715:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542b7ba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460078.692724:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542b7ba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788460078.692849:0:6533:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c69e7ced reply state 00000000f803f4e6 transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542b7ba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460078.692862:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542b7ba lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460078.692870:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8c4bfa9fec00) 00010000:00010000:2.0:1788460078.692872:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788460078.692875:0:6533:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788460078.693207:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac42fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+17:11380:x1875336003387264:12345-192.168.206.5@tcp:36:lhsmtool_posix.0 Request processed in 657us (828us total) trans 4294967403 rc 0/0 00000100:00100000:2.0:1788460078.693215:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 137 00000100:00100000:1.0:1788460078.695800:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460078.696460:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003387392 00000100:00100000:2.0:1788460078.696470:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003387392 00000100:00100000:2.0:1788460078.696521:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 52 00000100:00100000:2.0:1788460078.696530:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac42ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:2395:x1875336003387392:12345-192.168.206.5@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788460078.696675:0:8448:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1788460078.696679:0:8448:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 1788460077 -> 1788460076 00002000:00010000:2.0:1788460078.696681:0:8448:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788460076 00002000:00010000:2.0:1788460078.696683:0:8448:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1788460077 -> 1788460076 00002000:00010000:2.0:1788460078.696685:0:8448:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1788460078.696751:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac42ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+7:2395:x1875336003387392:12345-192.168.206.5@tcp:2:lhsmtool_posix.0 Request processed in 221us (959us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1788460078.696759:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 52 00000100:00100000:1.0:1788460078.702540:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460078.702623:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003387648 00000100:00100000:0.0:1788460078.702633:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003387648 00000100:00100000:0.0:1788460078.702707:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 138 00000100:00100000:0.0:1788460078.702716:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac42fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+17:11380:x1875336003387648:12345-192.168.206.5@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788460078.702778:0:13560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5600/0x5dfa74784542b7c1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.702796:0:13560:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542b77b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a795 expref: 17 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.702807:0:13560:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5600/0x5dfa74784542b7c1 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.702841:0:13560:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542b77b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a795 expref: 17 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.702853:0:13560:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542b77b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a795 expref: 17 pid: 13560 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460078.702866:0:13560:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4366a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13560:1875336022336000:192.168.206.5@tcp:104: 00000100:00100000:0.0:1788460078.702978:0:13560:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc65d7cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788460078.706148:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460078.706529:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003387776 00000100:00100000:2.0:1788460078.706539:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003387776 00010000:00010000:2.0:1788460078.706577:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542b77b lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a795 expref: 18 pid: 13560 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460078.706632:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 83 00000100:00100000:2.0:1788460078.706643:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac42fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+18:2393:x1875336003387776:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788460078.706658:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460078.706666:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542b77b lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a795 expref: 18 pid: 13560 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460078.706678:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542b77b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a795 expref: 18 pid: 13560 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460078.706717:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8c4bfa9fec00) 00010000:00010000:2.0:1788460078.706722:0:6518:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5600/0x5dfa74784542b7c1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460078.706732:0:6518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5600/0x5dfa74784542b7c1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460078.706740:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5600/0x5dfa74784542b7c1 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460078.706759:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788460078.706810:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac42fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+18:2393:x1875336003387776:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 168us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460078.706818:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 83 00010000:00010000:0.0:1788460078.708130:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542b77b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a795 expref: 17 pid: 13560 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460078.708149:0:13560:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4366a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13560:1875336022336000:192.168.206.5@tcp:104: 00010000:00010000:0.0:1788460078.708182:0:13560:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5600/0x5dfa74784542b7c1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.708191:0:13560:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5600/0x5dfa74784542b7c1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.708196:0:13560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5600/0x5dfa74784542b7c1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.708235:0:13560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5600/0x5dfa74784542b7c1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.708242:0:13560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5600/0x5dfa74784542b7c1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.708250:0:13560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5600/0x5dfa74784542b7c1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.708255:0:13560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc2bd5600 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460078.708259:0:13560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5600/0x5dfa74784542b7c1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.708267:0:13560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5600/0x5dfa74784542b7c1 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.708280:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8c4bfa9fec00) 00010000:00010000:0.0:1788460078.708283:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788460078.708287:0:13560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5600/0x5dfa74784542b7c1 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.708293:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5600/0x5dfa74784542b7c1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460078.708475:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac42fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+16:11380:x1875336003387648:12345-192.168.206.5@tcp:55:lhsmtool_posix.0 Request processed in 5760us (5942us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788460078.708484:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 138 00000100:00100000:1.0:1788460078.713998:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460078.714110:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003387904 00000100:00100000:2.0:1788460078.714119:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003387904 00000100:00100000:2.0:1788460078.714180:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 53 00000100:00100000:2.0:1788460078.714189:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac42fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+7:2394:x1875336003387904:12345-192.168.206.5@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788460078.714244:0:8449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000504a61f/0x5dfa74784542b7c8 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460078.714264:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000004318ad/0x5dfa74784542b7a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a7b1 expref: 7 pid: 8832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460078.714272:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788460078.714276:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788460078.714281:0:8449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000504a61f/0x5dfa74784542b7c8 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460078.714316:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000004318ad/0x5dfa74784542b7a5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a7b1 expref: 7 pid: 8832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460078.714331:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000004318ad/0x5dfa74784542b7a5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a7b1 expref: 7 pid: 8832 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460078.714344:0:8449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac41b9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1875336022336128:192.168.206.5@tcp:104: 00000100:00100000:2.0:1788460078.714423:0:8449:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc7e39180 going to sleep for 11 seconds 00000100:00100000:0.0:1788460078.720191:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460078.720336:0:9538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003388032 00000100:00100000:1.0:1788460078.720345:0:9538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003388032 00000100:00100000:2.0:1788460078.720363:0:8449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac41b9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1875336022336128:192.168.206.5@tcp:104: 00010000:00010000:1.0:1788460078.720378:0:9538:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000004318ad/0x5dfa74784542b7a5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a7b1 expref: 8 pid: 8832 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460078.720384:0:8449:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000504a61f/0x5dfa74784542b7c8 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460078.720429:0:9538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 84 00000100:00100000:1.0:1788460078.720439:0:9538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4366a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+8:2393:x1875336003388032:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788460078.720451:0:9538:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788460078.720485:0:9538:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000004318ad/0x5dfa74784542b7a5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a7b1 expref: 8 pid: 8832 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460078.720497:0:9538:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000004318ad/0x5dfa74784542b7a5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a7b1 expref: 8 pid: 8832 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460078.720518:0:9538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000004318ad/0x5dfa74784542b7a5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a7b1 expref: 8 pid: 8832 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460078.720532:0:9538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788460078.720536:0:9538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788460078.720541:0:9538:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000504a61f/0x5dfa74784542b7c8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460078.720551:0:9538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000504a61f/0x5dfa74784542b7c8 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460078.720581:0:9538:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788460078.720636:0:9538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4366a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+7:2393:x1875336003388032:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 198us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460078.720643:0:9538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 84 00010000:00010000:2.0:1788460078.722742:0:8449:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000504a61f/0x5dfa74784542b7c8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460078.722782:0:8449:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000504a61f/0x5dfa74784542b7c8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460078.722810:0:8449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000000504a61f/0x5dfa74784542b7c8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460078.722818:0:8449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000504a61f/0x5dfa74784542b7c8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460078.722825:0:8449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000504a61f/0x5dfa74784542b7c8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460078.722832:0:8449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bfadc7600 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:2.0:1788460078.722835:0:8449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000504a61f/0x5dfa74784542b7c8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460078.722843:0:8449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000504a61f/0x5dfa74784542b7c8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460078.722862:0:8449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000504a61f/0x5dfa74784542b7c8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460078.722870:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000504a61f/0x5dfa74784542b7c8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460078.723034:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac42fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:2394:x1875336003387904:12345-192.168.206.5@tcp:1:lhsmtool_posix.0 Request processed in 8842us (9040us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460078.723044:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 53 00000100:00100000:1.0:1788460078.728388:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460078.728711:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003388288 00000100:00100000:3.0:1788460078.728721:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003388288 00000100:00100000:3.0:1788460078.728777:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 139 00000100:00100000:3.0:1788460078.728786:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4286d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+16:11380:x1875336003388288:12345-192.168.206.5@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788460078.728871:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208c00/0x5dfa74784542b7cf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460078.728897:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208200/0x5dfa74784542b6be lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a75d expref: 16 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460078.728908:0:6535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208c00/0x5dfa74784542b7cf lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460078.728940:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208200/0x5dfa74784542b6be lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a75d expref: 16 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460078.728982:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208200/0x5dfa74784542b6be lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a75d expref: 16 pid: 6533 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460078.729009:0:6535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac42f3100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6535:1875336022336256:192.168.206.5@tcp:104: 00000100:00100000:3.0:1788460078.729075:0:6535:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac286c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788460078.738194:0:6535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac42f3100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6535:1875336022336256:192.168.206.5@tcp:104: 00010000:00010000:0.0:1788460078.738225:0:6535:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208c00/0x5dfa74784542b7cf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460078.738937:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460078.739047:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003388416 00000100:00100000:2.0:1788460078.739055:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003388416 00010000:00010000:2.0:1788460078.739093:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208200/0x5dfa74784542b6be lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a75d expref: 17 pid: 6533 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460078.739138:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 85 00000100:00100000:2.0:1788460078.739148:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4285500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+17:2394:x1875336003388416:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788460078.739161:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460078.739167:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208200/0x5dfa74784542b6be lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a75d expref: 17 pid: 6533 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460078.739189:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208200/0x5dfa74784542b6be lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a75d expref: 17 pid: 6533 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460078.739210:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208200/0x5dfa74784542b6be lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a75d expref: 17 pid: 6533 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460078.739225:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8c4bfa9fe700) 00010000:00010000:2.0:1788460078.739240:0:6519:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209e00/0x5dfa74784542b720 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a780 expref: 16 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460078.739250:0:6519:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208c00/0x5dfa74784542b7cf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460078.739270:0:6519:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208c00/0x5dfa74784542b7cf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460078.739278:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208c00/0x5dfa74784542b7cf lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460078.739308:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788460078.739364:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4285500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+16:2394:x1875336003388416:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 218us (430us total) trans 0 rc 0/0 00010000:00010000:3.0:1788460078.739368:0:6535:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208c00/0x5dfa74784542b7cf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460078.739372:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 85 00010000:00010000:3.0:1788460078.739376:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208c00/0x5dfa74784542b7cf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460078.739531:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209400/0x5dfa74784542b7d6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460078.739542:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542b789 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a79c expref: 16 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460078.739551:0:6535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209400/0x5dfa74784542b7d6 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460078.739579:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542b789 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a79c expref: 16 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460078.739591:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542b789 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a79c expref: 16 pid: 6533 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460078.739605:0:6535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac42f0380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6535:1875336022336384:192.168.206.5@tcp:104: 00000100:00100000:3.0:1788460078.739685:0:6535:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac286cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788460078.745473:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460078.745568:0:6535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac42f0380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6535:1875336022336384:192.168.206.5@tcp:104: 00010000:00010000:3.0:1788460078.745597:0:6535:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209400/0x5dfa74784542b7d6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460078.745756:0:9549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003388544 00000100:00100000:0.0:1788460078.745763:0:9549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003388544 00010000:00010000:0.0:1788460078.745797:0:9549:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542b789 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a79c expref: 17 pid: 6533 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460078.745837:0:9549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 86 00000100:00100000:0.0:1788460078.745846:0:9549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4285880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+17:2393:x1875336003388544:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788460078.745861:0:9549:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788460078.745869:0:9549:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542b789 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a79c expref: 17 pid: 6533 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.745881:0:9549:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542b789 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a79c expref: 17 pid: 6533 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.745915:0:9549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542b789 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a79c expref: 17 pid: 6533 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.745931:0:9549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8c4bfa9fec00) 00010000:00010000:0.0:1788460078.745975:0:9549:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209400/0x5dfa74784542b7d6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.745986:0:9549:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209400/0x5dfa74784542b7d6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.745993:0:9549:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209400/0x5dfa74784542b7d6 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.746022:0:9549:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788460078.746084:0:9549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4285880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+16:2393:x1875336003388544:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 238us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460078.746091:0:9549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 86 00010000:00010000:3.0:1788460078.746362:0:6535:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209400/0x5dfa74784542b7d6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460078.746371:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209400/0x5dfa74784542b7d6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788460078.746491:0:6535:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:3.0:1788460078.746620:0:6535:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:3.0:1788460078.746656:0:6535:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:3.0:1788460078.746740:0:6535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac42f0380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6535:1875336022336512:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788460078.746785:0:6535:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460078.746822:0:6535:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac286c900 going to sleep for 11 seconds 00000100:00100000:1.0:1788460078.747097:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022336512 00000100:00100000:1.0:1788460078.747104:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022336512 00000100:00100000:1.0:1788460078.747144:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788460078.747152:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac42f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6535:x1875336022336512:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788460078.747259:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac42f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6535:x1875336022336512:12345-0@lo:1000:mdt00_002.0 Request processed in 105us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460078.747267:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788460078.748347:0:6535:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1788460078.748356:0:6535:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967310 00000004:00080000:3.0:1788460078.748373:0:6535:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8c4ac4367b80, transno 4294967310 00000100:00100000:3.0:1788460078.748390:0:6535:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8c4ac4364380 x1875336022335488/t4294967311(4294967311) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788460094 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460078.748402:0:6535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac42f0380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6535:1875336022336512:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1788460078.748530:0:6535:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:3.0:1788460078.748591:0:6535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac42f0380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6535:1875336022336640:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788460078.748649:0:6535:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460078.748681:0:6535:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac286c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788460078.748757:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022336640 00000100:00100000:0.0:1788460078.748764:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022336640 00000100:00100000:0.0:1788460078.748806:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788460078.748813:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac42f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6535:x1875336022336640:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788460078.748935:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac42f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6535:x1875336022336640:12345-0@lo:1000:mdt00_002.0 Request processed in 121us (285us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1788460078.748961:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788460078.749684:0:6535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac42f0380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6535:1875336022336640:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1788460078.749738:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209400/0x5dfa74784542b7d6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460078.749748:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209400/0x5dfa74784542b7d6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460078.749767:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209400/0x5dfa74784542b7d6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460078.749773:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bef209400 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:3.0:1788460078.749778:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209400/0x5dfa74784542b7d6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460078.749785:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209400/0x5dfa74784542b7d6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460078.749799:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8c4bfa9fec00) 00010000:00010000:3.0:1788460078.749802:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788460078.749806:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209400/0x5dfa74784542b7d6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460078.749812:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209400/0x5dfa74784542b7d6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460078.749834:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542b719 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460078.749840:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542b719 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460078.749845:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542b719 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460078.749849:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc2bd4e00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:3.0:1788460078.749851:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542b719 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460078.749865:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542b719 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460078.749874:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8c4bfa9fe700) 00010000:00010000:3.0:1788460078.749876:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788460078.750082:0:6535:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209e00/0x5dfa74784542b720 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a780 expref: 19 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460078.750154:0:6535:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209e00/0x5dfa74784542b720 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a780 expref: 19 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460078.750165:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209e00/0x5dfa74784542b720 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a780 expref: 19 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.750253:0:6535:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209e00/0x5dfa74784542b720 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a780 expref: 19 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460078.750266:0:6535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4364700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6535:1875336022336768:192.168.206.5@tcp:105: 00000100:00100000:0.0:1788460078.750343:0:6535:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc65d7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788460078.761411:0:6535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4364700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6535:1875336022336768:192.168.206.5@tcp:105: 00010000:00010000:0.0:1788460078.761443:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542b719 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.761470:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542b719 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.761499:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b7dd lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.761513:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b7dd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.761523:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b7dd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.761533:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b7dd lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.761539:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b7dd lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.761544:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b7dd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.761549:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc2bd4200 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460078.761553:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b7dd lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.761559:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b7dd lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.761568:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8c4bfa9fe700) 00010000:00010000:0.0:1788460078.761571:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460078.761574:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b7dd lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.761587:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b7dd lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.761597:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208c00/0x5dfa74784542b7cf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.761603:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208c00/0x5dfa74784542b7cf lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.761609:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208c00/0x5dfa74784542b7cf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.761623:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bef208c00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460078.761627:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208c00/0x5dfa74784542b7cf lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.761632:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208c00/0x5dfa74784542b7cf lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.761641:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8c4bfa9fe700) 00010000:00010000:0.0:1788460078.761643:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788460078.761645:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208c00/0x5dfa74784542b7cf lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.761650:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208c00/0x5dfa74784542b7cf lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460078.761821:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4286d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+19:11380:x1875336003388288:12345-192.168.206.5@tcp:57:lhsmtool_posix.0 Request processed in 33034us (33439us total) trans 4294967408 rc 0/0 00000100:00100000:0.0:1788460078.761832:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 139 00000020:00080000:0.0:1788460078.761845:0:6535:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788460078.762059:0:13811:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788460078.762064:0:13811:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788460078.762534:0:13811:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1788460078.762544:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788460078.763323:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460078.763571:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003388672 00000100:00100000:0.0:1788460078.763581:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003388672 00000100:00100000:0.0:1788460078.763639:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 31 00000100:00100000:0.0:1788460078.763648:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+19:11379:x1875336003388672:12345-192.168.206.5@tcp:49:lfs.0 00000100:00100000:0.0:1788460078.763766:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+19:11379:x1875336003388672:12345-192.168.206.5@tcp:49:lfs.0 Request processed in 119us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460078.763774:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 31 00000100:00100000:2.0:1788460078.767806:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460078.767907:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003388928 00000100:00100000:1.0:1788460078.767916:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003388928 00000100:00100000:1.0:1788460078.768006:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 140 00000100:00100000:1.0:1788460078.768016:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+19:11379:x1875336003388928:12345-192.168.206.5@tcp:58:lfs.0 00000040:00080000:1.0:1788460078.768179:0:6534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1788460078.768260:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+19:11379:x1875336003388928:12345-192.168.206.5@tcp:58:lfs.0 Request processed in 246us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460078.768269:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 140 00000100:00100000:1.0:1788460078.773539:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460078.773635:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003389184 00000100:00100000:0.0:1788460078.773644:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003389184 00000100:00100000:0.0:1788460078.773710:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 32 00000100:00100000:0.0:1788460078.773720:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc6be1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+19:11380:x1875336003389184:12345-192.168.206.5@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788460078.773997:0:6537:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788460078.774028:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:0.0:1788460078.774068:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b7e4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.774085:0:6537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b7e4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.774096:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b7e4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.774105:0:6537:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b7e4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.774112:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b7e4 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.774118:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b7e4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.774145:0:6537:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788460078.774240:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc6be1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+21:11380:x1875336003389184:12345-192.168.206.5@tcp:35:lhsmtool_posix.0 Request processed in 521us (708us total) trans 4294967410 rc 0/0 00000100:00100000:0.0:1788460078.774248:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 32 00000020:00080000:0.0:1788460078.774253:0:6537:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788460078.774820:0:9536:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788460078.774828:0:9536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b7e4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460078.774835:0:9536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc2bd4200 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:1.0:1788460078.774838:0:9536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b7e4 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460078.774845:0:9536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b7e4 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460078.774857:0:9536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8c4bfa9fec00) 00010000:00010000:1.0:1788460078.774867:0:9536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788460078.774872:0:9536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b7e4 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460078.774878:0:9536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b7e4 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460078.774890:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460078.774891:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460078.774893:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788460078.800184:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460078.800262:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003389312 00000100:00100000:0.0:1788460078.800271:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003389312 00000100:00100000:0.0:1788460078.800329:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 141 00000100:00100000:0.0:1788460078.800339:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+21:11382:x1875336003389312:12345-192.168.206.5@tcp:101:lfs.0 00010000:00010000:0.0:1788460078.800363:0:13560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460078.800382:0:13560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542b7eb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a7b8 expref: -99 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.800439:0:13560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542b7f2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.800453:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542b7f2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.800464:0:13560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542b7f2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.800478:0:13560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4000/0x5dfa74784542b7f9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.800485:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4000/0x5dfa74784542b7f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.800492:0:13560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4000/0x5dfa74784542b7f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.800579:0:13560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5e00/0x5dfa74784542b800 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.800590:0:13560:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b70b lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a779 expref: 22 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.800599:0:13560:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5e00/0x5dfa74784542b800 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.800645:0:13560:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b70b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a779 expref: 22 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.800658:0:13560:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b70b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a779 expref: 22 pid: 7760 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460078.800671:0:13560:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4364700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13560:1875336022336896:192.168.206.5@tcp:104: 00000100:00100000:0.0:1788460078.800856:0:13560:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc65d76c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788460078.804304:0:13560:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4364700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13560:1875336022336896:192.168.206.5@tcp:104: 00010000:00010000:0.0:1788460078.804331:0:13560:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5e00/0x5dfa74784542b800 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460078.806668:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460078.807058:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003389568 00000100:00100000:0.0:1788460078.807069:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003389568 00000100:00100000:0.0:1788460078.807128:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 33 00000100:00100000:0.0:1788460078.807138:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+23:6160:x1875336003389568:12345-192.168.206.5@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788460078.807340:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+24:6160:x1875336003389568:12345-192.168.206.5@tcp:35:ldlm_bl.0 Request processed in 203us (679us total) trans 4294967411 rc 0/0 00000100:00100000:0.0:1788460078.807360:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 33 00000100:00100000:3.0:1788460078.810851:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460078.811448:0:9538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003389696 00000100:00100000:1.0:1788460078.811459:0:9538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003389696 00010000:00010000:1.0:1788460078.811495:0:9538:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b70b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a779 expref: 24 pid: 7760 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460078.811540:0:9538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 87 00000100:00100000:1.0:1788460078.811549:0:9538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac42f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+24:2393:x1875336003389696:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788460078.811563:0:9538:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788460078.811569:0:9538:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b70b lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a779 expref: 24 pid: 7760 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460078.811582:0:9538:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b70b lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a779 expref: 24 pid: 7760 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460078.811602:0:9538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b70b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a779 expref: 24 pid: 7760 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460078.811616:0:9538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8c4bfa9fe700) 00010000:00010000:1.0:1788460078.811622:0:9538:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5e00/0x5dfa74784542b800 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460078.811644:0:9538:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5e00/0x5dfa74784542b800 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460078.811652:0:9538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5e00/0x5dfa74784542b800 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460078.811683:0:9538:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788460078.811743:0:13560:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5e00/0x5dfa74784542b800 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460078.811749:0:9538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac42f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+23:2393:x1875336003389696:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 199us (906us total) trans 0 rc 0/0 00010000:00010000:0.0:1788460078.811760:0:13560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5e00/0x5dfa74784542b800 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460078.811764:0:9538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 87 00000004:00200000:0.0:1788460078.811813:0:13560:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788460078.811818:0:13560:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788460078.811837:0:13560:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5e00/0x5dfa74784542b800 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.811850:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5e00/0x5dfa74784542b800 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.811860:0:13560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542b7f2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.811868:0:13560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542b7f2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.811875:0:13560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542b7f2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.811880:0:13560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc2bd4c00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460078.811885:0:13560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542b7f2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.811892:0:13560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542b7f2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.811903:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8c4bc2ab7100) 00010000:00010000:0.0:1788460078.811913:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460078.811918:0:13560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542b7f2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.811925:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542b7f2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.811938:0:13560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4000/0x5dfa74784542b7f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.811977:0:13560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4000/0x5dfa74784542b7f9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.811983:0:13560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4000/0x5dfa74784542b7f9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.811988:0:13560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc2bd4000 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460078.811991:0:13560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4000/0x5dfa74784542b7f9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.811997:0:13560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4000/0x5dfa74784542b7f9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.812006:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8c4bc5dc1b00) 00010000:00010000:0.0:1788460078.812008:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460078.812012:0:13560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4000/0x5dfa74784542b7f9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.812017:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4000/0x5dfa74784542b7f9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.812063:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542b7eb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a7b8 expref: 23 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.812094:0:13560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5e00/0x5dfa74784542b800 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a7b8 expref: 22 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460078.812102:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8c4bfa9fe700) 00010000:00010000:0.0:1788460078.812105:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788460078.812107:0:13560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc2bd5e00, rc 0) 00000100:00100000:0.0:1788460078.812136:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+22:11382:x1875336003389312:12345-192.168.206.5@tcp:101:lfs.0 Request processed in 11799us (11960us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460078.812143:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 141 00010000:00010000:1.0:1788460078.865529:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788460079.185270:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788460079.185290:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4364700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022337024:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788460079.185355:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460079.185442:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022337024 00000100:00100000:2.0:1788460079.185449:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022337024 00000100:00100000:2.0:1788460079.185499:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788460079.185508:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4366680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022337024:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788460079.185544:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446453248 avail 1300213760 00000100:00100000:2.0:1788460079.185586:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4366680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022337024:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460079.185593:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788460079.187140:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4364700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022337024:0@lo:41:osp-pre-1-0.0 00000040:00080000:0.0:1788460079.594273:0:14328:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788460079.594351:0:14328:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788460079.594398:0:14328:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788460079.594407:0:14328:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788460079.700612:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788460079.700633:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4364700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022337152:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788460079.700704:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460079.700766:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022337152 00000100:00100000:0.0:1788460079.700773:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022337152 00000100:00100000:0.0:1788460079.700826:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788460079.700834:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4366300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3662:x1875336022337152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788460079.700861:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 28672 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788460079.700928:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4366300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3662:x1875336022337152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460079.700936:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:0.0:1788460079.700996:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788460079.701096:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4366d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1875336022337408:0@lo:400:kworker.0 00000100:00100000:0.0:1788460079.701124:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460079.701144:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4365180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1875336022337920:0@lo:400:kworker.0 00000100:00100000:0.0:1788460079.701164:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460079.701184:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4365f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1875336022338432:0@lo:400:kworker.0 00000100:00100000:0.0:1788460079.701203:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460079.701229:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788460079.701235:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4365500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022337536:0@lo:400:kworker.0 00000100:00100000:0.0:1788460079.701271:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460079.701293:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4367100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022338048:0@lo:400:kworker.0 00000100:00100000:0.0:1788460079.701317:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460079.701333:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4367800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022338560:0@lo:400:kworker.0 00000100:00100000:0.0:1788460079.701352:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460079.701560:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022337408 00000100:00100000:0.0:1788460079.701565:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022337408 00000100:00100000:0.0:1788460079.701595:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022337920 00000100:00100000:0.0:1788460079.701598:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022337920 00000100:00100000:0.0:1788460079.701634:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022338432 00000100:00100000:0.0:1788460079.701637:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022338432 00000100:00100000:0.0:1788460079.701651:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1788460079.701657:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4364e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1875336022337408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460079.701709:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4364e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1875336022337408:12345-0@lo:400:kworker.0 Request processed in 51us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460079.701724:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1788460079.701739:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1788460079.701745:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3bd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1875336022337920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460079.701780:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3bd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1875336022337920:12345-0@lo:400:kworker.0 Request processed in 35us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460079.701786:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1788460079.701798:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1788460079.701804:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac42ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1875336022338432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460079.701827:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac42ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1875336022338432:12345-0@lo:400:kworker.0 Request processed in 24us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460079.701833:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1788460079.701853:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022337536 00000100:00100000:0.0:1788460079.701857:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022337536 00000100:00100000:0.0:1788460079.702003:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788460079.702010:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac43cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022337536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460079.702041:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac43cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022337536:12345-0@lo:400:kworker.0 Request processed in 32us (770us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460079.702047:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788460079.702064:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022338048 00000100:00100000:0.0:1788460079.702068:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022338048 00000100:00100000:0.0:1788460079.702089:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022338560 00000100:00100000:0.0:1788460079.702091:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022338560 00000100:00100000:0.0:1788460079.702110:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788460079.702116:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac43cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022338048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460079.702144:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac43cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022338048:12345-0@lo:400:kworker.0 Request processed in 29us (826us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460079.702159:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788460079.702172:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788460079.702177:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac43cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022338560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460079.702204:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac43cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022338560:12345-0@lo:400:kworker.0 Request processed in 27us (851us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460079.702209:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:0.0:1788460079.702240:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788460079.702244:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788460079.702256:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4367480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0cf73fe6-82e2-434e-b670-631647721b2c:3662:1875336022337280:0@lo:400:kworker.0 00000100:00100000:0.0:1788460079.702285:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460079.702309:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4364a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3662:1875336022337792:0@lo:400:kworker.0 00000100:00100000:0.0:1788460079.702330:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460079.702346:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4365c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3662:1875336022338304:0@lo:400:kworker.0 00000100:00100000:0.0:1788460079.702365:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460079.702497:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4365880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875336022337664:0@lo:400:kworker.0 00000100:00100000:2.0:1788460079.703007:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022337280 00000100:00100000:2.0:1788460079.703013:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022337280 00000100:00100000:2.0:1788460079.703043:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 421 00000100:00100000:2.0:1788460079.703050:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+29:3662:x1875336022337280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460079.703216:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460079.703248:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4367b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022338176:0@lo:400:kworker.0 00000100:00100000:1.0:1788460079.703271:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460079.703294:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac42f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022338688:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788460079.703315:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460079.703342:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022338176 00000100:00100000:1.0:1788460079.703345:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022338176 00000100:00100000:1.0:1788460079.703390:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788460079.703396:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4285180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3661:x1875336022338176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460079.703431:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4285180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3661:x1875336022338176:12345-0@lo:400:kworker.0 Request processed in 35us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460079.703437:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:1.0:1788460079.703456:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788460079.703481:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4367b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022338176:0@lo:400:kworker.0 00000100:00100000:1.0:1788460079.703512:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022338688 00000100:00100000:1.0:1788460079.703516:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022338688 00000100:00100000:1.0:1788460079.703541:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788460079.703547:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4287100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022338688:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788460079.703561:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 28672 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788460079.703592:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4287100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022338688:12345-0@lo:13:osp-pre-1-1.0 Request processed in 45us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460079.703598:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788460079.703640:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac42f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022338688:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788460079.703994:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4364700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022337152:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788460079.704176:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+29:3662:x1875336022337280:12345-0@lo:400:kworker.0 Request processed in 1125us (1889us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460079.704189:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 421 00000100:00100000:2.0:1788460079.704228:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022337792 00000100:00100000:2.0:1788460079.704232:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022337792 00000100:00100000:2.0:1788460079.704266:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022338304 00000100:00100000:2.0:1788460079.704269:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022338304 00000100:00100000:2.0:1788460079.704283:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022337664 00000100:00100000:2.0:1788460079.704286:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022337664 00000100:00100000:2.0:1788460079.704297:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1788460079.704302:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac43cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1875336022337792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460079.704332:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac43cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1875336022337792:12345-0@lo:400:kworker.0 Request processed in 30us (2001us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460079.704338:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1788460079.704349:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1788460079.704354:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac43cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1875336022338304:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788460079.704448:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788460079.704491:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac43cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1875336022338304:12345-0@lo:400:kworker.0 Request processed in 136us (2125us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460079.704497:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1788460079.704509:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1788460079.704516:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4284a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1875336022337664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460079.704555:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4284a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1875336022337664:12345-0@lo:400:kworker.0 Request processed in 40us (1339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460079.704561:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1788460079.705055:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4365880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875336022337664:0@lo:400:kworker.0 00000100:00100000:2.0:1788460079.705848:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4365500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022337536:0@lo:400:kworker.0 00000100:00100000:2.0:1788460079.705860:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4367100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022338048:0@lo:400:kworker.0 00000100:00100000:2.0:1788460079.705871:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4367800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022338560:0@lo:400:kworker.0 00000100:00100000:2.0:1788460079.705967:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4366d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1875336022337408:0@lo:400:kworker.0 00010000:00080000:2.0:1788460079.705980:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac4365180 x1875336022337920/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460095 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460079.705991:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4365180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1875336022337920:0@lo:400:kworker.0 00010000:00080000:2.0:1788460079.706004:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac4365f80 x1875336022338432/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460095 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460079.706013:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4365f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1875336022338432:0@lo:400:kworker.0 00000100:00100000:0.0:1788460079.706964:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4367480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0cf73fe6-82e2-434e-b670-631647721b2c:3662:1875336022337280:0@lo:400:kworker.0 00000100:00100000:0.0:1788460079.707035:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4364a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3662:1875336022337792:0@lo:400:kworker.0 00000100:00100000:0.0:1788460079.707204:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4365c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3662:1875336022338304:0@lo:400:kworker.0 00000040:00080000:1.0:1788460079.826459:0:13811:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788460079.826466:0:13811:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788460079.826489:0:13811:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788460079.826494:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788460079.826612:0:13811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4284380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13811:1875336022338816:192.168.206.5@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788460079.826707:0:13811:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bfa392cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788460079.831104:0:13811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4284380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13811:1875336022338816:192.168.206.5@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788460079.841135:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460079.841214:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003389824 00000100:00100000:3.0:1788460079.841222:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003389824 00000100:00100000:3.0:1788460079.841509:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 142 00000100:00100000:3.0:1788460079.841521:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac43cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+22:11394:x1875336003389824:12345-192.168.206.5@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788460079.841553:0:6534:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788460079.841679:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac43cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+22:11394:x1875336003389824:12345-192.168.206.5@tcp:53:lhsmtool_posix.0 Request processed in 160us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460079.841701:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 142 00000100:00100000:3.0:1788460079.844862:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460079.844967:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003390080 00000100:00100000:0.0:1788460079.844976:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003390080 00000100:00100000:0.0:1788460079.845029:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 143 00000100:00100000:0.0:1788460079.845038:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac42f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+22:11394:x1875336003390080:12345-192.168.206.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788460079.845062:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460079.845080:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542b807 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a7bf expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460079.845176:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4800/0x5dfa74784542b80e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460079.845191:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4800/0x5dfa74784542b80e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460079.845203:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4800/0x5dfa74784542b80e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788460079.845214:0:6535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788460079.845314:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542b807 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a7bf expref: 25 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460079.845329:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4800/0x5dfa74784542b80e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a7bf expref: 24 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460079.845337:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8c4bfa9fe700) 00010000:00010000:0.0:1788460079.845340:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788460079.845343:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc2bd4800, rc 0) 00000100:00100000:0.0:1788460079.845394:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac42f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+24:11394:x1875336003390080:12345-192.168.206.5@tcp:101:lhsmtool_posix.0 Request processed in 357us (540us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1788460079.845402:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 143 00000100:00100000:3.0:1788460079.858558:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460079.858599:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460079.858723:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003390464 00000100:00100000:0.0:1788460079.858723:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003390336 00000100:00100000:2.0:1788460079.858731:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003390464 00000100:00100000:0.0:1788460079.858731:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003390336 00000100:00100000:2.0:1788460079.858787:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 8 00000100:00100000:0.0:1788460079.858787:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 144 00000100:00100000:2.0:1788460079.858797:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac42f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+25:2394:x1875336003390464:12345-192.168.206.5@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788460079.858804:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac42f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+25:11394:x1875336003390336:12345-192.168.206.5@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788460079.858811:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460079.858834:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4800/0x5dfa74784542b80e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a7bf expref: 25 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460079.858849:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8c4bfa9fe700) 00010000:00010000:2.0:1788460079.858854:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788460079.858864:0:13560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542b81c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460079.858877:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542b81c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460079.858900:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac42f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+24:2394:x1875336003390464:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 105us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460079.858907:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 8 00010000:00010000:0.0:1788460079.859400:0:13560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542b81c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460079.859541:0:13560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542b81c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460079.859549:0:13560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542b81c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460079.859555:0:13560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542b81c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460079.859561:0:13560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc2bd4c00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460079.859565:0:13560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542b81c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460079.859572:0:13560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542b81c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460079.859583:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8c4bfa9fe700) 00010000:00010000:0.0:1788460079.859586:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788460079.859590:0:13560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542b81c lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460079.859597:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542b81c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460079.859713:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac42f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+24:11394:x1875336003390336:12345-192.168.206.5@tcp:57:lhsmtool_posix.0 Request processed in 908us (1164us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1788460079.859721:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 144 00000040:00080000:1.0:1788460079.859842:0:13811:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788460079.859847:0:13811:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788460079.860372:0:13811:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1788460079.860383:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788460079.863562:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460079.863656:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003390720 00000100:00100000:0.0:1788460079.863667:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003390720 00000100:00100000:0.0:1788460079.863735:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 34 00000100:00100000:0.0:1788460079.863745:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac42f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+24:11394:x1875336003390720:12345-192.168.206.5@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788460079.863993:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac42f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+25:11394:x1875336003390720:12345-192.168.206.5@tcp:35:lhsmtool_posix.0 Request processed in 249us (439us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1788460079.864001:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 34 00010000:00010000:0.0:1788460079.889108:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460080.067766:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460080.067810:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460080.067843:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460080.067872:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460080.067903:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460080.067931:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460080.067979:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003391104 00000100:00100000:3.0:1788460080.067988:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003391104 00000100:00100000:3.0:1788460080.068030:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003391232 00000100:00100000:3.0:1788460080.068033:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003391232 00000100:00100000:3.0:1788460080.068053:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 116 00000100:00100000:3.0:1788460080.068061:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac42f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:2396:x1875336003391104:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:2.0:1788460080.068216:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003390848 00000100:00100000:2.0:1788460080.068221:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003390848 00000100:00100000:2.0:1788460080.068249:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 422 00000100:00100000:2.0:1788460080.068255:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bed032f6-c389-485e-b2f7-e2ea34763c65+14:2396:x1875336003390848:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:2.0:1788460080.068324:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bed032f6-c389-485e-b2f7-e2ea34763c65+14:2396:x1875336003390848:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 69us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460080.068332:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 422 00000100:00100000:1.0:1788460080.068884:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003391360 00000100:00100000:1.0:1788460080.068889:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003391360 00000100:00100000:1.0:1788460080.068931:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003390976 00000100:00100000:1.0:1788460080.068935:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003390976 00000100:00100000:1.0:1788460080.068993:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003391488 00000100:00100000:1.0:1788460080.068996:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003391488 00000100:00100000:1.0:1788460080.069012:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 289 00000100:00100000:1.0:1788460080.069019:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac42f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a5915a6d-4114-41fb-8d95-33add86e0720+5:2396:x1875336003391360:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:1.0:1788460080.069069:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac42f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a5915a6d-4114-41fb-8d95-33add86e0720+5:2396:x1875336003391360:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 50us (1225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460080.069076:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 289 00000100:00100000:1.0:1788460080.069099:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 290 00000100:00100000:1.0:1788460080.069106:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac42f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2396:x1875336003390976:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:1.0:1788460080.069128:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac42f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2396:x1875336003390976:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 23us (1255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460080.069134:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 290 00000100:00100000:1.0:1788460080.069145:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 291 00000100:00100000:1.0:1788460080.069151:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3b6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a5915a6d-4114-41fb-8d95-33add86e0720+5:2396:x1875336003391488:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:1.0:1788460080.069170:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3b6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a5915a6d-4114-41fb-8d95-33add86e0720+5:2396:x1875336003391488:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 19us (1238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460080.069175:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 291 00000100:00080000:1.0:1788460080.069190:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788460080.069194:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788460080.069196:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788460080.069198:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788460080.069209:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 117 00000100:00100000:1.0:1788460080.069217:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3838e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+7:2396:x1875336003391232:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:1.0:1788460080.069239:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3838e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+7:2396:x1875336003391232:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 24us (1335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460080.069256:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 117 00000100:00100000:3.0:1788460080.071094:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac42f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:2396:x1875336003391104:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 3020us (3270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460080.071105:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 116 00010000:00010000:1.0:1788460080.914988:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788460081.110268:0:13815:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1788460081.448098:0:14379:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788460081.448107:0:14379:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788460081.448137:0:14379:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788460081.448143:0:14379:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788460081.632856:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460081.633019:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003391744 00000100:00100000:3.0:1788460081.633029:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003391744 00000100:00100000:3.0:1788460081.633098:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 145 00000100:00100000:3.0:1788460081.633108:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac2975880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+25:11414:x1875336003391744:12345-192.168.206.5@tcp:101:lfs.0 00010000:00010000:3.0:1788460081.633130:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460081.633149:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209800/0x5dfa74784542b823 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a7c6 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788460081.633257:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788460081.633383:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209400/0x5dfa74784542b82a lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460081.633410:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209400/0x5dfa74784542b82a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460081.633421:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209400/0x5dfa74784542b82a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788460081.633433:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788460081.633715:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209800/0x5dfa74784542b823 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a7c6 expref: 28 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460081.633731:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209400/0x5dfa74784542b82a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a7c6 expref: 27 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460081.633739:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8c4bfa9fe700) 00010000:00010000:3.0:1788460081.633741:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788460081.633745:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bef209400, rc 0) 00000100:00100000:3.0:1788460081.633910:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac2975880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+27:11414:x1875336003391744:12345-192.168.206.5@tcp:101:lfs.0 Request processed in 803us (1058us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1788460081.633918:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 145 00000100:00100000:0.0:1788460081.641793:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460081.641921:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003391872 00000100:00100000:2.0:1788460081.641930:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003391872 00000100:00100000:2.0:1788460081.642065:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 146 00000100:00100000:2.0:1788460081.642075:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac43cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+27:11414:x1875336003391872:12345-192.168.206.5@tcp:54:lfs.0 00010000:00010000:2.0:1788460081.642136:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b838 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460081.642152:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b838 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460081.642163:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b838 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460081.642196:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b838 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460081.642203:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b838 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460081.642210:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b838 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460081.642215:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bfadc6400 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:2.0:1788460081.642219:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b838 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460081.642242:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b838 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460081.642254:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8c4bfa9fe700) 00010000:00010000:2.0:1788460081.642257:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788460081.642262:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b838 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460081.642268:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b838 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460081.642350:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac43cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+27:11414:x1875336003391872:12345-192.168.206.5@tcp:54:lfs.0 Request processed in 276us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460081.642358:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 146 00000100:00100000:0.0:1788460081.712545:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460081.712713:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003392000 00000100:00100000:1.0:1788460081.712722:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003392000 00000100:00100000:1.0:1788460081.712825:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 54 00000100:00100000:1.0:1788460081.712840:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac43cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:2395:x1875336003392000:12345-192.168.206.5@tcp:101:cat.0 00010000:00010000:1.0:1788460081.712856:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460081.712875:0:8448:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd4e6ef7/0x5dfa74784542b83f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a7cd expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788460081.712896:0:8448:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a99bc2c, atime: 0x6a99bc2c, ctime: 0x6a99bc2c, blocks: 0x8 00010000:00010000:1.0:1788460081.712914:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=378s v=(0 0) 00010000:00010000:1.0:1788460081.712919:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460081.712927:0:8448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd4e6ef7/0x5dfa74784542b83f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a7cd expref: 7 pid: 8448 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460081.712986:0:8448:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cd4e6ef7/0x5dfa74784542b83f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a7cd expref: 7 pid: 8448 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460081.713000:0:8448:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ac3677000, rc 0) 00000100:00100000:0.0:1788460081.713131:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac43cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+7:2395:x1875336003392000:12345-192.168.206.5@tcp:101:cat.0 Request processed in 295us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460081.713138:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 54 00000100:00100000:3.0:1788460081.717808:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460081.718090:0:8455:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003392128 00000100:00100000:2.0:1788460081.718099:0:8455:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003392128 00002000:00100000:2.0:1788460081.718143:0:8455:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff8c4ac3a32680 x1875336003392128/t0(0) o3->f8767d3e-bfef-4d3d-8163-ef8ae18a3514@192.168.206.5@tcp:237/0 lens 488/0 e 0 to 0 dl 1788460092 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788460081.718154:0:8455:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c4ac3a32680 with x1875336003392128 ext(0->4095) 00002000:00010000:2.0:1788460081.718160:0:8455:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c4ac3a32680 00000100:00100000:2.0:1788460081.718356:0:8455:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 3 00000100:00100000:2.0:1788460081.718366:0:8455:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3a32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+7:2394:x1875336003392128:12345-192.168.206.5@tcp:3:cat.0 00000100:00100000:2.0:1788460081.718583:0:8455:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3a32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+7:2394:x1875336003392128:12345-192.168.206.5@tcp:3:cat.0 Request processed in 217us (782us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788460081.718647:0:8455:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 3 00002000:00100000:2.0:1788460081.718657:0:8455:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff8c4ac3a32680 x1875336003392128/t0(0) o3->f8767d3e-bfef-4d3d-8163-ef8ae18a3514@192.168.206.5@tcp:237/0 lens 488/4536 e 0 to 0 dl 1788460092 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788460081.718702:0:8455:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c4ac3a32680 with x1875336003392128 ext(0->4095) 00002000:00010000:2.0:1788460081.718706:0:8455:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c4ac3a32680 00000040:00080000:1.0:1788460081.937381:0:13811:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788460081.937390:0:13811:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788460081.937408:0:13811:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788460081.937415:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788460081.938961:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788460082.769154:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac43cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022338944:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788460082.769217:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460082.769401:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022338944 00000100:00100000:2.0:1788460082.769407:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022338944 00000100:00100000:2.0:1788460082.769477:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788460082.769486:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac413a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3662:x1875336022338944:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788460082.769504:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1788460082.769514:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1788460082.769688:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac413a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3662:x1875336022338944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 201us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460082.769698:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788460082.769790:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac43cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022338944:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1788460082.770705:0:9527:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:3.0:1788460082.770720:0:9527:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00010000:00010000:1.0:1788460082.962983:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788460083.281297:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4138700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022339072:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788460083.281364:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460083.282158:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022339072 00000100:00100000:1.0:1788460083.282169:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022339072 00000100:00100000:1.0:1788460083.282231:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788460083.282238:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788460083.282244:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac43cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022339072:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788460083.282279:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1788460083.282364:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac43cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022339200:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788460083.282398:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460083.282481:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022339200 00000100:00100000:3.0:1788460083.282487:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022339200 00000100:00100000:3.0:1788460083.282533:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788460083.282542:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4138a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022339200:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788460083.282555:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1788460083.282603:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4138a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022339200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 62us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460083.282610:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:0.0:1788460083.282737:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788460083.290978:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac43cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022339072:12345-0@lo:41:osp-pre-0-1.0 Request processed in 8729us (9604us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460083.290992:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788460083.293775:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4138700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022339072:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788460083.294517:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac43cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022339200:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788460083.985624:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788460084.307198:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac43cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022339328:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788460084.307276:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460084.307350:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022339328 00000100:00100000:1.0:1788460084.307357:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022339328 00000100:00100000:1.0:1788460084.307411:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788460084.307429:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4284380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1875336022339328:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788460084.307460:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446453248 avail 1300213760 00000100:00100000:1.0:1788460084.307503:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4284380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1875336022339328:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460084.307510:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788460084.307566:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac43cce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022339328:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788460084.817119:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac43cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022339456:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788460084.817190:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460084.817262:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022339456 00000100:00100000:0.0:1788460084.817269:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022339456 00000100:00100000:0.0:1788460084.817316:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788460084.817326:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac43cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875336022339456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788460084.817354:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788460084.817412:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac43cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875336022339456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460084.817420:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:0.0:1788460084.817441:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788460084.817467:0:3662:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:0.0:1788460084.817473:0:3662:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:0.0:1788460084.817490:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8c4ac4364000, transno 4294967305 00000100:00100000:0.0:1788460084.817505:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac43cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022339456:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788460084.818227:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc43f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0cf73fe6-82e2-434e-b670-631647721b2c:3659:1875336022339584:0@lo:400:kworker.0 00000100:00100000:3.0:1788460084.818267:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460084.818295:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfa35ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1875336022340096:0@lo:400:kworker.0 00000100:00100000:3.0:1788460084.818319:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460084.818334:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfa1e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1875336022340608:0@lo:400:kworker.0 00000100:00100000:3.0:1788460084.818352:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460084.818370:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788460084.818376:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc43f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1875336022339712:0@lo:400:kworker.0 00000100:00100000:3.0:1788460084.818395:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460084.818409:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3a3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1875336022340224:0@lo:400:kworker.0 00000100:00100000:3.0:1788460084.818426:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460084.818439:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfa1e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1875336022340736:0@lo:400:kworker.0 00000100:00100000:3.0:1788460084.818457:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460084.818482:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022339584 00000100:00100000:3.0:1788460084.818486:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022339584 00000100:00100000:3.0:1788460084.818515:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 423 00000100:00100000:3.0:1788460084.818522:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+29:3659:x1875336022339584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460084.818558:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+29:3659:x1875336022339584:12345-0@lo:400:kworker.0 Request processed in 36us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460084.818564:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 423 00000100:00100000:3.0:1788460084.818589:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022340096 00000100:00100000:3.0:1788460084.818600:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022340096 00000100:00100000:3.0:1788460084.818625:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022340608 00000100:00100000:3.0:1788460084.818627:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022340608 00000100:00100000:3.0:1788460084.818639:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022339712 00000100:00100000:3.0:1788460084.818641:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022339712 00000100:00100000:3.0:1788460084.818650:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022340224 00000100:00100000:3.0:1788460084.818652:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022340224 00000100:00100000:3.0:1788460084.818678:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022340736 00000100:00100000:3.0:1788460084.818681:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022340736 00000100:00100000:3.0:1788460084.818693:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1788460084.818698:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac405df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1875336022340096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460084.818728:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac405df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1875336022340096:12345-0@lo:400:kworker.0 Request processed in 30us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460084.818734:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1788460084.818746:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1788460084.818751:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac405ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1875336022340608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460084.818775:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac405ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1875336022340608:12345-0@lo:400:kworker.0 Request processed in 24us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460084.818781:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1788460084.818792:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1788460084.818797:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac405c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1875336022339712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460084.818822:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac405c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1875336022339712:12345-0@lo:400:kworker.0 Request processed in 24us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460084.818827:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1788460084.818838:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:3.0:1788460084.818844:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac405e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1875336022340224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460084.818868:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac405e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1875336022340224:12345-0@lo:400:kworker.0 Request processed in 25us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460084.818883:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:3.0:1788460084.818895:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1788460084.818902:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac405c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1875336022340736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460084.818930:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac405c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3659:x1875336022340736:12345-0@lo:400:kworker.0 Request processed in 30us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460084.818936:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1788460084.819047:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc43f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1875336022339712:0@lo:400:kworker.0 00010000:00080000:3.0:1788460084.819060:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3a3bb80 x1875336022340224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460100 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460084.819070:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3a3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1875336022340224:0@lo:400:kworker.0 00010000:00080000:3.0:1788460084.819079:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bfa1e2300 x1875336022340736/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460100 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460084.819087:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfa1e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1875336022340736:0@lo:400:kworker.0 00000100:00100000:3.0:1788460084.819096:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc43f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0cf73fe6-82e2-434e-b670-631647721b2c:3659:1875336022339584:0@lo:400:kworker.0 00000100:00100000:3.0:1788460084.819104:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfa35ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1875336022340096:0@lo:400:kworker.0 00000100:00100000:3.0:1788460084.819112:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfa1e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1875336022340608:0@lo:400:kworker.0 00000100:00100000:0.0:1788460084.819358:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfae8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022339840:0@lo:400:kworker.0 00000100:00100000:0.0:1788460084.819404:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460084.819429:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf76ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022340352:0@lo:400:kworker.0 00000100:00100000:0.0:1788460084.819452:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460084.819469:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfa1e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022340864:0@lo:400:kworker.0 00000100:00100000:0.0:1788460084.819487:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460084.819504:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788460084.819510:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfa35bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875336022339968:0@lo:400:kworker.0 00000100:00100000:0.0:1788460084.819528:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460084.819543:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf76ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022340480:0@lo:400:kworker.0 00000100:00100000:0.0:1788460084.819560:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460084.819601:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022339840 00000100:00100000:0.0:1788460084.819606:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022339840 00000100:00100000:0.0:1788460084.819640:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788460084.819647:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac43cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022339840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460084.819697:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac43cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022339840:12345-0@lo:400:kworker.0 Request processed in 50us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460084.819703:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788460084.819722:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022340352 00000100:00100000:0.0:1788460084.819725:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022340352 00000100:00100000:0.0:1788460084.819745:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022340864 00000100:00100000:0.0:1788460084.819747:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022340864 00000100:00100000:0.0:1788460084.819759:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022340480 00000100:00100000:0.0:1788460084.819761:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022340480 00000100:00100000:0.0:1788460084.819773:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788460084.819778:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac43ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022340352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460084.819809:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac43ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022340352:12345-0@lo:400:kworker.0 Request processed in 30us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460084.819815:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788460084.819826:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788460084.819832:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac43ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022340864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460084.819857:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac43ce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022340864:12345-0@lo:400:kworker.0 Request processed in 27us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460084.819862:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788460084.819874:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788460084.819879:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac43ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3661:x1875336022340480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460084.819903:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac43ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3661:x1875336022340480:12345-0@lo:400:kworker.0 Request processed in 24us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460084.819917:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:0.0:1788460084.819939:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788460084.819966:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788460084.819969:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788460084.819971:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788460084.819998:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf76ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022340480:0@lo:400:kworker.0 00000100:00100000:0.0:1788460084.820008:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfae8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022339840:0@lo:400:kworker.0 00000100:00100000:0.0:1788460084.820017:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf76ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022340352:0@lo:400:kworker.0 00000100:00100000:0.0:1788460084.820025:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfa1e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022340864:0@lo:400:kworker.0 00000100:00100000:3.0:1788460084.820360:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022339968 00000100:00100000:3.0:1788460084.820365:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022339968 00000100:00100000:3.0:1788460084.820500:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1788460084.820508:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac43cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1875336022339968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460084.820571:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac43cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1875336022339968:12345-0@lo:400:kworker.0 Request processed in 64us (1041us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460084.820587:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1788460084.820664:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfa35bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875336022339968:0@lo:400:kworker.0 00000100:00100000:3.0:1788460084.822729:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788460084.822747:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac405dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022340992:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788460084.822804:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460084.822845:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022340992 00000100:00100000:3.0:1788460084.822851:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022340992 00000100:00100000:3.0:1788460084.822891:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788460084.822899:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac405fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022340992:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788460084.822932:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788460084.822992:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac405fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022340992:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460084.822999:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788460084.823038:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac405dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022340992:0@lo:13:osp-pre-1-1.0 00000001:00080000:1.0:1788460084.824470:0:6513:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:1.0:1788460084.824497:0:6513:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8c4ac286c900 refcount 2 committed 0 result 0 batchid 4 00010000:00010000:2.0:1788460084.824499:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542b7ba lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788460084.824502:0:6513:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8c4ac25cd300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8c4ac286c600 00000020:00080000:1.0:1788460084.824505:0:6513:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8c4ac25cd000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8c4ac2949400 00010000:00010000:2.0:1788460084.824510:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542b7ba lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460084.824518:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542b7ba lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788460084.824521:0:6513:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00010000:00010000:2.0:1788460084.824523:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bfadc7800 already unused, calling callback (ffffffffc18714f0) 00000020:00080000:1.0:1788460084.824531:0:6565:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00010000:00010000:2.0:1788460084.824534:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542b7ba lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460084.824541:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542b7ba lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460084.824555:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8c4bfa9fec00) 00010000:00010000:2.0:1788460084.824557:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460084.824561:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542b7ba lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460084.824566:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542b7ba lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788460084.824591:0:6565:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:0.0:1788460084.829062:0:8443:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:0.0:1788460084.829076:0:8443:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00010000:00010000:3.0:1788460085.009162:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460085.201991:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460085.202041:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460085.202075:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460085.202105:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460085.202124:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460085.202139:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460085.202159:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460085.202181:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003392512 00000100:00100000:3.0:1788460085.202189:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003392512 00000100:00100000:3.0:1788460085.202231:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003393024 00000100:00100000:3.0:1788460085.202234:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003393024 00000100:00100000:3.0:1788460085.202260:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003392384 00000100:00100000:3.0:1788460085.202262:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003392384 00000100:00100000:3.0:1788460085.202272:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003392896 00000100:00100000:3.0:1788460085.202274:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003392896 00000100:00100000:3.0:1788460085.202286:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 298 00000100:00100000:3.0:1788460085.202294:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac405dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2394:x1875336003392512:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:3.0:1788460085.202358:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac405dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2394:x1875336003392512:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 64us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460085.202366:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 298 00000100:00100000:3.0:1788460085.202382:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 299 00000100:00100000:3.0:1788460085.202388:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfa35ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a5915a6d-4114-41fb-8d95-33add86e0720+5:2394:x1875336003393024:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:3.0:1788460085.202411:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfa35ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a5915a6d-4114-41fb-8d95-33add86e0720+5:2394:x1875336003393024:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 23us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460085.202417:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 299 00000100:00100000:3.0:1788460085.202429:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 300 00000100:00100000:3.0:1788460085.202436:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfa1e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+13:2394:x1875336003392384:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:3.0:1788460085.202459:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfa1e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+13:2394:x1875336003392384:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 24us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460085.202464:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 300 00000100:00100000:3.0:1788460085.202475:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 301 00000100:00100000:3.0:1788460085.202482:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfa1e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a5915a6d-4114-41fb-8d95-33add86e0720+5:2394:x1875336003392896:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:3.0:1788460085.202503:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfa1e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:a5915a6d-4114-41fb-8d95-33add86e0720+5:2394:x1875336003392896:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 22us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460085.202509:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 301 00000100:00100000:3.0:1788460085.202529:0:8832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003392768 00000100:00100000:3.0:1788460085.202537:0:8832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003392768 00000100:00100000:3.0:1788460085.202558:0:8832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003392640 00000100:00100000:3.0:1788460085.202560:0:8832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003392640 00000100:00100000:3.0:1788460085.202583:0:8832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 121 00000100:00100000:3.0:1788460085.202589:0:8832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfa35bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2394:x1875336003392768:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:3.0:1788460085.202614:0:8832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfa35bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2394:x1875336003392768:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 25us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460085.202619:0:8832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 121 00000100:00100000:3.0:1788460085.202628:0:8832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 122 00000100:00100000:3.0:1788460085.202633:0:8832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfa1e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:2394:x1875336003392640:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:3.0:1788460085.202650:0:8832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfa1e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:2394:x1875336003392640:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 18us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460085.202667:0:8832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 122 00000100:00100000:2.0:1788460085.202818:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003392256 00000100:00100000:2.0:1788460085.202822:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003392256 00000100:00100000:2.0:1788460085.202852:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 424 00000100:00100000:2.0:1788460085.202858:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bed032f6-c389-485e-b2f7-e2ea34763c65+14:2394:x1875336003392256:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:2.0:1788460085.202886:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bed032f6-c389-485e-b2f7-e2ea34763c65+14:2394:x1875336003392256:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 29us (904us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460085.202892:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 424 00000100:00080000:0.0:1788460085.202976:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788460085.202980:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788460085.202982:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788460085.202984:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1788460086.042747:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460087.059144:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460087.181772:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460087.185415:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003393152 00000100:00100000:0.0:1788460087.185431:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003393152 00000100:00100000:0.0:1788460087.185523:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 147 00000100:00100000:0.0:1788460087.185537:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+13:11059:x1875336003393152:12345-192.168.206.5@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788460087.185671:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+13:11059:x1875336003393152:12345-192.168.206.5@tcp:60:lhsmtool_posix.0 Request processed in 138us (3908us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460087.185679:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 147 00000100:00080000:2.0:1788460087.186330:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788460087.193247:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460087.197532:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003393280 00000100:00100000:3.0:1788460087.197547:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003393280 00000100:00100000:2.0:1788460087.201865:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 148 00000100:00100000:2.0:1788460087.201881:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac43cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:11059:x1875336003393280:12345-192.168.206.5@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788460087.202022:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac43cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:11059:x1875336003393280:12345-192.168.206.5@tcp:60:lhsmtool_posix.0 Request processed in 145us (8783us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460087.202030:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 148 00000100:00080000:0.0:1788460087.205617:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788460087.207597:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460087.208002:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003393536 00000100:00100000:0.0:1788460087.208026:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003393536 00000100:00100000:0.0:1788460087.208132:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 35 00000100:00100000:0.0:1788460087.208144:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4287b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+13:11059:x1875336003393536:12345-192.168.206.5@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788460087.208392:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4287b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+14:11059:x1875336003393536:12345-192.168.206.5@tcp:35:lhsmtool_posix.0 Request processed in 251us (802us total) trans 4294967416 rc 0/0 00000100:00100000:0.0:1788460087.208401:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 35 00000100:00100000:1.0:1788460087.502222:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460087.505715:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003393664 00000100:00100000:0.0:1788460087.505728:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003393664 00000100:00100000:0.0:1788460087.505817:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 149 00000100:00100000:0.0:1788460087.505826:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4284000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a5915a6d-4114-41fb-8d95-33add86e0720+5:11874:x1875336003393664:12345-192.168.206.5@tcp:101:lsof.0 00010000:00010000:0.0:1788460087.505844:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460087.505863:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5000/0x5dfa74784542b846 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a7d4 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460087.505919:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4600/0x5dfa74784542b84d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460087.505931:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4600/0x5dfa74784542b84d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460087.505960:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4600/0x5dfa74784542b84d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788460087.506005:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788460087.506009:0:6533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788460087.506109:0:6533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4600/0x5dfa74784542b84d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460087.506132:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5000/0x5dfa74784542b846 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a7d4 expref: 7 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460087.506161:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4600/0x5dfa74784542b84d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a7d4 expref: 6 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460087.506168:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4bc5dc1900) 00010000:00010000:0.0:1788460087.506171:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788460087.506174:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc2bd4600, rc 0) 00000100:00080000:2.0:1788460087.506314:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788460087.506523:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4284000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a5915a6d-4114-41fb-8d95-33add86e0720+6:11874:x1875336003393664:12345-192.168.206.5@tcp:101:lsof.0 Request processed in 697us (4959us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460087.506531:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 149 00000100:00100000:3.0:1788460087.890224:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4138700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022341120:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788460087.890287:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460087.890410:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022341120 00000100:00100000:1.0:1788460087.890417:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022341120 00000100:00100000:1.0:1788460087.890472:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788460087.890481:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc43f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022341120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788460087.890506:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1788460087.890547:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc43f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022341120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460087.890554:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788460087.890604:0:3659:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:1.0:1788460087.890609:0:3659:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8c4ac4364380, transno 4294967311 00000004:00080000:1.0:1788460087.890618:0:3659:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:1.0:1788460087.890651:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4138700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022341120:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788460087.890924:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788460088.082217:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788460088.401157:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4139180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022341248:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788460088.401226:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460088.401374:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022341248 00000100:00100000:1.0:1788460088.401393:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022341248 00000100:00100000:1.0:1788460088.401447:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788460088.401456:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac43cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022341248:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788460088.401487:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1788460088.402009:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788460088.402020:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4138000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022341376:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788460088.402055:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460088.402113:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022341376 00000100:00100000:2.0:1788460088.402117:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022341376 00000100:00100000:2.0:1788460088.402152:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788460088.402159:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4138700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022341376:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788460088.402174:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1788460088.402208:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4138700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022341376:12345-0@lo:13:osp-pre-0-1.0 Request processed in 49us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460088.402215:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788460088.402261:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4138000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022341376:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788460088.402279:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788460088.408193:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac43cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022341248:12345-0@lo:41:osp-pre-0-1.0 Request processed in 6729us (6958us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460088.408207:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788460088.408324:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4139180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022341248:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788460089.108547:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788460089.425318:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac43cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022341504:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788460089.425388:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460089.425740:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022341504 00000100:00100000:3.0:1788460089.425749:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022341504 00000100:00100000:3.0:1788460089.425800:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788460089.425809:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4138000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1875336022341504:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788460089.425851:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446453248 avail 1300213760 00000100:00100000:3.0:1788460089.425913:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4138000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1875336022341504:12345-0@lo:41:osp-pre-1-0.0 Request processed in 104us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460089.425921:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788460089.426033:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac43cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022341504:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788460089.937191:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788460089.937213:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac43cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022341632:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788460089.937297:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460089.937460:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022341632 00000100:00100000:2.0:1788460089.937467:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022341632 00000100:00100000:2.0:1788460089.937532:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788460089.937542:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4285c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022341632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788460089.937567:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788460089.937610:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4285c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022341632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460089.937617:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788460089.937721:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac43cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022341632:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788460089.937801:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788460089.938426:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc532ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022342016:0@lo:400:kworker.0 00000100:00100000:2.0:1788460089.938471:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460089.938494:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc5329f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3662:1875336022342528:0@lo:400:kworker.0 00000100:00100000:2.0:1788460089.938517:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460089.938540:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc471a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1875336022343040:0@lo:400:kworker.0 00000100:00100000:2.0:1788460089.938560:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460089.938579:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788460089.938585:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc532f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3662:1875336022341888:0@lo:400:kworker.0 00000100:00100000:2.0:1788460089.938605:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460089.938621:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc5329180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3662:1875336022342400:0@lo:400:kworker.0 00000100:00100000:2.0:1788460089.938653:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460089.938672:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc471b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3662:1875336022342912:0@lo:400:kworker.0 00000100:00100000:2.0:1788460089.938690:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460089.938715:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022342016 00000100:00100000:2.0:1788460089.938720:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022342016 00000100:00100000:2.0:1788460089.938750:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788460089.938757:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc4395180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022342016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460089.938801:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc4395180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022342016:12345-0@lo:400:kworker.0 Request processed in 45us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460089.938808:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788460089.938825:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022342528 00000100:00100000:2.0:1788460089.938828:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022342528 00000100:00100000:2.0:1788460089.938851:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022343040 00000100:00100000:2.0:1788460089.938853:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022343040 00000100:00100000:2.0:1788460089.938866:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022341888 00000100:00100000:2.0:1788460089.938868:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022341888 00000100:00100000:2.0:1788460089.938876:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022342400 00000100:00100000:2.0:1788460089.938878:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022342400 00000100:00100000:2.0:1788460089.938901:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022342912 00000100:00100000:2.0:1788460089.938904:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022342912 00000100:00100000:2.0:1788460089.938916:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1788460089.938922:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc4394380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875336022342528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460089.938980:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc4394380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875336022342528:12345-0@lo:400:kworker.0 Request processed in 58us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460089.938987:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1788460089.938999:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1788460089.939004:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc4396300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875336022343040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460089.939029:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc4396300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875336022343040:12345-0@lo:400:kworker.0 Request processed in 26us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460089.939035:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1788460089.939048:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1788460089.939053:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc4396a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1875336022341888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460089.939075:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc4396a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1875336022341888:12345-0@lo:400:kworker.0 Request processed in 22us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460089.939080:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1788460089.939090:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1788460089.939094:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc4394e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1875336022342400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460089.939119:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc4394e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1875336022342400:12345-0@lo:400:kworker.0 Request processed in 24us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460089.939124:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1788460089.939134:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1788460089.939140:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc4397800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1875336022342912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460089.939163:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc4397800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1875336022342912:12345-0@lo:400:kworker.0 Request processed in 24us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460089.939176:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1788460089.939208:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc532f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3662:1875336022341888:0@lo:400:kworker.0 00000100:00100000:2.0:1788460089.939218:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc5329180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3662:1875336022342400:0@lo:400:kworker.0 00000100:00100000:2.0:1788460089.939226:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc471b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3662:1875336022342912:0@lo:400:kworker.0 00000100:00100000:2.0:1788460089.939233:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc532ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022342016:0@lo:400:kworker.0 00010000:00080000:2.0:1788460089.939245:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bc5329f80 x1875336022342528/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460105 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460089.939254:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc5329f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3662:1875336022342528:0@lo:400:kworker.0 00010000:00080000:2.0:1788460089.939264:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bc471a680 x1875336022343040/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460105 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460089.939272:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc471a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1875336022343040:0@lo:400:kworker.0 00000100:00080000:0.0:1788460089.939372:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788460089.939377:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788460089.939388:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc532ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1875336022342144:0@lo:400:kworker.0 00000100:00100000:0.0:1788460089.939417:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460089.939442:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc532a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022342656:0@lo:400:kworker.0 00000100:00100000:0.0:1788460089.939466:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460089.939482:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4719180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022343168:0@lo:400:kworker.0 00000100:00100000:0.0:1788460089.939502:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460089.939519:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788460089.939525:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4139180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0cf73fe6-82e2-434e-b670-631647721b2c:3659:1875336022341760:0@lo:400:kworker.0 00000100:00100000:0.0:1788460089.939560:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460089.939581:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc5329880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022342272:0@lo:400:kworker.0 00000100:00100000:0.0:1788460089.939602:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460089.939620:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc5329c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022342784:0@lo:400:kworker.0 00000100:00100000:0.0:1788460089.939655:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460089.939680:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022342656 00000100:00100000:0.0:1788460089.939683:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022342656 00000100:00100000:0.0:1788460089.939712:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022343168 00000100:00100000:0.0:1788460089.939714:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022343168 00000100:00100000:0.0:1788460089.939731:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022342784 00000100:00100000:0.0:1788460089.939734:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022342784 00000100:00100000:0.0:1788460089.939747:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788460089.939753:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfae8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022342656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460089.939787:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfae8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022342656:12345-0@lo:400:kworker.0 Request processed in 34us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460089.939793:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788460089.939806:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788460089.939811:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf76ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022343168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460089.939835:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf76ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022343168:12345-0@lo:400:kworker.0 Request processed in 25us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460089.939841:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788460089.939851:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788460089.939856:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022342784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460089.939881:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022342784:12345-0@lo:400:kworker.0 Request processed in 25us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460089.939887:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788460089.939915:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022342272 00000100:00100000:0.0:1788460089.939918:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022342272 00000100:00100000:0.0:1788460089.939934:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788460089.939939:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf76ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022342272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460089.939996:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf76ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022342272:12345-0@lo:400:kworker.0 Request processed in 57us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460089.940003:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00080000:0.0:1788460089.940017:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788460089.940020:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788460089.940027:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022342144 00000100:00100000:0.0:1788460089.940030:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022342144 00000100:00100000:0.0:1788460089.940046:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1788460089.940052:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac43cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1875336022342144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460089.940079:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac43cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1875336022342144:12345-0@lo:400:kworker.0 Request processed in 28us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460089.940085:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1788460089.940110:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc5329880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022342272:0@lo:400:kworker.0 00000100:00100000:0.0:1788460089.940120:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc5329c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022342784:0@lo:400:kworker.0 00000100:00100000:0.0:1788460089.940129:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc532ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1875336022342144:0@lo:400:kworker.0 00000100:00100000:0.0:1788460089.940136:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc532a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022342656:0@lo:400:kworker.0 00000100:00100000:0.0:1788460089.940144:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4719180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022343168:0@lo:400:kworker.0 00000100:00100000:3.0:1788460089.940512:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022341760 00000100:00100000:3.0:1788460089.940517:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022341760 00000100:00100000:3.0:1788460089.940556:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 425 00000100:00100000:3.0:1788460089.940563:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+29:3659:x1875336022341760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460089.940609:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+29:3659:x1875336022341760:12345-0@lo:400:kworker.0 Request processed in 46us (1047us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460089.940616:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 425 00000100:00100000:0.0:1788460089.941791:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4139180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0cf73fe6-82e2-434e-b670-631647721b2c:3659:1875336022341760:0@lo:400:kworker.0 00000100:00100000:3.0:1788460089.944828:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4287800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022343296:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788460089.945020:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460089.945423:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022343296 00000100:00100000:2.0:1788460089.945432:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022343296 00000100:00100000:2.0:1788460089.945719:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788460089.945729:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc43f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022343296:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788460089.945753:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788460089.945809:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc43f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022343296:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (789us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460089.945815:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788460089.945907:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4287800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022343296:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788460090.129340:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788460090.308474:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460090.308513:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460090.308539:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460090.308566:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460090.308580:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460090.308597:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460090.308623:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460090.308702:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003394304 00000100:00100000:2.0:1788460090.308712:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003394304 00000100:00100000:2.0:1788460090.308772:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003394176 00000100:00100000:2.0:1788460090.308776:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003394176 00000100:00100000:2.0:1788460090.308814:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 126 00000100:00100000:2.0:1788460090.308824:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4284e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2395:x1875336003394304:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:2.0:1788460090.308904:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4284e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2395:x1875336003394304:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 82us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460090.308913:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 126 00000100:00100000:2.0:1788460090.308930:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 127 00000100:00100000:2.0:1788460090.308936:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4286680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:2395:x1875336003394176:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:2.0:1788460090.308991:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4286680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:2395:x1875336003394176:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 55us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460090.308998:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 127 00000100:00100000:2.0:1788460090.309108:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003394048 00000100:00100000:2.0:1788460090.309113:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003394048 00000100:00100000:2.0:1788460090.309140:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003394560 00000100:00100000:2.0:1788460090.309143:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003394560 00000100:00100000:2.0:1788460090.309155:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003393920 00000100:00100000:2.0:1788460090.309158:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003393920 00000100:00100000:2.0:1788460090.309168:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003394432 00000100:00100000:2.0:1788460090.309170:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003394432 00000100:00100000:2.0:1788460090.309182:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 308 00000100:00100000:2.0:1788460090.309188:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4285f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2395:x1875336003394048:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:2.0:1788460090.309216:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4285f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2395:x1875336003394048:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 27us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460090.309222:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 308 00000100:00100000:2.0:1788460090.309233:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 309 00000100:00100000:2.0:1788460090.309239:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4286a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a5915a6d-4114-41fb-8d95-33add86e0720+5:2395:x1875336003394560:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:2.0:1788460090.309256:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4286a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a5915a6d-4114-41fb-8d95-33add86e0720+5:2395:x1875336003394560:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 17us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460090.309268:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 309 00000100:00100000:2.0:1788460090.309280:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 310 00000100:00100000:2.0:1788460090.309286:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4284700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+14:2395:x1875336003393920:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:2.0:1788460090.309316:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4284700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+14:2395:x1875336003393920:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 31us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460090.309323:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 310 00000100:00100000:2.0:1788460090.309333:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 311 00000100:00100000:2.0:1788460090.309339:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4286300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a5915a6d-4114-41fb-8d95-33add86e0720+6:2395:x1875336003394432:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:2.0:1788460090.309357:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4286300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a5915a6d-4114-41fb-8d95-33add86e0720+6:2395:x1875336003394432:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 19us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460090.309363:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 311 00000100:00100000:3.0:1788460090.309705:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003393792 00000100:00100000:3.0:1788460090.309711:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003393792 00000100:00100000:3.0:1788460090.309750:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 426 00000100:00100000:3.0:1788460090.309757:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bed032f6-c389-485e-b2f7-e2ea34763c65+14:2395:x1875336003393792:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:3.0:1788460090.309797:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bed032f6-c389-485e-b2f7-e2ea34763c65+14:2395:x1875336003393792:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 40us (1332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460090.309804:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 426 00000100:00080000:1.0:1788460090.309894:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788460090.309899:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788460090.309902:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788460090.309904:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1788460090.969137:0:6513:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:3.0:1788460090.969152:0:6513:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:2.0:1788460090.969287:0:6565:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1788460090.969298:0:6565:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000040:00080000:1.0:1788460091.153089:0:13811:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788460091.153098:0:13811:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788460091.153193:0:13811:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:1.0:1788460091.153199:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788460091.153490:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788460091.348181:0:13815:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:3.0:1788460091.545752:0:14577:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 14:28:09 (1788460089) 00010000:00010000:0.0:1788460092.177346:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788460093.012151:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4394000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022343424:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788460093.012224:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460093.012396:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022343424 00000100:00100000:0.0:1788460093.012416:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022343424 00000100:00100000:0.0:1788460093.012480:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788460093.012490:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4287480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1875336022343424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788460093.012519:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1788460093.012575:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4287480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1875336022343424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460093.012582:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788460093.012902:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4394000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022343424:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788460093.012967:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788460093.201208:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788460093.523932:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4139180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022343680:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788460093.524010:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460093.524171:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022343680 00000100:00100000:0.0:1788460093.524179:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022343680 00000100:00100000:0.0:1788460093.524252:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788460093.524261:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc4394000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022343680:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788460093.524283:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1788460093.524324:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc4394000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022343680:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460093.524331:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788460093.524468:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788460093.524479:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4397100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022343552:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788460093.524512:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788460093.524583:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788460093.524628:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4139180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022343680:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788460093.524767:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022343552 00000100:00100000:0.0:1788460093.524771:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022343552 00000100:00100000:0.0:1788460093.524808:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788460093.524815:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4287800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022343552:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788460093.524858:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1788460093.524901:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4287800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022343552:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460093.524907:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788460093.525126:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4397100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022343552:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788460093.719761:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460093.719874:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003394816 00000100:00100000:0.0:1788460093.719885:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003394816 00000100:00100000:0.0:1788460093.720002:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 150 00000100:00100000:0.0:1788460093.720014:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc4397100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+13:12141:x1875336003394816:12345-192.168.206.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788460093.720063:0:7760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460093.720084:0:7760:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5600/0x5dfa74784542b854 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a7db expref: -99 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460093.720151:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b85b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460093.720165:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b85b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460093.720177:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b85b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460093.720231:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542b862 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460093.720239:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542b862 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460093.720245:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542b862 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460093.720331:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4000/0x5dfa74784542b869 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460093.720340:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4000/0x5dfa74784542b869 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460093.720346:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4000/0x5dfa74784542b869 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788460093.720356:0:7760:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1788460093.720436:0:7760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b85b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460093.720444:0:7760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b85b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460093.720450:0:7760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b85b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460093.720455:0:7760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc2bd4200 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460093.720460:0:7760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b85b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460093.720468:0:7760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b85b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460093.720479:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8c4bc5dc1100) 00010000:00010000:0.0:1788460093.720482:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460093.720486:0:7760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b85b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460093.720492:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b85b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460093.720505:0:7760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542b862 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460093.720510:0:7760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542b862 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460093.720515:0:7760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542b862 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460093.720542:0:7760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc2bd4e00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460093.720545:0:7760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542b862 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460093.720552:0:7760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542b862 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460093.720561:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8c4bc5dc1b00) 00010000:00010000:0.0:1788460093.720563:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460093.720566:0:7760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542b862 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460093.720572:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542b862 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460093.720834:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5600/0x5dfa74784542b854 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a7db expref: 16 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460093.720847:0:7760:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4000/0x5dfa74784542b869 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a7db expref: 15 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460093.720854:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c4bef1fde00) 00010000:00010000:0.0:1788460093.720857:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460093.720859:0:7760:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc2bd4000, rc 0) 00000100:00100000:0.0:1788460093.720924:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc4397100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+15:12141:x1875336003394816:12345-192.168.206.5@tcp:101:lhsmtool_posix.0 Request processed in 913us (1172us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1788460093.720932:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 150 00000100:00080000:2.0:1788460093.721444:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788460093.725894:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460093.726312:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003394944 00000100:00100000:3.0:1788460093.726321:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003394944 00000100:00100000:3.0:1788460093.726379:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 151 00000100:00100000:3.0:1788460093.726388:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4139180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+15:12141:x1875336003394944:12345-192.168.206.5@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788460093.726493:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4139180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+15:12141:x1875336003394944:12345-192.168.206.5@tcp:59:lhsmtool_posix.0 Request processed in 105us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460093.726501:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 151 00000100:00100000:1.0:1788460093.732924:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460093.733037:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003395072 00000100:00100000:3.0:1788460093.733057:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003395072 00000100:00100000:3.0:1788460093.733141:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 152 00000100:00100000:3.0:1788460093.733153:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac42f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:12141:x1875336003395072:12345-192.168.206.5@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788460093.733259:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac42f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:12141:x1875336003395072:12345-192.168.206.5@tcp:59:lhsmtool_posix.0 Request processed in 108us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460093.733266:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 152 00000100:00100000:3.0:1788460093.733435:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460093.733920:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003395200 00000100:00100000:2.0:1788460093.733926:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003395200 00000100:00100000:2.0:1788460093.734008:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 9 00000100:00100000:2.0:1788460093.734018:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bedf6f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+15:2396:x1875336003395200:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788460093.734041:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460093.734061:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4000/0x5dfa74784542b869 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a7db expref: 15 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460093.734078:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c4bef1fde00) 00010000:00010000:2.0:1788460093.734082:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:3.0:1788460093.734311:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788460093.734366:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bedf6f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+14:2396:x1875336003395200:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 349us (930us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460093.734374:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 9 00010000:00010000:1.0:1788460094.227587:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788460094.227686:0:13811:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788460094.227691:0:13811:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788460094.228293:0:13811:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1788460094.228305:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1788460094.419131:0:13815:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788460094.546824:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788460094.546846:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac42fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022343808:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788460094.546914:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460094.546996:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022343808 00000100:00100000:2.0:1788460094.547017:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022343808 00000100:00100000:2.0:1788460094.547061:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788460094.547070:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4285500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022343808:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788460094.547102:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446453248 avail 1300213760 00000100:00100000:2.0:1788460094.547146:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4285500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022343808:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460094.547153:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788460094.547196:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac42fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022343808:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788460095.057256:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac42f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022343936:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788460095.057321:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460095.057381:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788460095.057388:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4385180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022344064:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788460095.057411:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460095.057449:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022343936 00000100:00100000:1.0:1788460095.057456:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022343936 00000100:00100000:0.0:1788460095.057506:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022344064 00000100:00100000:0.0:1788460095.057511:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022344064 00000100:00100000:1.0:1788460095.068478:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788460095.068492:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac42f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022343936:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788460095.068522:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788460095.068594:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac42f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022343936:12345-0@lo:13:osp-pre-1-1.0 Request processed in 106us (11273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460095.068614:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788460095.068704:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac42f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022343936:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788460095.071527:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4285880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0cf73fe6-82e2-434e-b670-631647721b2c:3659:1875336022344192:0@lo:400:kworker.0 00000100:00100000:2.0:1788460095.071591:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460095.071658:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022344192 00000100:00100000:2.0:1788460095.071665:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022344192 00000100:00100000:0.0:1788460095.071868:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788460095.071878:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4366a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1875336022344064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788460095.071902:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788460095.071963:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4366a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1875336022344064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (14550us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460095.071971:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788460095.072017:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4385180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022344064:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788460095.072479:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 427 00000100:00100000:2.0:1788460095.072488:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+29:3659:x1875336022344192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460095.072538:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+29:3659:x1875336022344192:12345-0@lo:400:kworker.0 Request processed in 52us (947us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460095.072544:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 427 00000100:00100000:2.0:1788460095.072669:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac42fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3660:1875336022344320:0@lo:400:kworker.0 00000100:00100000:0.0:1788460095.072742:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4719180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022344448:0@lo:400:kworker.0 00000100:00100000:0.0:1788460095.072773:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460095.072794:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc5329c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1875336022344960:0@lo:400:kworker.0 00000100:00100000:0.0:1788460095.072813:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460095.072826:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc532ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1875336022345472:0@lo:400:kworker.0 00000100:00100000:0.0:1788460095.072844:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460095.072860:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788460095.072865:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc471a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875336022344576:0@lo:400:kworker.0 00000100:00100000:0.0:1788460095.072884:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460095.072900:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc5329880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022345088:0@lo:400:kworker.0 00000100:00100000:0.0:1788460095.072922:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460095.072967:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022344448 00000100:00100000:0.0:1788460095.072972:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022344448 00000100:00100000:0.0:1788460095.073001:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788460095.073007:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4385180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022344448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460095.073048:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4385180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022344448:12345-0@lo:400:kworker.0 Request processed in 40us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460095.073064:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788460095.073084:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022344960 00000100:00100000:1.0:1788460095.073110:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc471b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022344704:0@lo:400:kworker.0 00000100:00100000:1.0:1788460095.073528:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460095.073558:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc5329f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022345216:0@lo:400:kworker.0 00000100:00100000:1.0:1788460095.073585:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460095.073625:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4285880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0cf73fe6-82e2-434e-b670-631647721b2c:3659:1875336022344192:0@lo:400:kworker.0 00000100:00100000:1.0:1788460095.073666:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022344704 00000100:00100000:1.0:1788460095.073670:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022344704 00000100:00100000:0.0:1788460095.073706:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022344960 00000100:00100000:0.0:1788460095.073745:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022345472 00000100:00100000:0.0:1788460095.073749:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022345472 00000100:00100000:0.0:1788460095.073770:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022344576 00000100:00100000:0.0:1788460095.073774:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022344576 00000100:00100000:0.0:1788460095.073787:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1788460095.073794:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4387100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1875336022344960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460095.073833:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4387100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1875336022344960:12345-0@lo:400:kworker.0 Request processed in 39us (1018us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460095.073839:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1788460095.073852:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1788460095.073858:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4384380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1875336022345472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460095.073885:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4384380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1875336022345472:12345-0@lo:400:kworker.0 Request processed in 28us (1040us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460095.073892:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1788460095.073902:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1788460095.073908:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4387b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1875336022344576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460095.073934:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4387b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1875336022344576:12345-0@lo:400:kworker.0 Request processed in 26us (1049us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460095.073939:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:2.0:1788460095.074246:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460095.074270:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc532a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3660:1875336022344832:0@lo:400:kworker.0 00000100:00100000:2.0:1788460095.074293:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460095.074305:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc5329180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3660:1875336022345344:0@lo:400:kworker.0 00000100:00100000:2.0:1788460095.074342:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460095.074727:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788460095.074739:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4364380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022344704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460095.074786:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4364380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022344704:12345-0@lo:400:kworker.0 Request processed in 51us (1643us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460095.074804:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788460095.074829:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022345088 00000100:00100000:0.0:1788460095.074834:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022345088 00000100:00100000:0.0:1788460095.074860:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022345216 00000100:00100000:0.0:1788460095.074862:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022345216 00000100:00100000:0.0:1788460095.074879:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788460095.074885:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4384000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022345088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460095.074918:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4384000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022345088:12345-0@lo:400:kworker.0 Request processed in 33us (1995us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460095.074924:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788460095.074935:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788460095.074941:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4364000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022345216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460095.074991:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022344320 00000100:00100000:0.0:1788460095.074993:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4364000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022345216:12345-0@lo:400:kworker.0 Request processed in 51us (1406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460095.074998:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022344320 00000100:00100000:0.0:1788460095.075002:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788460095.075022:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022344832 00000100:00100000:0.0:1788460095.075026:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022344832 00000100:00100000:0.0:1788460095.075042:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022345344 00000100:00100000:0.0:1788460095.075044:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022345344 00000100:00100000:0.0:1788460095.075055:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1788460095.075061:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc532f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1875336022344832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460095.075097:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1788460095.075105:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3bc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1875336022345344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460095.075279:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc5329180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3660:1875336022345344:0@lo:400:kworker.0 00000100:00100000:2.0:1788460095.075305:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc532a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3660:1875336022344832:0@lo:400:kworker.0 00000100:00100000:2.0:1788460095.075343:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:2.0:1788460095.075351:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc532ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1875336022344320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460095.075420:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3bc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1875336022345344:12345-0@lo:400:kworker.0 Request processed in 40us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460095.075434:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1788460095.075482:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc471b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022344704:0@lo:400:kworker.0 00000100:00100000:1.0:1788460095.075494:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc5329f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022345216:0@lo:400:kworker.0 00000100:00100000:1.0:1788460095.075523:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc471a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875336022344576:0@lo:400:kworker.0 00000100:00100000:1.0:1788460095.075534:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc5329880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022345088:0@lo:400:kworker.0 00000100:00100000:1.0:1788460095.075544:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4719180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022344448:0@lo:400:kworker.0 00010000:00080000:1.0:1788460095.075557:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bc5329c00 x1875336022344960/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460111 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460095.075567:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc5329c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1875336022344960:0@lo:400:kworker.0 00010000:00080000:1.0:1788460095.075578:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bc532ca80 x1875336022345472/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460111 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460095.075586:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc532ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1875336022345472:0@lo:400:kworker.0 00000100:00080000:3.0:1788460095.075621:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788460095.075627:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788460095.075629:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788460095.075632:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788460095.075712:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc532f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1875336022344832:12345-0@lo:400:kworker.0 Request processed in 649us (1416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460095.075720:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1788460095.075752:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc532ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1875336022344320:12345-0@lo:400:kworker.0 Request processed in 401us (1504us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460095.075761:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1788460095.075984:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac42fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3660:1875336022344320:0@lo:400:kworker.0 00010000:00010000:1.0:1788460095.254083:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460095.423472:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460095.423520:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460095.423557:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460095.423607:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003395840 00000100:00100000:3.0:1788460095.423615:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003395840 00000100:00100000:3.0:1788460095.423674:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 130 00000100:00100000:3.0:1788460095.423684:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2393:x1875336003395840:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:3.0:1788460095.423757:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2393:x1875336003395840:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 75us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460095.423781:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 130 00000100:00080000:3.0:1788460095.423816:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788460095.424544:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003395328 00000100:00100000:2.0:1788460095.424553:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003395328 00000100:00100000:2.0:1788460095.424611:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 428 00000100:00100000:2.0:1788460095.424620:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bed032f6-c389-485e-b2f7-e2ea34763c65+14:2393:x1875336003395328:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:2.0:1788460095.424668:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bed032f6-c389-485e-b2f7-e2ea34763c65+14:2393:x1875336003395328:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 49us (1204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460095.424896:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 428 00000100:00100000:0.0:1788460095.427368:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003395584 00000100:00100000:0.0:1788460095.427381:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003395584 00000100:00100000:0.0:1788460095.427475:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 318 00000100:00100000:0.0:1788460095.427511:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2393:x1875336003395584:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:0.0:1788460095.427608:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2393:x1875336003395584:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 90us (4076us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460095.427617:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 318 00000100:00080000:3.0:1788460095.431383:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788460095.444869:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460095.444904:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460095.444933:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460095.445003:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460095.445030:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003395712 00000100:00100000:0.0:1788460095.445039:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003395712 00000100:00100000:0.0:1788460095.445098:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 131 00000100:00100000:0.0:1788460095.445107:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4385f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:2394:x1875336003395712:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:1.0:1788460095.445281:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003396096 00000100:00100000:1.0:1788460095.445287:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003396096 00000100:00100000:1.0:1788460095.445317:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003395456 00000100:00100000:1.0:1788460095.445320:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003395456 00000100:00100000:1.0:1788460095.445342:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003395968 00000100:00100000:1.0:1788460095.445344:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003395968 00000100:00100000:1.0:1788460095.445358:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 319 00000100:00100000:1.0:1788460095.445364:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4385c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a5915a6d-4114-41fb-8d95-33add86e0720+5:2393:x1875336003396096:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:1.0:1788460095.445429:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4385c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a5915a6d-4114-41fb-8d95-33add86e0720+5:2393:x1875336003396096:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 65us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460095.445437:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 319 00000100:00100000:1.0:1788460095.445452:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 320 00000100:00100000:1.0:1788460095.445458:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4387800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+14:2394:x1875336003395456:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:1.0:1788460095.445479:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4387800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+14:2394:x1875336003395456:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 21us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460095.445484:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 320 00000100:00100000:1.0:1788460095.445493:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 321 00000100:00100000:1.0:1788460095.445499:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4384e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a5915a6d-4114-41fb-8d95-33add86e0720+6:2394:x1875336003395968:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:1.0:1788460095.445518:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4384e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a5915a6d-4114-41fb-8d95-33add86e0720+6:2394:x1875336003395968:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 20us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460095.445524:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 321 00000100:00100000:0.0:1788460095.445584:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4385f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:2394:x1875336003395712:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 478us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460095.445591:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 131 00000100:00080000:3.0:1788460095.445901:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788460095.445905:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788460095.445907:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788460095.724540:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460095.724642:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003396224 00000100:00100000:1.0:1788460095.724653:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003396224 00000100:00100000:1.0:1788460095.724712:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 153 00000100:00100000:1.0:1788460095.724722:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+14:12183:x1875336003396224:12345-192.168.206.5@tcp:101:lfs.0 00010000:00010000:1.0:1788460095.724740:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460095.724766:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676200/0x5dfa74784542b877 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a7e2 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460095.724825:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677c00/0x5dfa74784542b87e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460095.724840:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677c00/0x5dfa74784542b87e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460095.724858:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677c00/0x5dfa74784542b87e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460095.724873:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676c00/0x5dfa74784542b885 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460095.724881:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676c00/0x5dfa74784542b885 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460095.724887:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676c00/0x5dfa74784542b885 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460095.724926:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677c00/0x5dfa74784542b87e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460095.724934:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677c00/0x5dfa74784542b87e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460095.724940:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677c00/0x5dfa74784542b87e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460095.724972:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac3677c00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:1.0:1788460095.724976:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677c00/0x5dfa74784542b87e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460095.724984:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677c00/0x5dfa74784542b87e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460095.724994:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4bc5dc1900) 00010000:00010000:1.0:1788460095.724997:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788460095.725002:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677c00/0x5dfa74784542b87e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460095.725015:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677c00/0x5dfa74784542b87e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460095.725025:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676c00/0x5dfa74784542b885 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460095.725031:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676c00/0x5dfa74784542b885 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460095.725037:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676c00/0x5dfa74784542b885 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460095.725041:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac3676c00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:1.0:1788460095.725044:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676c00/0x5dfa74784542b885 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460095.725050:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676c00/0x5dfa74784542b885 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460095.725057:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8c4bc2ab7200) 00010000:00010000:1.0:1788460095.725060:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788460095.725063:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676c00/0x5dfa74784542b885 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460095.725068:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676c00/0x5dfa74784542b885 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460095.725095:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676200/0x5dfa74784542b877 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a7e2 expref: 15 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460095.725117:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4bc5dc1900) 00010000:00010000:1.0:1788460095.725120:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788460095.725124:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676200/0x5dfa74784542b877 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a7e2 expref: 15 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460095.725133:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ac3676200, rc 0) 00000100:00100000:1.0:1788460095.725195:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+14:12183:x1875336003396224:12345-192.168.206.5@tcp:101:lfs.0 Request processed in 474us (663us total) trans 0 rc 301/301 00000100:00100000:1.0:1788460095.725203:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 153 00000100:00100000:3.0:1788460095.732690:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460095.732782:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003396480 00000100:00100000:0.0:1788460095.732792:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003396480 00000100:00100000:0.0:1788460095.732853:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 154 00000100:00100000:0.0:1788460095.732864:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+14:12183:x1875336003396480:12345-192.168.206.5@tcp:36:lfs.0 00010000:00010000:0.0:1788460095.732915:0:6534:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788460095.732939:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d1e00/0x5dfa74784542b1cb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a606 expref: 14 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460095.732985:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4bc5dc1900) 00010000:00010000:0.0:1788460095.732989:0:6534:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788460095.733057:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542b88c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460095.733081:0:6534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4600/0x5dfa74784542b84d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a7d4 expref: 5 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460095.733089:0:6534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542b88c lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460095.733120:0:6534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4600/0x5dfa74784542b84d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a7d4 expref: 5 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460095.733133:0:6534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4600/0x5dfa74784542b84d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a7d4 expref: 5 pid: 6533 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460095.733146:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4386a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6534:1875336022345600:192.168.206.5@tcp:104: 00000100:00100000:0.0:1788460095.733227:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bd47b9240 going to sleep for 11 seconds 00000100:00100000:0.0:1788460095.735462:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4386a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6534:1875336022345600:192.168.206.5@tcp:104: 00010000:00010000:0.0:1788460095.735489:0:6534:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542b88c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460095.736304:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460095.738578:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003396608 00000100:00100000:1.0:1788460095.738589:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003396608 00010000:00010000:1.0:1788460095.738647:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4600/0x5dfa74784542b84d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a7d4 expref: 6 pid: 6533 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460095.738737:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 88 00000100:00100000:1.0:1788460095.738747:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc6760a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5915a6d-4114-41fb-8d95-33add86e0720+6:2393:x1875336003396608:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788460095.738770:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788460095.738777:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4600/0x5dfa74784542b84d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a7d4 expref: 6 pid: 6533 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460095.738789:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4600/0x5dfa74784542b84d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a7d4 expref: 6 pid: 6533 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460095.738810:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4600/0x5dfa74784542b84d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a7d4 expref: 6 pid: 6533 timeout: 492 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460095.738838:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4bc5dc1900) 00010000:00010000:1.0:1788460095.738844:0:6520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542b88c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460095.738853:0:6520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542b88c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460095.738861:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542b88c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460095.738886:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788460095.738937:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc6760a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a5915a6d-4114-41fb-8d95-33add86e0720+5:2393:x1875336003396608:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 191us (2636us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460095.738964:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 88 00010000:00010000:0.0:1788460095.739721:0:6534:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542b88c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460095.739732:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542b88c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460095.739764:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4800/0x5dfa74784542b893 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460095.739775:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4800/0x5dfa74784542b893 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460095.739792:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4800/0x5dfa74784542b893 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460095.740304:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542b89a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460095.740315:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542b89a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460095.740323:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542b89a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788460095.740337:0:6534:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000616ca6dd reply state 00000000d64b31b0 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542b89a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460095.740347:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542b89a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460095.740354:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8c4bc5dc1500) 00010000:00010000:0.0:1788460095.740356:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788460095.740359:0:6534:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788460095.740365:0:6534:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1788460095.740370:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542b88c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460095.740376:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542b88c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460095.740383:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542b88c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460095.740389:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc2bd4e00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460095.740399:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542b88c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460095.740406:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542b88c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460095.740416:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4bc5dc1900) 00010000:00010000:0.0:1788460095.741253:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460095.741263:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542b88c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460095.741283:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542b88c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788460095.741306:0:6534:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000616ca6dd reply state 00000000d64b31b0 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4800/0x5dfa74784542b893 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460095.741316:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4800/0x5dfa74784542b893 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460095.741323:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8c4bc5dc1b00) 00010000:00010000:0.0:1788460095.741326:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788460095.741328:0:6534:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1788460095.741408:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+15:12183:x1875336003396480:12345-192.168.206.5@tcp:36:lfs.0 Request processed in 8543us (8724us total) trans 4294967418 rc 0/0 00000100:00100000:0.0:1788460095.741416:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 154 00000100:00100000:3.0:1788460095.881150:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460095.881368:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003396736 00000100:00100000:2.0:1788460095.881378:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003396736 00000100:00100000:2.0:1788460095.881441:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 155 00000100:00100000:2.0:1788460095.881451:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc6763b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+15:12191:x1875336003396736:12345-192.168.206.5@tcp:101:lctl.0 00010000:00010000:2.0:1788460095.881493:0:7760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460095.881516:0:7760:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b8a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a7e9 expref: -99 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460095.881587:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6800/0x5dfa74784542b8a8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460095.881611:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6800/0x5dfa74784542b8a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460095.881623:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6800/0x5dfa74784542b8a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788460095.881668:0:7760:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788460095.881671:0:7760:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788460095.881692:0:7760:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6800/0x5dfa74784542b8a8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460095.881717:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b8a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a7e9 expref: 17 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460095.881733:0:7760:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6800/0x5dfa74784542b8a8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a7e9 expref: 16 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460095.881760:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4bfa9fec00) 00010000:00010000:2.0:1788460095.881763:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788460095.881767:0:7760:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bfadc6800, rc 0) 00000100:00100000:2.0:1788460095.881825:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc6763b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+16:12191:x1875336003396736:12345-192.168.206.5@tcp:101:lctl.0 Request processed in 375us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460095.881833:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 155 00000100:00100000:0.0:1788460095.956408:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460095.956517:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003396864 00000100:00100000:2.0:1788460095.956534:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003396864 00000100:00100000:2.0:1788460095.956603:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 156 00000100:00100000:2.0:1788460095.956614:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4386a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+16:12197:x1875336003396864:12345-192.168.206.5@tcp:101:bash.0 00010000:00010000:2.0:1788460095.956634:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460095.956654:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b8af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a7f0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460095.956713:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542b8b6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460095.956728:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542b8b6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460095.956740:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542b8b6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460095.956752:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b8bd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460095.956759:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b8bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460095.956784:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b8bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460095.956874:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b8c4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460095.956883:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b8c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460095.956890:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b8c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788460095.956924:0:6535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1788460095.956929:0:6535:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788460095.957005:0:6535:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b8c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460095.957019:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542b8b6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460095.957026:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542b8b6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460095.957033:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542b8b6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460095.957039:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bfadc7800 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:2.0:1788460095.957043:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542b8b6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460095.957050:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542b8b6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460095.957070:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4bfa9fec00) 00010000:00010000:2.0:1788460095.957073:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460095.957079:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542b8b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460095.957085:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542b8b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460095.957097:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b8bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460095.957104:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b8bd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460095.957110:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b8bd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460095.957115:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bfadc7200 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:2.0:1788460095.957129:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b8bd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460095.957136:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b8bd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460095.957144:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8c4bc5dc1b00) 00010000:00010000:2.0:1788460095.957146:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460095.957149:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b8bd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460095.957155:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542b8bd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460095.957193:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542b8af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a7f0 expref: 18 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460095.957207:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b8c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a7f0 expref: 17 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460095.957214:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8c4bc5dc1500) 00010000:00010000:2.0:1788460095.957216:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788460095.957218:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bfadc6400, rc 0) 00000100:00100000:2.0:1788460095.957275:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4386a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+17:12197:x1875336003396864:12345-192.168.206.5@tcp:101:bash.0 Request processed in 663us (874us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460095.957283:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 156 00000100:00100000:2.0:1788460095.962138:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460095.962273:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003397120 00000100:00100000:0.0:1788460095.962283:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003397120 00000100:00100000:0.0:1788460095.962341:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 157 00000100:00100000:0.0:1788460095.962351:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3bc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+17:12197:x1875336003397120:12345-192.168.206.5@tcp:101:bash.0 00010000:00010000:0.0:1788460095.962386:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460095.962404:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542b8cb lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a7f7 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460095.962506:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5a00/0x5dfa74784542b8d2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460095.962528:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5a00/0x5dfa74784542b8d2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460095.962539:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5a00/0x5dfa74784542b8d2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460095.962552:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4600/0x5dfa74784542b8d9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460095.962560:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4600/0x5dfa74784542b8d9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460095.962567:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4600/0x5dfa74784542b8d9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788460095.962864:0:6534:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:0.0:1788460095.963035:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b8e0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460095.963043:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b8e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460095.963050:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b8e0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460095.963095:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5a00/0x5dfa74784542b8d2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460095.963102:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5a00/0x5dfa74784542b8d2 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460095.963108:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5a00/0x5dfa74784542b8d2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460095.963113:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc2bd5a00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460095.963337:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5a00/0x5dfa74784542b8d2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460095.963348:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5a00/0x5dfa74784542b8d2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460095.963360:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8c4bc5dc1500) 00010000:00010000:0.0:1788460095.963363:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460095.963368:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5a00/0x5dfa74784542b8d2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460095.963374:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5a00/0x5dfa74784542b8d2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788460095.963386:0:6534:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000820ecfd8 reply state 00000000e23e7c7a transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4600/0x5dfa74784542b8d9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460095.963395:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4600/0x5dfa74784542b8d9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460095.963401:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8c4bc5dc1900) 00010000:00010000:0.0:1788460095.963409:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788460095.963412:0:6534:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788460095.963444:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542b8cb lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a7f7 expref: 20 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460095.963459:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b8e0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a7f7 expref: 19 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460095.963465:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4bc5dc1e00) 00010000:00010000:0.0:1788460095.963467:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788460095.963469:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc2bd4200, rc 0) 00000100:00100000:0.0:1788460095.963748:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3bc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+20:12197:x1875336003397120:12345-192.168.206.5@tcp:101:bash.0 Request processed in 1397us (1628us total) trans 4294967419 rc 0/0 00000100:00100000:0.0:1788460095.963756:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 157 00000100:00100000:0.0:1788460095.968775:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460095.969042:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003397248 00000100:00100000:1.0:1788460095.969051:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003397248 00000100:00100000:1.0:1788460095.969108:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 55 00000100:00100000:1.0:1788460095.969363:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4384700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2393:x1875336003397248:12345-192.168.206.5@tcp:101:bash.0 00010000:00010000:1.0:1788460095.969382:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460095.969401:0:8448:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000073d30515/0x5dfa74784542b8ee lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a7fe expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788460095.969423:0:8448:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788460095.969441:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=393s v=(0 0) 00010000:00010000:1.0:1788460095.969445:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460095.969454:0:8448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073d30515/0x5dfa74784542b8ee lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a7fe expref: 6 pid: 8448 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460095.969499:0:8448:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000073d30515/0x5dfa74784542b8ee lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a7fe expref: 6 pid: 8448 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460095.969512:0:8448:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ac3676c00, rc 0) 00000100:00100000:1.0:1788460095.969674:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4384700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:2393:x1875336003397248:12345-192.168.206.5@tcp:101:bash.0 Request processed in 556us (907us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460095.969682:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 55 00000100:00100000:1.0:1788460095.974226:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460095.974310:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003397376 00000100:00100000:0.0:1788460095.974320:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003397376 00000100:00100000:0.0:1788460095.974398:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 56 00000100:00100000:0.0:1788460095.974407:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4365c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:12197:x1875336003397376:12345-192.168.206.5@tcp:101:bash.0 00010000:00010000:0.0:1788460095.974425:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460095.974441:0:8449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000586a5fad/0x5dfa74784542b8f5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a805 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460095.974468:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000073d30515/0x5dfa74784542b8ee lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a7fe expref: 7 pid: 8448 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460095.974478:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460095.974492:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460095.974507:0:8449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000586a5fad/0x5dfa74784542b8f5 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a805 expref: 7 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460095.974545:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000073d30515/0x5dfa74784542b8ee lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a7fe expref: 7 pid: 8448 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460095.974559:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000073d30515/0x5dfa74784542b8ee lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a7fe expref: 7 pid: 8448 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460095.974573:0:8449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4386680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1875336022345728:192.168.206.5@tcp:104: 00000100:00100000:0.0:1788460095.974661:0:8449:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bd47b96c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788460095.977392:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460095.977667:0:8449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4386680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8449:1875336022345728:192.168.206.5@tcp:104: 00010000:00010000:0.0:1788460095.977701:0:8449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000586a5fad/0x5dfa74784542b8f5 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a805 expref: 7 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460095.977721:0:8449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc2bd5600, rc 0) 00000100:00100000:0.0:1788460095.977779:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4365c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+7:12197:x1875336003397376:12345-192.168.206.5@tcp:101:bash.0 Request processed in 3372us (3560us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460095.977788:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 56 00000100:00100000:3.0:1788460095.977991:0:9549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003397504 00000100:00100000:3.0:1788460095.977997:0:9549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003397504 00010000:00010000:3.0:1788460095.978023:0:9549:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000073d30515/0x5dfa74784542b8ee lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a7fe expref: 7 pid: 8448 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460095.978050:0:9549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 89 00000100:00100000:3.0:1788460095.978057:0:9549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3bc2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+7:2394:x1875336003397504:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788460095.978068:0:9549:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788460095.978086:0:9549:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000073d30515/0x5dfa74784542b8ee lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a7fe expref: 7 pid: 8448 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460095.978098:0:9549:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000073d30515/0x5dfa74784542b8ee lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a7fe expref: 7 pid: 8448 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460095.978131:0:9549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000073d30515/0x5dfa74784542b8ee lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a7fe expref: 7 pid: 8448 timeout: 493 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460095.978164:0:9549:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788460095.978168:0:9549:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788460095.978176:0:9549:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000586a5fad/0x5dfa74784542b8f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a805 expref: 6 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460095.978187:0:9549:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000586a5fad/0x5dfa74784542b8f5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a805 expref: 6 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460095.978217:0:9549:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000586a5fad/0x5dfa74784542b8f5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a805 expref: 6 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460095.978230:0:9549:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc6761c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9549:1875336022345856:192.168.206.5@tcp:105: 00000100:00100000:3.0:1788460095.978281:0:9549:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4be03290c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788460095.981411:0:9549:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc6761c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9549:1875336022345856:192.168.206.5@tcp:105: 00010000:00010000:3.0:1788460095.981435:0:9549:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788460095.981497:0:9549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3bc2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:2394:x1875336003397504:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 3439us (4112us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460095.981507:0:9549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 89 00000100:00100000:3.0:1788460095.984842:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460095.984934:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003397760 00000100:00100000:2.0:1788460095.984987:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003397760 00000100:00100000:2.0:1788460095.985036:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 36 00000100:00100000:2.0:1788460095.985045:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc6761c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+20:12197:x1875336003397760:12345-192.168.206.5@tcp:35:bash.0 00000100:00100000:2.0:1788460095.985316:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc6761c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+21:12197:x1875336003397760:12345-192.168.206.5@tcp:35:bash.0 Request processed in 271us (480us total) trans 4294967420 rc 0/0 00000100:00100000:2.0:1788460095.985323:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 36 00000100:00100000:2.0:1788460096.104812:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460096.104903:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003398016 00000100:00100000:1.0:1788460096.104913:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003398016 00000100:00100000:1.0:1788460096.105000:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 158 00000100:00100000:1.0:1788460096.105011:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3bc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+21:12207:x1875336003398016:12345-192.168.206.5@tcp:101:lfs.0 00010000:00010000:1.0:1788460096.105034:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460096.105053:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677800/0x5dfa74784542b8fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a80c expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788460096.105148:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1788460096.105240:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677800/0x5dfa74784542b8fc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a80c expref: 23 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460096.105254:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4bfa9fec00) 00010000:00010000:1.0:1788460096.105257:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788460096.105262:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677800/0x5dfa74784542b8fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a80c expref: 23 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460096.105293:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ac3677800, rc 0) 00000100:00100000:1.0:1788460096.105356:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3bc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+22:12207:x1875336003398016:12345-192.168.206.5@tcp:101:lfs.0 Request processed in 347us (552us total) trans 4294967421 rc 301/301 00000100:00100000:1.0:1788460096.105363:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 158 00000100:00100000:1.0:1788460096.109914:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460096.110109:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003398272 00000100:00100000:0.0:1788460096.110129:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003398272 00000100:00100000:0.0:1788460096.110180:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 37 00000100:00100000:0.0:1788460096.110190:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4364a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+22:12207:x1875336003398272:12345-192.168.206.5@tcp:35:lfs.0 00000100:00100000:0.0:1788460096.110400:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4364a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+23:12207:x1875336003398272:12345-192.168.206.5@tcp:35:lfs.0 Request processed in 211us (494us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1788460096.110426:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 37 00000100:00100000:3.0:1788460096.192800:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460096.192990:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003398400 00000100:00100000:0.0:1788460096.192999:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003398400 00000100:00100000:0.0:1788460096.193059:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 159 00000100:00100000:0.0:1788460096.193069:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc6761f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+23:12213:x1875336003398400:12345-192.168.206.5@tcp:101:lfs.0 00010000:00010000:0.0:1788460096.193091:0:13560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460096.193110:0:13560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542b90a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a813 expref: -99 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.193177:0:13560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5a00/0x5dfa74784542b911 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.193191:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5a00/0x5dfa74784542b911 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.193203:0:13560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5a00/0x5dfa74784542b911 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788460096.193243:0:13560:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1788460096.193247:0:13560:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788460096.193264:0:13560:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5a00/0x5dfa74784542b911 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.193289:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542b90a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a813 expref: 25 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.193308:0:13560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5a00/0x5dfa74784542b911 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a813 expref: 24 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.193336:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8c4bc5dc1500) 00010000:00010000:0.0:1788460096.193339:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788460096.193343:0:13560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc2bd5a00, rc 0) 00000100:00100000:0.0:1788460096.193393:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc6761f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+24:12213:x1875336003398400:12345-192.168.206.5@tcp:101:lfs.0 Request processed in 325us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460096.193400:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 159 00000100:00100000:1.0:1788460096.197092:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460096.197334:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003398656 00000100:00100000:0.0:1788460096.197343:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003398656 00000100:00100000:0.0:1788460096.197444:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 160 00000100:00100000:0.0:1788460096.197455:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4367480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+24:12213:x1875336003398656:12345-192.168.206.5@tcp:101:lfs.0 00010000:00010000:0.0:1788460096.197474:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460096.197493:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4000/0x5dfa74784542b918 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a81a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.197613:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5400/0x5dfa74784542b91f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.197628:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5400/0x5dfa74784542b91f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.197639:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5400/0x5dfa74784542b91f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788460096.197650:0:6534:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788460096.197820:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4000/0x5dfa74784542b918 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a81a expref: 27 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.197856:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5400/0x5dfa74784542b91f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a81a expref: 26 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.197864:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4bc5dc1e00) 00010000:00010000:0.0:1788460096.197867:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788460096.197870:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc2bd5400, rc 0) 00000100:00100000:0.0:1788460096.197977:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4367480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+26:12213:x1875336003398656:12345-192.168.206.5@tcp:101:lfs.0 Request processed in 491us (863us total) trans 4294967423 rc 0/0 00000100:00100000:0.0:1788460096.197986:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 160 00000100:00100000:1.0:1788460096.203561:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460096.203703:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460096.204133:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003399040 00000100:00100000:0.0:1788460096.204144:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003399040 00000100:00100000:0.0:1788460096.204201:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 161 00000100:00100000:2.0:1788460096.204202:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003398784 00000100:00100000:2.0:1788460096.204207:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003398784 00000100:00100000:0.0:1788460096.204222:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4365180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+27:12213:x1875336003399040:12345-192.168.206.5@tcp:101:lfs.0 00010000:00010000:0.0:1788460096.204242:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1788460096.204251:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 10 00000100:00100000:2.0:1788460096.204258:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4365f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+27:2395:x1875336003398784:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788460096.204260:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542b92d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a821 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460096.204281:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460096.204298:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5400/0x5dfa74784542b91f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a81a expref: 28 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460096.204314:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4bc5dc1e00) 00010000:00010000:2.0:1788460096.204318:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788460096.204349:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4a00/0x5dfa74784542b934 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460096.204362:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4365f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+27:2395:x1875336003398784:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 105us (811us total) trans 0 rc 0/0 00010000:00010000:0.0:1788460096.204362:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4a00/0x5dfa74784542b934 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460096.204369:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 10 00010000:00010000:0.0:1788460096.204372:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4a00/0x5dfa74784542b934 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788460096.204382:0:6535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788460096.204490:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542b92d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a821 expref: 28 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.204503:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4a00/0x5dfa74784542b934 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a821 expref: 27 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.204511:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4bc5dc1e00) 00010000:00010000:0.0:1788460096.204513:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788460096.204527:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc2bd4a00, rc 0) 00000100:00100000:0.0:1788460096.204554:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4365180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+27:12213:x1875336003399040:12345-192.168.206.5@tcp:101:lfs.0 Request processed in 344us (851us total) trans 4294967424 rc 0/0 00000100:00100000:0.0:1788460096.204560:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 161 00000001:00080000:2.0:1788460096.204611:0:6513:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967423 is committed 00010000:00010000:0.0:1788460096.205261:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4800/0x5dfa74784542b893 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.205270:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4800/0x5dfa74784542b893 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.205277:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4800/0x5dfa74784542b893 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.205282:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc2bd4800 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460096.205286:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4800/0x5dfa74784542b893 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.205294:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4800/0x5dfa74784542b893 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.205304:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8c4bc5dc1b00) 00010000:00010000:0.0:1788460096.205307:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460096.205320:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4800/0x5dfa74784542b893 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.205326:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4800/0x5dfa74784542b893 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.205342:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542b89a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.205349:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542b89a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.205354:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542b89a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.205359:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc2bd4c00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460096.205361:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542b89a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.205366:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542b89a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.205374:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8c4bc5dc1500) 00010000:00010000:0.0:1788460096.205376:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460096.205379:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542b89a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.205383:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542b89a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.205395:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4600/0x5dfa74784542b8d9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.205400:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4600/0x5dfa74784542b8d9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.205411:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4600/0x5dfa74784542b8d9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.205416:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc2bd4600 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460096.205418:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4600/0x5dfa74784542b8d9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.205423:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4600/0x5dfa74784542b8d9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.205430:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8c4bc5dc1900) 00010000:00010000:0.0:1788460096.205432:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460096.205435:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4600/0x5dfa74784542b8d9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.205440:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4600/0x5dfa74784542b8d9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460096.211860:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460096.211991:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003399168 00000100:00100000:3.0:1788460096.212005:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003399168 00000100:00100000:3.0:1788460096.212063:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 57 00000100:00100000:3.0:1788460096.212072:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:2394:x1875336003399168:12345-192.168.206.5@tcp:1:lfs.0 00010000:00010000:3.0:1788460096.212128:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da3e90b4/0x5dfa74784542b942 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460096.212147:0:8450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000586a5fad/0x5dfa74784542b8f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a805 expref: 6 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460096.212155:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788460096.212160:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788460096.212164:0:8450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da3e90b4/0x5dfa74784542b942 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460096.212200:0:8450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000586a5fad/0x5dfa74784542b8f5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a805 expref: 6 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460096.212226:0:8450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000586a5fad/0x5dfa74784542b8f5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a805 expref: 6 pid: 8449 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460096.212240:0:8450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc6762a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8450:1875336022345984:192.168.206.5@tcp:104: 00000100:00100000:3.0:1788460096.212332:0:8450:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4be03290c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788460096.215906:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460096.215981:0:8450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc6762a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8450:1875336022345984:192.168.206.5@tcp:104: 00010000:00010000:3.0:1788460096.216007:0:8450:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000da3e90b4/0x5dfa74784542b942 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460096.216133:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003399296 00000100:00100000:2.0:1788460096.216140:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003399296 00002000:00100000:2.0:1788460096.216277:0:8454:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff8c4ac4366d80 x1875336003399296/t0(0) o4->f8767d3e-bfef-4d3d-8163-ef8ae18a3514@192.168.206.5@tcp:252/0 lens 504/0 e 0 to 0 dl 1788460107 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788460096.216287:0:8454:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c4ac4366d80 with x1875336003399296 ext(0->12) 00010000:00010000:2.0:1788460096.216296:0:8454:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000586a5fad/0x5dfa74784542b8f5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a805 expref: 7 pid: 8449 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460096.216310:0:8454:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000586a5fad/0x5dfa74784542b8f5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a805 expref: 7 pid: 8449 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788460096.216318:0:8454:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8c4ac4366d80 00000100:00100000:2.0:1788460096.216352:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 2 00000100:00100000:2.0:1788460096.216362:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4366d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+7:2394:x1875336003399296:12345-192.168.206.5@tcp:4:lfs.0 00000100:00100000:2.0:1788460096.217358:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4366d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+9:2394:x1875336003399296:12345-192.168.206.5@tcp:4:lfs.0 Request processed in 993us (1458us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788460096.217379:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 2 00002000:00100000:2.0:1788460096.217391:0:8454:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff8c4ac4366d80 x1875336003399296/t4294967306(0) o4->f8767d3e-bfef-4d3d-8163-ef8ae18a3514@192.168.206.5@tcp:252/0 lens 504/448 e 0 to 0 dl 1788460107 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788460096.217401:0:8454:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c4ac4366d80 with x1875336003399296 ext(0->12) 00010000:00010000:2.0:1788460096.217415:0:8454:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000586a5fad/0x5dfa74784542b8f5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a805 expref: 9 pid: 8449 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460096.217431:0:8454:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000586a5fad/0x5dfa74784542b8f5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a805 expref: 9 pid: 8449 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788460096.217439:0:8454:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8c4ac4366d80 00000100:00100000:2.0:1788460096.221354:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460096.221554:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003399424 00000100:00100000:1.0:1788460096.221564:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003399424 00010000:00010000:1.0:1788460096.221615:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000586a5fad/0x5dfa74784542b8f5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a805 expref: 9 pid: 8449 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460096.221658:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 90 00000100:00100000:1.0:1788460096.221669:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3bc1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+9:2396:x1875336003399424:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788460096.221682:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788460096.221699:0:6520:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788460096.221702:0:6520:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788460094 00002000:00010000:1.0:1788460096.221705:0:6520:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788460095 00002000:00010000:1.0:1788460096.221707:0:6520:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1788460094 00002000:00010000:1.0:1788460096.221709:0:6520:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1788460096.221715:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000586a5fad/0x5dfa74784542b8f5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a805 expref: 9 pid: 8449 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460096.221748:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000586a5fad/0x5dfa74784542b8f5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a805 expref: 9 pid: 8449 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460096.221770:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000586a5fad/0x5dfa74784542b8f5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a805 expref: 9 pid: 8449 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460096.221786:0:6520:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788460096.221790:0:6520:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788460096.221796:0:6520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000da3e90b4/0x5dfa74784542b942 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460096.221806:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da3e90b4/0x5dfa74784542b942 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460096.221841:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788460096.221906:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3bc1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+8:2396:x1875336003399424:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 239us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460096.221914:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 90 00010000:00010000:3.0:1788460096.222298:0:8450:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000da3e90b4/0x5dfa74784542b942 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460096.222322:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000da3e90b4/0x5dfa74784542b942 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460096.222343:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000da3e90b4/0x5dfa74784542b942 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460096.222352:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000da3e90b4/0x5dfa74784542b942 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460096.222417:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000da3e90b4/0x5dfa74784542b942 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460096.222425:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bef208c00 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:3.0:1788460096.222429:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000da3e90b4/0x5dfa74784542b942 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460096.222437:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000da3e90b4/0x5dfa74784542b942 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460096.222451:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000da3e90b4/0x5dfa74784542b942 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460096.222459:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000da3e90b4/0x5dfa74784542b942 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460096.222532:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+7:2394:x1875336003399168:12345-192.168.206.5@tcp:1:lfs.0 Request processed in 10460us (10680us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460096.222540:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 57 00000100:00100000:2.0:1788460096.230209:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460096.230346:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003399680 00000100:00100000:0.0:1788460096.230354:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003399680 00000100:00100000:0.0:1788460096.230412:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 38 00000100:00100000:0.0:1788460096.230422:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc6be2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+18:12213:x1875336003399680:12345-192.168.206.5@tcp:35:lfs.0 00000004:00010000:0.0:1788460096.230478:0:6537:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4a00/0x5dfa74784542b934 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a821 expref: 18 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788460096.230678:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:0.0:1788460096.230712:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1788460096.232461:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:0.0:1788460096.232527:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542b949 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.232558:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b8e0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a7f7 expref: 22 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.232567:0:6537:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542b949 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.232618:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b8e0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a7f7 expref: 22 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.232633:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b8e0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a7f7 expref: 22 pid: 6534 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460096.232647:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4386680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6537:1875336022346112:192.168.206.5@tcp:104: 00000100:00100000:0.0:1788460096.232789:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bd47b9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788460096.236818:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460096.237337:0:9549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003399808 00000100:00100000:3.0:1788460096.237349:0:9549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003399808 00010000:00010000:3.0:1788460096.237392:0:9549:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b8e0 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a7f7 expref: 23 pid: 6534 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460096.237484:0:9549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 91 00000100:00100000:3.0:1788460096.237496:0:9549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3bc1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+23:2394:x1875336003399808:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788460096.237512:0:9549:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788460096.237519:0:9549:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b8e0 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a7f7 expref: 23 pid: 6534 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460096.237532:0:9549:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b8e0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a7f7 expref: 23 pid: 6534 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460096.237553:0:9549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4bc5dc1e00) 00010000:00010000:3.0:1788460096.237559:0:9549:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542b949 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460096.237568:0:9549:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542b949 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460096.237575:0:9549:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542b949 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460096.237621:0:9549:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788460096.237673:0:9549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3bc1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+23:2394:x1875336003399808:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 180us (874us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460096.237680:0:9549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 91 00010000:00010000:0.0:1788460096.241120:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b8e0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a7f7 expref: 22 pid: 6534 timeout: 493 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460096.241148:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4386680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6537:1875336022346112:192.168.206.5@tcp:104: 00010000:00010000:0.0:1788460096.241175:0:6537:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542b949 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.241185:0:6537:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542b949 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.241191:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542b949 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788460096.241296:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:0.0:1788460096.241413:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:0.0:1788460096.241501:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4386680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6537:1875336022346240:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788460096.241560:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460096.241612:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bd47b99c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788460096.242067:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022346240 00000100:00100000:2.0:1788460096.242074:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022346240 00000100:00100000:2.0:1788460096.242140:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788460096.242149:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4386300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6537:x1875336022346240:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788460096.242233:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4386300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6537:x1875336022346240:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 85us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460096.242241:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788460096.242465:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4386680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6537:1875336022346240:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788460096.242575:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:0.0:1788460096.242633:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4386680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6537:1875336022346368:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788460096.242661:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460096.242678:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bd47b9c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788460096.242724:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022346368 00000100:00100000:1.0:1788460096.242729:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022346368 00000100:00100000:1.0:1788460096.242760:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788460096.242766:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4387480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6537:x1875336022346368:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788460096.242875:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4387480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6537:x1875336022346368:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 109us (213us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1788460096.242882:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788460096.242981:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4386680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6537:1875336022346368:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788460096.243020:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:3.0:1788460096.243052:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542b949 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460096.243063:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542b949 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460096.243070:0:6537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542b949 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460096.243076:0:6537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc2bd4c00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:3.0:1788460096.243080:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542b949 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460096.243087:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542b949 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460096.243102:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4bc5dc1e00) 00010000:00010000:3.0:1788460096.243105:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788460096.243110:0:6537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542b949 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460096.243117:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542b949 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788460096.243209:0:6537:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788460096.243264:0:6537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:3.0:1788460096.243275:0:6537:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 393346330306ns, next at 394346327519ns, rc = 0 00000001:00080000:3.0:1788460096.243281:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:3.0:1788460096.243301:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4bc5dc1e00) 00010000:00010000:3.0:1788460096.243304:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788460096.243311:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4a00/0x5dfa74784542b934 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a821 expref: 26 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460096.243391:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc6be2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+25:12213:x1875336003399680:12345-192.168.206.5@tcp:35:lfs.0 Request processed in 12970us (13190us total) trans 4294967433 rc 0/0 00000100:00100000:3.0:1788460096.243398:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 38 00000020:00080000:3.0:1788460096.243402:0:6537:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788460096.245782:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460096.245933:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003399936 00000100:00100000:0.0:1788460096.245983:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003399936 00000100:00100000:0.0:1788460096.246030:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 162 00000100:00100000:0.0:1788460096.246039:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+25:12213:x1875336003399936:12345-192.168.206.5@tcp:101:lfs.0 00010000:00010000:0.0:1788460096.246061:0:7760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460096.246081:0:7760:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4800/0x5dfa74784542b950 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a828 expref: -99 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.246146:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4800/0x5dfa74784542b950 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a828 expref: 26 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.246160:0:7760:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4800/0x5dfa74784542b950 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a828 expref: 26 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.246178:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4bc5dc1900) 00010000:00010000:0.0:1788460096.246181:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788460096.246185:0:7760:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc2bd4800, rc 0) 00000100:00100000:0.0:1788460096.246244:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+26:12213:x1875336003399936:12345-192.168.206.5@tcp:101:lfs.0 Request processed in 206us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460096.246264:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 162 00000100:00100000:1.0:1788460096.254054:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460096.254152:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003400192 00000100:00100000:3.0:1788460096.254161:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003400192 00000100:00100000:3.0:1788460096.254208:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 39 00000100:00100000:3.0:1788460096.254217:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4367800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+26:12213:x1875336003400192:12345-192.168.206.5@tcp:35:lfs.0 00000100:00100000:3.0:1788460096.254451:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4367800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+27:12213:x1875336003400192:12345-192.168.206.5@tcp:35:lfs.0 Request processed in 234us (407us total) trans 4294967434 rc 0/0 00000100:00100000:3.0:1788460096.254459:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 39 00010000:00010000:0.0:1788460096.273708:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788460096.425808:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460096.425907:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003400448 00000100:00100000:0.0:1788460096.425916:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003400448 00000100:00100000:0.0:1788460096.426006:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 163 00000100:00100000:0.0:1788460096.426017:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3bc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+27:12223:x1875336003400448:12345-192.168.206.5@tcp:101:lfs.0 00010000:00010000:0.0:1788460096.426040:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460096.426059:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b957 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a82f expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788460096.426182:0:6534:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1788460096.426284:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b957 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a82f expref: 29 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.426298:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4bfa9fec00) 00010000:00010000:0.0:1788460096.426300:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788460096.426306:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b957 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a82f expref: 29 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.426319:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc2bd4200, rc 0) 00000100:00100000:0.0:1788460096.426362:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3bc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+28:12223:x1875336003400448:12345-192.168.206.5@tcp:101:lfs.0 Request processed in 348us (564us total) trans 4294967435 rc 301/301 00000100:00100000:0.0:1788460096.426369:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 163 00000100:00100000:2.0:1788460096.438609:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460096.438709:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003400576 00000100:00100000:0.0:1788460096.438719:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003400576 00000100:00100000:0.0:1788460096.438778:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 164 00000100:00100000:0.0:1788460096.438789:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3bc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+28:12223:x1875336003400576:12345-192.168.206.5@tcp:34:lfs.0 00010000:00010000:0.0:1788460096.438873:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b965 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.438890:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b965 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.438902:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b965 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.438916:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542b96c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.438924:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542b96c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.438931:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542b96c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.439022:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4000/0x5dfa74784542b973 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.439030:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4000/0x5dfa74784542b973 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.439038:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4000/0x5dfa74784542b973 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788460096.439080:0:6535:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4000/0x5dfa74784542b973 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.439091:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b965 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.439109:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b965 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.439115:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b965 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.439120:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc2bd4200 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460096.439123:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b965 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.439130:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b965 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.439140:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8c4bc5dc1500) 00010000:00010000:0.0:1788460096.439143:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460096.439147:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b965 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.439152:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b965 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.439163:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542b96c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.439168:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542b96c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.439173:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542b96c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.439178:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc2bd4e00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460096.439187:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542b96c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.439193:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542b96c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.439202:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8c4bc5dc1b00) 00010000:00010000:0.0:1788460096.439204:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460096.439207:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542b96c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.439213:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542b96c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.439227:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4000/0x5dfa74784542b973 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.439233:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4000/0x5dfa74784542b973 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.439239:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4000/0x5dfa74784542b973 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.439244:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc2bd4000 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460096.439246:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4000/0x5dfa74784542b973 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.439253:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4000/0x5dfa74784542b973 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.439260:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4bc5dc1900) 00010000:00010000:0.0:1788460096.439263:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460096.439272:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4000/0x5dfa74784542b973 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.439279:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4000/0x5dfa74784542b973 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460096.439358:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3bc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+28:12223:x1875336003400576:12345-192.168.206.5@tcp:34:lfs.0 Request processed in 571us (767us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460096.439367:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 164 00000100:00100000:1.0:1788460096.446458:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460096.446990:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003400832 00000100:00100000:3.0:1788460096.447000:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003400832 00000100:00100000:3.0:1788460096.447055:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 40 00000100:00100000:3.0:1788460096.447065:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4367100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+28:12223:x1875336003400832:12345-192.168.206.5@tcp:35:lfs.0 00000100:00100000:3.0:1788460096.447312:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4367100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+29:12223:x1875336003400832:12345-192.168.206.5@tcp:35:lfs.0 Request processed in 247us (862us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1788460096.447333:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 40 00000100:00100000:1.0:1788460096.490489:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460096.490647:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003401088 00000100:00100000:0.0:1788460096.490657:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003401088 00000100:00100000:0.0:1788460096.490720:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 165 00000100:00100000:0.0:1788460096.490730:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4365500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+29:12227:x1875336003401088:12345-192.168.206.5@tcp:101:lfs.0 00010000:00010000:0.0:1788460096.490756:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460096.490777:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4000/0x5dfa74784542b97a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a836 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.491031:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542b981 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.491047:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542b981 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.491057:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542b981 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.491070:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b988 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.491077:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b988 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.491103:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b988 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.491202:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5800/0x5dfa74784542b98f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.491211:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5800/0x5dfa74784542b98f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.491219:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5800/0x5dfa74784542b98f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788460096.491228:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788460096.491305:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542b981 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.491314:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542b981 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.491320:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542b981 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.491326:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc2bd4e00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460096.491330:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542b981 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.491338:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542b981 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.491350:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8c4bc5dc1500) 00010000:00010000:0.0:1788460096.491353:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460096.491364:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542b981 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.491371:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542b981 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.491383:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b988 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.491389:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b988 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.491395:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b988 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.491400:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc2bd4200 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460096.491403:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b988 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.491409:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b988 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.491417:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8c4bc5dc1b00) 00010000:00010000:0.0:1788460096.491419:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460096.491422:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b988 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.491427:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b988 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.491466:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4000/0x5dfa74784542b97a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a836 expref: 32 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.491492:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5800/0x5dfa74784542b98f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a836 expref: 31 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.491499:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4bc5dc1900) 00010000:00010000:0.0:1788460096.491501:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788460096.491503:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc2bd5800, rc 0) 00000100:00100000:0.0:1788460096.491693:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4365500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+31:12227:x1875336003401088:12345-192.168.206.5@tcp:101:lfs.0 Request processed in 963us (1212us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1788460096.491701:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 165 00000100:00100000:2.0:1788460096.497030:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460096.497113:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003401216 00000100:00100000:3.0:1788460096.497123:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003401216 00000100:00100000:3.0:1788460096.497220:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 166 00000100:00100000:3.0:1788460096.497231:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3bc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+31:12227:x1875336003401216:12345-192.168.206.5@tcp:54:lfs.0 00010000:00010000:3.0:1788460096.497294:0:13560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208c00/0x5dfa74784542b99d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460096.497310:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208c00/0x5dfa74784542b99d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460096.497321:0:13560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208c00/0x5dfa74784542b99d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460096.497355:0:13560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208c00/0x5dfa74784542b99d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460096.497361:0:13560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208c00/0x5dfa74784542b99d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460096.497368:0:13560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208c00/0x5dfa74784542b99d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460096.497373:0:13560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bef208c00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:3.0:1788460096.497377:0:13560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208c00/0x5dfa74784542b99d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460096.497383:0:13560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208c00/0x5dfa74784542b99d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460096.497393:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4bc5dc1900) 00010000:00010000:3.0:1788460096.497410:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788460096.497416:0:13560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208c00/0x5dfa74784542b99d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460096.497422:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208c00/0x5dfa74784542b99d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460096.497497:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3bc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+31:12227:x1875336003401216:12345-192.168.206.5@tcp:54:lfs.0 Request processed in 267us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460096.497505:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 166 00000100:00100000:1.0:1788460096.502395:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460096.502473:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003401472 00000100:00100000:3.0:1788460096.502482:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003401472 00000100:00100000:3.0:1788460096.502636:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 41 00000100:00100000:3.0:1788460096.502647:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4365880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+31:12227:x1875336003401472:12345-192.168.206.5@tcp:35:lfs.0 00000100:00100000:3.0:1788460096.502876:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4365880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+32:12227:x1875336003401472:12345-192.168.206.5@tcp:35:lfs.0 Request processed in 230us (488us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1788460096.502885:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 41 00000100:00100000:1.0:1788460096.815050:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460096.815263:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003401728 00000100:00100000:2.0:1788460096.815286:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003401728 00000100:00100000:2.0:1788460096.815354:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 167 00000100:00100000:2.0:1788460096.815365:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4364700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+32:12258:x1875336003401728:12345-192.168.206.5@tcp:101:cat.0 00010000:00010000:2.0:1788460096.815391:0:7760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460096.815413:0:7760:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542b9a4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a83d expref: -99 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460096.815536:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542b9ab lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460096.815551:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542b9ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460096.815562:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542b9ab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788460096.815573:0:7760:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788460096.815683:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542b9a4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a83d expref: 35 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460096.815701:0:7760:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542b9ab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a83d expref: 34 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460096.815709:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4bc5dc1900) 00010000:00010000:2.0:1788460096.815712:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788460096.815716:0:7760:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bfadc7c00, rc 0) 00000100:00100000:2.0:1788460096.816172:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4364700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+34:12258:x1875336003401728:12345-192.168.206.5@tcp:101:cat.0 Request processed in 806us (1128us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1788460096.816180:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 167 00000100:00100000:2.0:1788460096.823103:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460096.823249:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460096.823838:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003402112 00000100:00100000:1.0:1788460096.823850:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003402112 00000100:00100000:1.0:1788460096.823920:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 11 00000100:00100000:1.0:1788460096.823930:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3bc0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+34:2394:x1875336003402112:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788460096.824150:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788460096.824177:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542b9ab lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a83d expref: 34 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460096.824196:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4bc5dc1900) 00010000:00010000:1.0:1788460096.824202:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788460096.824263:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3bc0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+33:2394:x1875336003402112:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 335us (1013us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460096.824270:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 11 00000100:00100000:0.0:1788460096.828092:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003401984 00000100:00100000:0.0:1788460096.828109:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003401984 00000100:00100000:0.0:1788460096.828179:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 42 00000100:00100000:0.0:1788460096.828189:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3bc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+33:12258:x1875336003401984:12345-192.168.206.5@tcp:35:cat.0 00000100:00100000:0.0:1788460096.828463:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3bc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+34:12258:x1875336003401984:12345-192.168.206.5@tcp:35:cat.0 Request processed in 274us (5367us total) trans 4294967440 rc 0/0 00000100:00100000:0.0:1788460096.828471:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 42 00000100:00100000:2.0:1788460096.914188:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460096.914282:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003402368 00000100:00100000:0.0:1788460096.914291:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003402368 00000100:00100000:0.0:1788460096.914358:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 168 00000100:00100000:0.0:1788460096.914368:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3bc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+34:12264:x1875336003402368:12345-192.168.206.5@tcp:101:dd.0 00010000:00010000:0.0:1788460096.914391:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460096.914394:0:6533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788460096.914421:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5a00/0x5dfa74784542b911 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a813 expref: 34 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.914457:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8c4bc5dc1500) 00010000:00010000:0.0:1788460096.914462:0:6533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788460096.914475:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4000/0x5dfa74784542b9b9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a844 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.914582:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b9c0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.914606:0:6533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5800/0x5dfa74784542b98f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a836 expref: 34 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.914615:0:6533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b9c0 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.914647:0:6533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5800/0x5dfa74784542b98f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a836 expref: 34 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.914661:0:6533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5800/0x5dfa74784542b98f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a836 expref: 34 pid: 6533 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460096.914674:0:6533:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4386d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6533:1875336022346496:192.168.206.5@tcp:104: 00000100:00100000:0.0:1788460096.914766:0:6533:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bd47b9900 going to sleep for 11 seconds 00000100:00100000:0.0:1788460096.919198:0:6533:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4386d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6533:1875336022346496:192.168.206.5@tcp:104: 00010000:00010000:0.0:1788460096.919226:0:6533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b9c0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460096.920325:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460096.920670:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003402496 00000100:00100000:1.0:1788460096.920678:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003402496 00010000:00010000:1.0:1788460096.920713:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5800/0x5dfa74784542b98f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a836 expref: 35 pid: 6533 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460096.920752:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 92 00000100:00100000:1.0:1788460096.920761:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bedf6d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+35:2393:x1875336003402496:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788460096.920776:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788460096.920790:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5800/0x5dfa74784542b98f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a836 expref: 35 pid: 6533 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460096.920817:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5800/0x5dfa74784542b98f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a836 expref: 35 pid: 6533 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460096.920837:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5800/0x5dfa74784542b98f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a836 expref: 35 pid: 6533 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460096.920851:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4bc5dc1900) 00010000:00010000:1.0:1788460096.920856:0:6520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b9c0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460096.920865:0:6520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b9c0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460096.920872:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b9c0 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460096.920902:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788460096.921130:0:6533:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b9c0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.921145:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b9c0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788460096.921160:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788460096.921275:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4000/0x5dfa74784542b9b9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a844 expref: 36 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.921288:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b9c0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a844 expref: 35 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.921295:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4bc5dc1900) 00010000:00010000:0.0:1788460096.921298:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788460096.921300:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc2bd4200, rc 0) 00000100:00100000:0.0:1788460096.921327:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3bc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+35:12264:x1875336003402368:12345-192.168.206.5@tcp:101:dd.0 Request processed in 6960us (7147us total) trans 4294967441 rc 0/0 00000100:00100000:0.0:1788460096.921335:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 168 00000100:00100000:1.0:1788460096.921437:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bedf6d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+34:2393:x1875336003402496:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 231us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460096.921444:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 92 00000100:00100000:1.0:1788460096.926546:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460096.926723:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003402624 00000100:00100000:3.0:1788460096.926732:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003402624 00000100:00100000:3.0:1788460096.926796:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 169 00000100:00100000:3.0:1788460096.926806:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4365f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+34:12264:x1875336003402624:12345-192.168.206.5@tcp:101:dd.0 00010000:00010000:3.0:1788460096.926829:0:13560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460096.926849:0:13560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208c00/0x5dfa74784542b9ce lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a84b expref: -99 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460096.926893:0:13560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209800/0x5dfa74784542b9d5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460096.926910:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209800/0x5dfa74784542b9d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460096.926937:0:13560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209800/0x5dfa74784542b9d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460096.927234:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208c00/0x5dfa74784542b9ce lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a84b expref: 36 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460096.927250:0:13560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209800/0x5dfa74784542b9d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a84b expref: 35 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460096.927259:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4bc5dc1900) 00010000:00010000:3.0:1788460096.927263:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788460096.927266:0:13560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bef209800, rc 0) 00000100:00100000:3.0:1788460096.927462:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4365f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+35:12264:x1875336003402624:12345-192.168.206.5@tcp:101:dd.0 Request processed in 657us (924us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460096.927469:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 169 00000100:00100000:2.0:1788460096.933187:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460096.933755:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003402880 00000100:00100000:0.0:1788460096.933795:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003402880 00000100:00100000:0.0:1788460096.933856:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 170 00000100:00100000:0.0:1788460096.933866:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3bc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+35:12264:x1875336003402880:12345-192.168.206.5@tcp:36:dd.0 00010000:00010000:0.0:1788460096.934098:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4000/0x5dfa74784542b9dc lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.934114:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4000/0x5dfa74784542b9dc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.934125:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4000/0x5dfa74784542b9dc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788460096.934185:0:7760:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:0.0:1788460096.934211:0:7760:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007e3da765 reply state 0000000082c5e2ab transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4000/0x5dfa74784542b9dc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.934223:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4000/0x5dfa74784542b9dc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460096.934231:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4bc5dc1900) 00010000:00010000:0.0:1788460096.934234:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788460096.934238:0:7760:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788460096.934613:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3bc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+38:12264:x1875336003402880:12345-192.168.206.5@tcp:36:dd.0 Request processed in 747us (1432us total) trans 4294967443 rc 0/0 00000100:00100000:0.0:1788460096.934620:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 170 00000020:00080000:0.0:1788460096.934624:0:7760:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788460097.243310:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460097.243563:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003403008 00000100:00100000:0.0:1788460097.243572:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003403008 00000100:00100000:0.0:1788460097.243653:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 171 00000100:00100000:0.0:1788460097.243665:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc6761c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+38:12278:x1875336003403008:12345-192.168.206.5@tcp:101:stat.0 00010000:00010000:0.0:1788460097.243688:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460097.243709:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5a00/0x5dfa74784542b9e3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a852 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.243779:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542b9ea lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.243807:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542b9ea lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.243818:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542b9ea lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.243851:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5000/0x5dfa74784542b9f1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.243862:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5000/0x5dfa74784542b9f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.243869:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5000/0x5dfa74784542b9f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.243931:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4400/0x5dfa74784542b9f8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.243941:0:6533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b9c0 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a844 expref: 39 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.243986:0:6533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4400/0x5dfa74784542b9f8 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.244018:0:6533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b9c0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a844 expref: 39 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.244032:0:6533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b9c0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a844 expref: 39 pid: 6533 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460097.244044:0:6533:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4386d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6533:1875336022346624:192.168.206.5@tcp:104: 00000100:00100000:0.0:1788460097.244255:0:6533:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bd47b9900 going to sleep for 11 seconds 00000100:00080000:3.0:1788460097.244896:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788460097.251175:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460097.251908:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003403264 00000100:00100000:3.0:1788460097.251919:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003403264 00000100:00100000:3.0:1788460097.252009:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 43 00000100:00100000:3.0:1788460097.252019:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4367b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+40:6160:x1875336003403264:12345-192.168.206.5@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788460097.252486:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4367b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+41:6160:x1875336003403264:12345-192.168.206.5@tcp:35:ldlm_bl.0 Request processed in 467us (1318us total) trans 4294967444 rc 0/0 00000100:00100000:3.0:1788460097.252496:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 43 00000100:00100000:0.0:1788460097.253642:0:6533:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4386d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6533:1875336022346624:192.168.206.5@tcp:104: 00010000:00010000:0.0:1788460097.253671:0:6533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4400/0x5dfa74784542b9f8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460097.260371:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460097.261059:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003403392 00000100:00100000:2.0:1788460097.261069:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003403392 00010000:00010000:2.0:1788460097.261129:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b9c0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a844 expref: 41 pid: 6533 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460097.261170:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 93 00000100:00100000:2.0:1788460097.261180:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4364a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+41:2393:x1875336003403392:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788460097.261195:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460097.261201:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b9c0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a844 expref: 41 pid: 6533 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460097.261215:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b9c0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a844 expref: 41 pid: 6533 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460097.261239:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4200/0x5dfa74784542b9c0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a844 expref: 41 pid: 6533 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460097.261255:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4bc5dc1900) 00010000:00010000:2.0:1788460097.261260:0:6519:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4400/0x5dfa74784542b9f8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460097.261270:0:6519:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4400/0x5dfa74784542b9f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460097.261307:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4400/0x5dfa74784542b9f8 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460097.261340:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788460097.261401:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4364a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+40:2393:x1875336003403392:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 222us (1038us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460097.261409:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 93 00010000:00010000:0.0:1788460097.261729:0:6533:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4400/0x5dfa74784542b9f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.261738:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4400/0x5dfa74784542b9f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788460097.261795:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788460097.261799:0:6533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788460097.261830:0:6533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4400/0x5dfa74784542b9f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.261844:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4400/0x5dfa74784542b9f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.261853:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542b9ea lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.261860:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542b9ea lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.261866:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542b9ea lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.261872:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc2bd4e00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460097.261877:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542b9ea lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.261887:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542b9ea lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.261897:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8c4bc5dc1500) 00010000:00010000:0.0:1788460097.261907:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460097.261913:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542b9ea lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.261918:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542b9ea lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.261931:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5000/0x5dfa74784542b9f1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.261937:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5000/0x5dfa74784542b9f1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.261989:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5000/0x5dfa74784542b9f1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.261996:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc2bd5000 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460097.261999:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5000/0x5dfa74784542b9f1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.262005:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5000/0x5dfa74784542b9f1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.262015:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8c4bc5dc1b00) 00010000:00010000:0.0:1788460097.262017:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460097.262020:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5000/0x5dfa74784542b9f1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.262026:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5000/0x5dfa74784542b9f1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.262062:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5a00/0x5dfa74784542b9e3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a852 expref: 40 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.262111:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4400/0x5dfa74784542b9f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a852 expref: 39 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.262119:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4bc5dc1900) 00010000:00010000:0.0:1788460097.262121:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788460097.262123:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc2bd4400, rc 0) 00000100:00100000:0.0:1788460097.262159:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc6761c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+39:12278:x1875336003403008:12345-192.168.206.5@tcp:101:stat.0 Request processed in 18497us (18857us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460097.262166:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 171 00010000:00010000:3.0:1788460097.297268:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788460097.355195:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460097.355468:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003403648 00000100:00100000:3.0:1788460097.355499:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003403648 00000100:00100000:3.0:1788460097.355597:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 172 00000100:00100000:3.0:1788460097.355610:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3bc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+39:12284:x1875336003403648:12345-192.168.206.5@tcp:36:truncate.0 00010000:00010000:3.0:1788460097.355701:0:13560:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788460097.355735:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4400/0x5dfa74784542b9f8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a852 expref: 39 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460097.355758:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4bc5dc1900) 00010000:00010000:3.0:1788460097.355764:0:13560:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788460097.357370:0:13560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208c00/0x5dfa74784542b9ff lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460097.357401:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208c00/0x5dfa74784542b9ff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460097.357416:0:13560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208c00/0x5dfa74784542b9ff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788460097.357471:0:13560:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:3.0:1788460097.357499:0:13560:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008a2845ea reply state 00000000df552b00 transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208c00/0x5dfa74784542b9ff lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460097.357512:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208c00/0x5dfa74784542b9ff lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460097.357521:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4bc5dc1900) 00010000:00010000:3.0:1788460097.357524:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788460097.357529:0:13560:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788460097.357695:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3bc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+41:12284:x1875336003403648:12345-192.168.206.5@tcp:36:truncate.0 Request processed in 2082us (2507us total) trans 4294967446 rc 0/0 00000100:00100000:3.0:1788460097.357707:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 172 00000020:00080000:3.0:1788460097.357733:0:13560:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788460097.550388:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460097.551934:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003403776 00000100:00100000:0.0:1788460097.551999:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003403776 00000100:00100000:0.0:1788460097.552108:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 173 00000100:00100000:0.0:1788460097.552120:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc6762a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+41:12298:x1875336003403776:12345-192.168.206.5@tcp:101:stat.0 00010000:00010000:0.0:1788460097.552155:0:7760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460097.552183:0:7760:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5a00/0x5dfa74784542ba06 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a859 expref: -99 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.552272:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5000/0x5dfa74784542ba0d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.552290:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5000/0x5dfa74784542ba0d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.552304:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5000/0x5dfa74784542ba0d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.552321:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542ba14 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.552347:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542ba14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.552354:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542ba14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.552453:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542ba1b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.552463:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542ba1b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.552470:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542ba1b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788460097.552524:0:7760:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1788460097.552528:0:7760:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788460097.552550:0:7760:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542ba1b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.552564:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542ba1b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.552573:0:7760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5000/0x5dfa74784542ba0d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.552578:0:7760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5000/0x5dfa74784542ba0d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.552594:0:7760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5000/0x5dfa74784542ba0d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.552612:0:7760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc2bd5000 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460097.552616:0:7760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5000/0x5dfa74784542ba0d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.552625:0:7760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5000/0x5dfa74784542ba0d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.552639:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8c4bc5dc1500) 00010000:00010000:0.0:1788460097.552642:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460097.552648:0:7760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5000/0x5dfa74784542ba0d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.552655:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5000/0x5dfa74784542ba0d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.552671:0:7760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542ba14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.552678:0:7760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542ba14 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.552684:0:7760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542ba14 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.552690:0:7760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc2bd4e00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460097.552693:0:7760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542ba14 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.552699:0:7760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542ba14 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.552717:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8c4bc5dc1b00) 00010000:00010000:0.0:1788460097.552719:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460097.552722:0:7760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542ba14 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.552728:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542ba14 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.552766:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5a00/0x5dfa74784542ba06 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a859 expref: 43 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.552783:0:7760:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542ba1b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a859 expref: 42 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.552791:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4bc5dc1900) 00010000:00010000:0.0:1788460097.552793:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788460097.552795:0:7760:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc2bd5c00, rc 0) 00000100:00100000:0.0:1788460097.552899:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc6762a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+42:12298:x1875336003403776:12345-192.168.206.5@tcp:101:stat.0 Request processed in 780us (2525us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460097.552909:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 173 00000100:00100000:1.0:1788460097.685459:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460097.685575:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003404032 00000100:00100000:0.0:1788460097.685599:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003404032 00000100:00100000:0.0:1788460097.685675:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 174 00000100:00100000:0.0:1788460097.685687:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac42fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+42:12308:x1875336003404032:12345-192.168.206.5@tcp:101:lfs.0 00010000:00010000:0.0:1788460097.685716:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460097.685743:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5a00/0x5dfa74784542ba22 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a860 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788460097.685902:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1788460097.686142:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5a00/0x5dfa74784542ba22 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a860 expref: 44 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.686159:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4bfa9fec00) 00010000:00010000:0.0:1788460097.686163:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788460097.686169:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5a00/0x5dfa74784542ba22 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a860 expref: 44 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.686186:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc2bd5a00, rc 0) 00000100:00100000:0.0:1788460097.686263:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac42fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+43:12308:x1875336003404032:12345-192.168.206.5@tcp:101:lfs.0 Request processed in 578us (816us total) trans 4294967447 rc 301/301 00000100:00100000:0.0:1788460097.686271:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 174 00000100:00100000:3.0:1788460097.689102:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460097.689472:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003404288 00000100:00100000:0.0:1788460097.689484:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003404288 00000100:00100000:0.0:1788460097.689615:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 44 00000100:00100000:0.0:1788460097.689625:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc6be0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+43:12308:x1875336003404288:12345-192.168.206.5@tcp:35:lfs.0 00000100:00100000:0.0:1788460097.689933:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc6be0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+44:12308:x1875336003404288:12345-192.168.206.5@tcp:35:lfs.0 Request processed in 307us (843us total) trans 4294967448 rc 0/0 00000100:00100000:0.0:1788460097.689976:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 44 00000100:00100000:3.0:1788460097.792307:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460097.792443:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003404544 00000100:00100000:0.0:1788460097.792457:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003404544 00000100:00100000:0.0:1788460097.792549:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 175 00000100:00100000:0.0:1788460097.792561:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc6760a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+44:12314:x1875336003404544:12345-192.168.206.5@tcp:101:bash.0 00010000:00010000:0.0:1788460097.792602:0:13560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460097.792647:0:13560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5a00/0x5dfa74784542ba30 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a867 expref: -99 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.792774:0:13560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542ba37 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.792801:0:13560:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542ba1b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a859 expref: 45 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.792811:0:13560:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542ba37 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.792851:0:13560:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542ba1b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a859 expref: 45 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.792864:0:13560:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542ba1b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a859 expref: 45 pid: 7760 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460097.792879:0:13560:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4386d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13560:1875336022346752:192.168.206.5@tcp:104: 00000100:00100000:0.0:1788460097.793053:0:13560:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bd47b9900 going to sleep for 11 seconds 00000100:00100000:0.0:1788460097.795504:0:13560:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4386d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13560:1875336022346752:192.168.206.5@tcp:104: 00010000:00010000:0.0:1788460097.795560:0:13560:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542ba37 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460097.800414:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460097.800667:0:9538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003404672 00000100:00100000:2.0:1788460097.800682:0:9538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003404672 00010000:00010000:2.0:1788460097.800744:0:9538:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542ba1b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a859 expref: 46 pid: 7760 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460097.800794:0:9538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 94 00000100:00100000:2.0:1788460097.800806:0:9538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+46:2394:x1875336003404672:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788460097.800829:0:9538:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460097.800838:0:9538:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542ba1b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a859 expref: 46 pid: 7760 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460097.800857:0:9538:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542ba1b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a859 expref: 46 pid: 7760 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460097.800893:0:9538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542ba1b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a859 expref: 46 pid: 7760 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460097.800920:0:9538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4bc5dc1900) 00010000:00010000:2.0:1788460097.800928:0:9538:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542ba37 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460097.801050:0:9538:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542ba37 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460097.801060:0:9538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542ba37 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460097.801108:0:9538:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788460097.801181:0:9538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+45:2394:x1875336003404672:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 376us (780us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460097.801191:0:9538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 94 00010000:00010000:1.0:1788460097.801204:0:13560:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542ba37 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460097.801222:0:13560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542ba37 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788460097.801261:0:13560:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1788460097.801461:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5a00/0x5dfa74784542ba30 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a867 expref: 46 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460097.801479:0:13560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542ba37 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a867 expref: 45 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460097.801487:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4bc5dc1900) 00010000:00010000:1.0:1788460097.801489:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788460097.801492:0:13560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc2bd4e00, rc 0) 00000100:00100000:1.0:1788460097.801521:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc6760a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+45:12314:x1875336003404544:12345-192.168.206.5@tcp:101:bash.0 Request processed in 8964us (9230us total) trans 4294967449 rc 0/0 00000100:00100000:1.0:1788460097.801529:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 175 00000100:00100000:2.0:1788460097.805463:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460097.805619:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003404928 00000100:00100000:0.0:1788460097.805633:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003404928 00000100:00100000:0.0:1788460097.805710:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 176 00000100:00100000:0.0:1788460097.805721:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+45:12314:x1875336003404928:12345-192.168.206.5@tcp:36:bash.0 00010000:00010000:0.0:1788460097.806286:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5000/0x5dfa74784542ba45 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.806319:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5000/0x5dfa74784542ba45 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.806333:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5000/0x5dfa74784542ba45 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788460097.806391:0:6534:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:0.0:1788460097.806416:0:6534:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000045a06e21 reply state 00000000e3b00d49 transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5000/0x5dfa74784542ba45 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.806431:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5000/0x5dfa74784542ba45 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.806439:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4bc5dc1900) 00010000:00010000:0.0:1788460097.806442:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788460097.806446:0:6534:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788460097.806721:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+48:12314:x1875336003404928:12345-192.168.206.5@tcp:36:bash.0 Request processed in 999us (1268us total) trans 4294967451 rc 0/0 00000100:00100000:0.0:1788460097.806730:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 176 00000020:00080000:0.0:1788460097.806736:0:6534:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788460097.815913:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460097.816342:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003405056 00000100:00100000:2.0:1788460097.816354:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003405056 00000100:00100000:2.0:1788460097.816481:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 177 00000100:00100000:2.0:1788460097.816492:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac1e60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+48:12314:x1875336003405056:12345-192.168.206.5@tcp:101:bash.0 00010000:00010000:2.0:1788460097.816532:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460097.816557:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542ba4c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a86e expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460097.816685:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542ba53 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460097.816701:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542ba37 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a867 expref: 49 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460097.816710:0:6535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542ba53 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460097.816750:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542ba37 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a867 expref: 49 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460097.816781:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542ba37 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a867 expref: 49 pid: 13560 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460097.816796:0:6535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3bc2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6535:1875336022346880:192.168.206.5@tcp:104: 00000100:00100000:2.0:1788460097.816909:0:6535:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bf74ef480 going to sleep for 11 seconds 00000100:00100000:3.0:1788460097.819483:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460097.819650:0:6535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3bc2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6535:1875336022346880:192.168.206.5@tcp:104: 00010000:00010000:2.0:1788460097.819686:0:6535:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542ba53 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460097.819872:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003405184 00000100:00100000:1.0:1788460097.819883:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003405184 00010000:00010000:1.0:1788460097.819932:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542ba37 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a867 expref: 50 pid: 13560 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460097.820166:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 95 00000100:00100000:1.0:1788460097.820176:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac1e61500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+50:2393:x1875336003405184:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788460097.820196:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788460097.820204:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542ba37 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a867 expref: 50 pid: 13560 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460097.820219:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542ba37 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a867 expref: 50 pid: 13560 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460097.820269:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542ba37 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a867 expref: 50 pid: 13560 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460097.820288:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4bc5dc1900) 00010000:00010000:1.0:1788460097.820293:0:6520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542ba53 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460097.820305:0:6520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542ba53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460097.820315:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542ba53 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460097.820354:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788460097.820423:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac1e61500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+49:2393:x1875336003405184:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 247us (955us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460097.820433:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 95 00010000:00010000:0.0:1788460097.821272:0:6535:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542ba53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.821287:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542ba53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788460097.821358:0:6535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788460097.821364:0:6535:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788460097.821390:0:6535:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542ba53 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.821456:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542ba4c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a86e expref: 49 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.821476:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542ba53 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a86e expref: 48 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.821485:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4bc5dc1900) 00010000:00010000:0.0:1788460097.821488:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788460097.821491:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bfadc7400, rc 0) 00000100:00100000:0.0:1788460097.821562:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac1e60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+48:12314:x1875336003405056:12345-192.168.206.5@tcp:101:bash.0 Request processed in 5071us (5662us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460097.821570:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 177 00000100:00100000:3.0:1788460097.828938:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460097.829358:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003405440 00000100:00100000:2.0:1788460097.829373:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003405440 00000100:00100000:2.0:1788460097.829474:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 45 00000100:00100000:2.0:1788460097.829487:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac43f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+48:12314:x1875336003405440:12345-192.168.206.5@tcp:35:bash.0 00000100:00100000:2.0:1788460097.829994:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac43f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+49:12314:x1875336003405440:12345-192.168.206.5@tcp:35:bash.0 Request processed in 507us (1067us total) trans 4294967452 rc 0/0 00000100:00100000:2.0:1788460097.830015:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 45 00000100:00100000:3.0:1788460097.912882:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460097.913125:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003405696 00000100:00100000:1.0:1788460097.913138:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003405696 00000100:00100000:1.0:1788460097.913204:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 178 00000100:00100000:1.0:1788460097.913214:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac43f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+49:12324:x1875336003405696:12345-192.168.206.5@tcp:101:lfs.0 00010000:00010000:1.0:1788460097.913248:0:13560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460097.913278:0:13560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677a00/0x5dfa74784542ba5a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a875 expref: -99 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788460097.913405:0:13560:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1788460097.913543:0:13560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677a00/0x5dfa74784542ba5a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a875 expref: 51 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460097.913577:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4bfa9fec00) 00010000:00010000:1.0:1788460097.913580:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788460097.913597:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677a00/0x5dfa74784542ba5a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a875 expref: 51 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460097.913615:0:13560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ac3677a00, rc 0) 00000100:00100000:1.0:1788460097.913691:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac43f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+50:12324:x1875336003405696:12345-192.168.206.5@tcp:101:lfs.0 Request processed in 478us (824us total) trans 4294967453 rc 301/301 00000100:00100000:1.0:1788460097.913699:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 178 00000100:00100000:3.0:1788460097.917349:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460097.917459:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003405824 00000100:00100000:0.0:1788460097.917472:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003405824 00000100:00100000:0.0:1788460097.917555:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 179 00000100:00100000:0.0:1788460097.917566:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac43f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+50:12324:x1875336003405824:12345-192.168.206.5@tcp:34:lfs.0 00010000:00010000:0.0:1788460097.917816:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542ba68 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.917838:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542ba68 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.917856:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542ba68 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.917872:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5a00/0x5dfa74784542ba6f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.917901:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5a00/0x5dfa74784542ba6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.917908:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5a00/0x5dfa74784542ba6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.918040:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542ba76 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.918052:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542ba76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.918059:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542ba76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788460097.918117:0:6534:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542ba76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.918131:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542ba68 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.918138:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542ba68 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.918146:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542ba68 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.918152:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc2bd4e00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460097.918157:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542ba68 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.918165:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542ba68 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.918185:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8c4bc5dc1500) 00010000:00010000:0.0:1788460097.918188:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460097.918194:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542ba68 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.918201:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542ba68 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.918215:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5a00/0x5dfa74784542ba6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.918222:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5a00/0x5dfa74784542ba6f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.918228:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5a00/0x5dfa74784542ba6f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.918234:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc2bd5a00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460097.918236:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5a00/0x5dfa74784542ba6f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.918243:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5a00/0x5dfa74784542ba6f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.918250:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8c4bc5dc1b00) 00010000:00010000:0.0:1788460097.918252:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460097.918255:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5a00/0x5dfa74784542ba6f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.918261:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5a00/0x5dfa74784542ba6f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.918287:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542ba76 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.918294:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542ba76 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.918300:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542ba76 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.918305:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc2bd5c00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460097.918308:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542ba76 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.918315:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542ba76 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.918322:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4bc5dc1900) 00010000:00010000:0.0:1788460097.918325:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460097.918328:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542ba76 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.918334:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542ba76 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460097.918438:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac43f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+50:12324:x1875336003405824:12345-192.168.206.5@tcp:34:lfs.0 Request processed in 871us (1100us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460097.918448:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 179 00000100:00100000:3.0:1788460097.921271:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460097.921423:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003406080 00000100:00100000:0.0:1788460097.921438:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003406080 00000100:00100000:0.0:1788460097.921680:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 46 00000100:00100000:0.0:1788460097.921712:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac43f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+50:12324:x1875336003406080:12345-192.168.206.5@tcp:35:lfs.0 00000100:00100000:0.0:1788460097.922058:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac43f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+51:12324:x1875336003406080:12345-192.168.206.5@tcp:35:lfs.0 Request processed in 347us (798us total) trans 4294967454 rc 0/0 00000100:00100000:0.0:1788460097.922067:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 46 00000100:00100000:3.0:1788460097.965047:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460097.965249:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003406336 00000100:00100000:0.0:1788460097.965263:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003406336 00000100:00100000:0.0:1788460097.965343:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 180 00000100:00100000:0.0:1788460097.965356:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac43f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+51:12327:x1875336003406336:12345-192.168.206.5@tcp:101:lfs.0 00010000:00010000:0.0:1788460097.965390:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460097.965420:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542ba7d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a87c expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.965529:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5a00/0x5dfa74784542ba84 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.965546:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5a00/0x5dfa74784542ba84 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.965565:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5a00/0x5dfa74784542ba84 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.965591:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542ba8b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.965600:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542ba8b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.965608:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542ba8b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.966061:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4400/0x5dfa74784542ba92 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.966074:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4400/0x5dfa74784542ba92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.966082:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4400/0x5dfa74784542ba92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788460097.966094:0:6535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788460097.966205:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5a00/0x5dfa74784542ba84 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.966214:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5a00/0x5dfa74784542ba84 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.966222:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5a00/0x5dfa74784542ba84 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.966229:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc2bd5a00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460097.966234:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5a00/0x5dfa74784542ba84 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.966243:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5a00/0x5dfa74784542ba84 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.966258:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8c4bc5dc1500) 00010000:00010000:0.0:1788460097.966261:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460097.966267:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5a00/0x5dfa74784542ba84 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.966284:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5a00/0x5dfa74784542ba84 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.966298:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542ba8b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.966305:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542ba8b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.966311:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542ba8b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.966316:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc2bd4e00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460097.966319:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542ba8b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.966325:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542ba8b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.966333:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8c4bc5dc1b00) 00010000:00010000:0.0:1788460097.966336:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460097.966339:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542ba8b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.966345:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542ba8b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.966397:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542ba7d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a87c expref: 54 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.966413:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4400/0x5dfa74784542ba92 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a87c expref: 53 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460097.966427:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4bc5dc1900) 00010000:00010000:0.0:1788460097.966430:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788460097.966433:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc2bd4400, rc 0) 00000100:00100000:0.0:1788460097.966825:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac43f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+53:12327:x1875336003406336:12345-192.168.206.5@tcp:101:lfs.0 Request processed in 1469us (1788us total) trans 4294967455 rc 0/0 00000100:00100000:0.0:1788460097.966836:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 180 00000100:00100000:3.0:1788460097.970928:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460097.971010:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460097.971084:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003406464 00000100:00100000:1.0:1788460097.971096:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003406464 00000100:00100000:1.0:1788460097.971159:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 181 00000100:00100000:1.0:1788460097.971170:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac43f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+53:12327:x1875336003406464:12345-192.168.206.5@tcp:54:lfs.0 00010000:00010000:1.0:1788460097.971254:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677a00/0x5dfa74784542baa0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460097.971276:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677a00/0x5dfa74784542baa0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460097.971290:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677a00/0x5dfa74784542baa0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460097.971336:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677a00/0x5dfa74784542baa0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460097.971344:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677a00/0x5dfa74784542baa0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460097.971374:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677a00/0x5dfa74784542baa0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460097.971381:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac3677a00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:1.0:1788460097.971385:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677a00/0x5dfa74784542baa0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460097.971393:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677a00/0x5dfa74784542baa0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460097.971408:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4bc5dc1900) 00010000:00010000:1.0:1788460097.971412:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788460097.971417:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677a00/0x5dfa74784542baa0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460097.971424:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677a00/0x5dfa74784542baa0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460097.971593:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003406592 00000100:00100000:2.0:1788460097.971599:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003406592 00000100:00100000:2.0:1788460097.971640:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 12 00000100:00100000:2.0:1788460097.971649:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac43f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+54:2394:x1875336003406592:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788460097.971661:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460097.971679:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4400/0x5dfa74784542ba92 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a87c expref: 54 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460097.971704:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4bc5dc1900) 00010000:00010000:2.0:1788460097.971708:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788460097.972343:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac43f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+53:12327:x1875336003406464:12345-192.168.206.5@tcp:54:lfs.0 Request processed in 1169us (1425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460097.972354:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 181 00000100:00100000:2.0:1788460097.972487:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac43f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+52:2394:x1875336003406592:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 838us (1475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460097.972495:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 12 00000100:00100000:0.0:1788460097.975434:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460097.975575:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003406848 00000100:00100000:2.0:1788460097.975597:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003406848 00000100:00100000:2.0:1788460097.975666:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 47 00000100:00100000:2.0:1788460097.975677:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4386d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+52:12327:x1875336003406848:12345-192.168.206.5@tcp:35:lfs.0 00000100:00100000:2.0:1788460097.976497:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4386d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+53:12327:x1875336003406848:12345-192.168.206.5@tcp:35:lfs.0 Request processed in 816us (1072us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1788460097.976517:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 47 00000100:00100000:1.0:1788460098.132672:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788460098.132702:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3bc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022347008:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788460098.132811:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460098.133100:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022347008 00000100:00100000:2.0:1788460098.133111:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022347008 00000100:00100000:2.0:1788460098.133194:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788460098.133206:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc532ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1875336022347008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788460098.133245:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1788460098.133319:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc532ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1875336022347008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460098.133327:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788460098.133434:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3bc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022347008:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788460098.133801:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788460098.138878:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460098.139072:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003407104 00000100:00100000:0.0:1788460098.139086:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003407104 00000100:00100000:0.0:1788460098.139158:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 182 00000100:00100000:0.0:1788460098.139170:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3bc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+53:12345:x1875336003407104:12345-192.168.206.5@tcp:101:cat.0 00010000:00010000:0.0:1788460098.139204:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460098.139231:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542baa7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a883 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460098.139392:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542baae lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460098.139411:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542baae lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460098.139425:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542baae lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788460098.139439:0:6534:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788460098.139592:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542baa7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a883 expref: 56 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460098.139633:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542baae lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a883 expref: 55 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460098.139642:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4bc5dc1900) 00010000:00010000:0.0:1788460098.139645:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788460098.139649:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc2bd4e00, rc 0) 00000100:00100000:0.0:1788460098.139727:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3bc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+55:12345:x1875336003407104:12345-192.168.206.5@tcp:101:cat.0 Request processed in 560us (864us total) trans 4294967457 rc 0/0 00000100:00100000:0.0:1788460098.139735:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 182 00000100:00100000:3.0:1788460098.183712:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460098.183993:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003407232 00000100:00100000:2.0:1788460098.184009:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003407232 00000100:00100000:2.0:1788460098.184101:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 183 00000100:00100000:2.0:1788460098.184113:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac43f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+55:12346:x1875336003407232:12345-192.168.206.5@tcp:101:lfs.0 00010000:00010000:2.0:1788460098.184162:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460098.184189:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542babc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a88a expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460098.184274:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542bac3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460098.184293:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542bac3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460098.184307:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542bac3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788460098.184376:0:6535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1788460098.184380:0:6535:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788460098.184403:0:6535:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542bac3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460098.184432:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542babc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a88a expref: 57 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460098.184452:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542bac3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a88a expref: 56 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460098.184461:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8c4bc5dc1500) 00010000:00010000:2.0:1788460098.184464:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788460098.184469:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bfadc7600, rc 0) 00000100:00100000:2.0:1788460098.184760:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac43f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+56:12346:x1875336003407232:12345-192.168.206.5@tcp:101:lfs.0 Request processed in 647us (1061us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460098.184768:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 183 00000100:00100000:3.0:1788460098.200505:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460098.200721:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003407616 00000100:00100000:0.0:1788460098.200734:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003407616 00000100:00100000:0.0:1788460098.200877:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 48 00000100:00100000:0.0:1788460098.200891:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac43f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+56:12346:x1875336003407616:12345-192.168.206.5@tcp:35:lfs.0 00000100:00100000:0.0:1788460098.201514:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac43f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+57:12346:x1875336003407616:12345-192.168.206.5@tcp:35:lfs.0 Request processed in 615us (1010us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1788460098.201526:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 48 00000100:00100000:3.0:1788460098.203719:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460098.203924:0:9549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003407744 00000100:00100000:0.0:1788460098.203936:0:9549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003407744 00000100:00100000:0.0:1788460098.204085:0:9549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 13 00000100:00100000:0.0:1788460098.204099:0:9549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac43f7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+57:12346:x1875336003407744:12345-192.168.206.5@tcp:103:lfs.0 00010000:00010000:0.0:1788460098.204122:0:9549:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788460098.204160:0:9549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542ba53 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a86e expref: 57 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460098.204189:0:9549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542baae lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a883 expref: 56 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460098.204227:0:9549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4800/0x5dfa74784542b950 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a828 expref: 55 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460098.204238:0:9549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4bc5dc1900) 00010000:00010000:0.0:1788460098.204244:0:9549:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788460098.204322:0:9549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac43f7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+54:12346:x1875336003407744:12345-192.168.206.5@tcp:103:lfs.0 Request processed in 225us (818us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460098.204331:0:9549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 13 00000100:00100000:3.0:1788460098.206197:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460098.206337:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003407872 00000100:00100000:1.0:1788460098.206351:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003407872 00000100:00100000:1.0:1788460098.206441:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 184 00000100:00100000:1.0:1788460098.206452:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac43f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+54:12346:x1875336003407872:12345-192.168.206.5@tcp:58:lfs.0 00010000:00010000:1.0:1788460098.206634:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677a00/0x5dfa74784542baca lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460098.206661:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677a00/0x5dfa74784542baca lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460098.206675:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677a00/0x5dfa74784542baca lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788460098.206801:0:7760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:1.0:1788460098.206900:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac43f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+54:12346:x1875336003407872:12345-192.168.206.5@tcp:58:lfs.0 Request processed in 449us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460098.206909:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 184 00000100:00100000:3.0:1788460098.236244:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460098.236424:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003408000 00000100:00100000:1.0:1788460098.236437:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003408000 00000100:00100000:1.0:1788460098.236527:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 185 00000100:00100000:1.0:1788460098.236539:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac43f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+54:12348:x1875336003408000:12345-192.168.206.5@tcp:101:lfs.0 00010000:00010000:1.0:1788460098.236567:0:13560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460098.236603:0:13560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676c00/0x5dfa74784542bad1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a891 expref: -99 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460098.236686:0:13560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677c00/0x5dfa74784542bad8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460098.236705:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677c00/0x5dfa74784542bad8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460098.236719:0:13560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677c00/0x5dfa74784542bad8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460098.236735:0:13560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676800/0x5dfa74784542badf lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460098.236765:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676800/0x5dfa74784542badf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460098.236773:0:13560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676800/0x5dfa74784542badf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460098.236870:0:13560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677800/0x5dfa74784542bae6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460098.236880:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677800/0x5dfa74784542bae6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460098.236886:0:13560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677800/0x5dfa74784542bae6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788460098.236935:0:13560:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788460098.236940:0:13560:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788460098.237013:0:13560:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677800/0x5dfa74784542bae6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460098.237026:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677800/0x5dfa74784542bae6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460098.237035:0:13560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677c00/0x5dfa74784542bad8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460098.237041:0:13560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677c00/0x5dfa74784542bad8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460098.237048:0:13560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677c00/0x5dfa74784542bad8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460098.237064:0:13560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac3677c00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:1.0:1788460098.237069:0:13560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677c00/0x5dfa74784542bad8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460098.237077:0:13560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677c00/0x5dfa74784542bad8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460098.237091:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8c4bc5dc1500) 00010000:00010000:1.0:1788460098.237094:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788460098.237099:0:13560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677c00/0x5dfa74784542bad8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460098.237106:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677c00/0x5dfa74784542bad8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460098.237121:0:13560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676800/0x5dfa74784542badf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460098.237127:0:13560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676800/0x5dfa74784542badf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460098.237132:0:13560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676800/0x5dfa74784542badf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460098.237137:0:13560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac3676800 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:1.0:1788460098.237140:0:13560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676800/0x5dfa74784542badf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460098.237146:0:13560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676800/0x5dfa74784542badf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460098.237163:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8c4bc2ab7400) 00010000:00010000:1.0:1788460098.237165:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788460098.237168:0:13560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676800/0x5dfa74784542badf lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460098.237174:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676800/0x5dfa74784542badf lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460098.237213:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676c00/0x5dfa74784542bad1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a891 expref: 56 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460098.237227:0:13560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677800/0x5dfa74784542bae6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a891 expref: 55 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460098.237235:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4bc5dc1900) 00010000:00010000:1.0:1788460098.237238:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788460098.237240:0:13560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ac3677800, rc 0) 00000100:00100000:1.0:1788460098.237340:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac43f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+55:12348:x1875336003408000:12345-192.168.206.5@tcp:101:lfs.0 Request processed in 803us (1109us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460098.237349:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 185 00010000:00010000:0.0:1788460098.323895:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788460098.323920:0:13811:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788460098.323927:0:13811:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788460098.324012:0:13811:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1788460098.324022:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788460098.324176:0:13811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac43f6a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13811:1875336022347136:192.168.206.5@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788460098.324305:0:13811:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc4d56b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788460098.329647:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460098.329860:0:13811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac43f6a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13811:1875336022347136:192.168.206.5@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788460098.330754:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003408128 00000100:00100000:2.0:1788460098.330769:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003408128 00000100:00100000:2.0:1788460098.330987:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 186 00000100:00100000:2.0:1788460098.331000:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac43f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+55:12359:x1875336003408128:12345-192.168.206.5@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788460098.331044:0:6535:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788460098.331200:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac43f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+55:12359:x1875336003408128:12345-192.168.206.5@tcp:53:lhsmtool_posix.0 Request processed in 202us (1564us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460098.331209:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 186 00000100:00100000:0.0:1788460098.340482:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460098.340903:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003408256 00000100:00100000:3.0:1788460098.340925:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003408256 00000100:00100000:3.0:1788460098.341062:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 187 00000100:00100000:3.0:1788460098.341073:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4385500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+55:12359:x1875336003408256:12345-192.168.206.5@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788460098.341185:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542baed lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460098.341208:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542baed lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460098.341221:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542baed lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460098.341237:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208200/0x5dfa74784542baf4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460098.341244:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208200/0x5dfa74784542baf4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460098.341250:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208200/0x5dfa74784542baf4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460098.341283:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f1e00/0x5dfa74784542bafb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460098.341292:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f1e00/0x5dfa74784542bafb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460098.341299:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f1e00/0x5dfa74784542bafb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788460098.341361:0:6534:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788460098.341366:0:6534:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788460098.341387:0:6534:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f1e00/0x5dfa74784542bafb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460098.341401:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542baed lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460098.341408:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542baed lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460098.341416:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542baed lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460098.341421:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bef208400 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:3.0:1788460098.341426:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542baed lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460098.341435:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542baed lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460098.341449:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c4bef1fde00) 00010000:00010000:3.0:1788460098.341452:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460098.341457:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542baed lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460098.341464:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542baed lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460098.341475:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208200/0x5dfa74784542baf4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460098.341482:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208200/0x5dfa74784542baf4 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460098.341488:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208200/0x5dfa74784542baf4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460098.341499:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bef208200 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:3.0:1788460098.341502:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208200/0x5dfa74784542baf4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460098.342809:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208200/0x5dfa74784542baf4 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460098.342828:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff8c4bef200000) 00010000:00010000:3.0:1788460098.342830:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460098.342835:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208200/0x5dfa74784542baf4 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460098.342842:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208200/0x5dfa74784542baf4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460098.342868:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f1e00/0x5dfa74784542bafb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460098.342875:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f1e00/0x5dfa74784542bafb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460098.342882:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f1e00/0x5dfa74784542bafb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460098.342889:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc14f1e00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:3.0:1788460098.342891:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f1e00/0x5dfa74784542bafb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460098.342898:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f1e00/0x5dfa74784542bafb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460098.342919:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4bc5dc1900) 00010000:00010000:3.0:1788460098.342921:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460098.342924:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f1e00/0x5dfa74784542bafb lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460098.342931:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f1e00/0x5dfa74784542bafb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460098.343077:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4385500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+55:12359:x1875336003408256:12345-192.168.206.5@tcp:34:lhsmtool_posix.0 Request processed in 2001us (2599us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460098.343088:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 187 00000100:00100000:3.0:1788460098.347400:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460098.347490:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003408512 00000100:00100000:0.0:1788460098.347506:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003408512 00000100:00100000:0.0:1788460098.347574:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 188 00000100:00100000:0.0:1788460098.347595:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac43f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+55:12359:x1875336003408512:12345-192.168.206.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788460098.347616:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460098.347636:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542bb02 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a898 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460098.347736:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542bb09 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460098.347751:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542bb09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460098.347761:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542bb09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788460098.347781:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788460098.347857:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542bb09 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460098.347866:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542bb09 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460098.347873:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542bb09 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460098.347879:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc2bd5c00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460098.349388:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542bb09 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460098.349413:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542bb09 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460098.349429:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4bc5dc1900) 00010000:00010000:0.0:1788460098.349432:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788460098.349436:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542bb09 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460098.349443:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542bb09 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460098.350128:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542bb02 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a898 expref: 57 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460098.350140:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c4bef1fde00) 00010000:00010000:0.0:1788460098.350143:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788460098.350168:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542bb02 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a898 expref: 57 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460098.350180:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc2bd4e00, rc 0) 00000100:00100000:0.0:1788460098.350252:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac43f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+56:12359:x1875336003408512:12345-192.168.206.5@tcp:101:lhsmtool_posix.0 Request processed in 2668us (2863us total) trans 4294967459 rc 301/301 00000100:00100000:0.0:1788460098.350260:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 188 00000100:00100000:2.0:1788460098.361725:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460098.361857:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003408640 00000100:00100000:0.0:1788460098.361871:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003408640 00000100:00100000:0.0:1788460098.361980:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 189 00000100:00100000:0.0:1788460098.361991:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3bc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+56:12359:x1875336003408640:12345-192.168.206.5@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788460098.362024:0:6535:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788460098.362139:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3bc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+56:12359:x1875336003408640:12345-192.168.206.5@tcp:53:lhsmtool_posix.0 Request processed in 150us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460098.362147:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 189 00000100:00100000:0.0:1788460098.372522:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460098.372668:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003408896 00000100:00100000:2.0:1788460098.372681:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003408896 00000100:00100000:2.0:1788460098.372761:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 190 00000100:00100000:2.0:1788460098.372773:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4385880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+56:12359:x1875336003408896:12345-192.168.206.5@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788460098.372799:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460098.372803:0:6534:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788460098.372836:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542bac3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a88a expref: 56 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460098.372858:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8c4bc5dc1500) 00010000:00010000:2.0:1788460098.372863:0:6534:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788460098.372880:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542bb17 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a89f expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788460098.373567:0:6534:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:2.0:1788460098.373748:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542bb1e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460098.373765:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542bb1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460098.373785:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542bb1e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460098.373855:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542bb17 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a89f expref: 58 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460098.373872:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542bb1e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a89f expref: 57 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460098.373880:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8c4bfa9fe500) 00010000:00010000:2.0:1788460098.373884:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788460098.373886:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bfadc7c00, rc 0) 00000100:00100000:2.0:1788460098.373995:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4385880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+57:12359:x1875336003408896:12345-192.168.206.5@tcp:101:lhsmtool_posix.0 Request processed in 1223us (1484us total) trans 4294967460 rc 0/0 00000100:00100000:2.0:1788460098.374005:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 190 00000100:00100000:2.0:1788460098.386439:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460098.386649:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003409152 00000100:00100000:1.0:1788460098.386661:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003409152 00000100:00100000:1.0:1788460098.386726:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 191 00000100:00100000:1.0:1788460098.386736:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3bc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+57:12359:x1875336003409152:12345-192.168.206.5@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788460098.386807:0:6533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788460098.386842:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542bb1e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a89f expref: 57 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460098.386881:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8c4bfa9fe500) 00010000:00010000:1.0:1788460098.386895:0:6533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788460098.386924:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677c00/0x5dfa74784542bb2c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460098.386940:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677c00/0x5dfa74784542bb2c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460098.386974:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677c00/0x5dfa74784542bb2c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460098.387178:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676e00/0x5dfa74784542bb33 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x11e0ffdd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460098.387199:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676e00/0x5dfa74784542bb33 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x11e0ffdd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460098.387211:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676e00/0x5dfa74784542bb33 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x11e0ffdd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460098.387257:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677c00/0x5dfa74784542bb2c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460098.387264:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677c00/0x5dfa74784542bb2c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460098.387270:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677c00/0x5dfa74784542bb2c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460098.387275:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac3677c00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:1.0:1788460098.387279:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677c00/0x5dfa74784542bb2c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460098.387299:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677c00/0x5dfa74784542bb2c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460098.387312:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8c4bc5dc1500) 00010000:00010000:1.0:1788460098.387314:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788460098.387319:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677c00/0x5dfa74784542bb2c lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460098.387325:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677c00/0x5dfa74784542bb2c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460098.387340:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676e00/0x5dfa74784542bb33 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x11e0ffdd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460098.387346:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676e00/0x5dfa74784542bb33 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x11e0ffdd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460098.387351:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676e00/0x5dfa74784542bb33 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x11e0ffdd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460098.387356:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac3676e00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:1.0:1788460098.387359:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676e00/0x5dfa74784542bb33 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x11e0ffdd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460098.387365:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676e00/0x5dfa74784542bb33 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x11e0ffdd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460098.387377:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x11e0ffdd (ffff8c4bc2ab7400) 00010000:00010000:1.0:1788460098.387381:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788460098.387384:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676e00/0x5dfa74784542bb33 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x11e0ffdd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460098.387455:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676e00/0x5dfa74784542bb33 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x11e0ffdd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460098.387561:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3bc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+56:12359:x1875336003409152:12345-192.168.206.5@tcp:36:lhsmtool_posix.0 Request processed in 822us (1131us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788460098.387571:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 191 00000100:00100000:1.0:1788460098.391787:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460098.397005:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003409280 00000100:00100000:2.0:1788460098.397019:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003409280 00000100:00100000:2.0:1788460098.397171:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 192 00000100:00100000:2.0:1788460098.397183:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc4719180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+56:12359:x1875336003409280:12345-192.168.206.5@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788460098.397201:0:13560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460098.397223:0:13560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542bb3a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a8a6 expref: -99 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460098.397256:0:13560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542bb41 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460098.397287:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542bb41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460098.397298:0:13560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542bb41 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460098.397416:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542bb3a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a8a6 expref: 58 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460098.397437:0:13560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542bb41 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a8a6 expref: 57 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460098.397446:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8c4bfa9fe800) 00010000:00010000:2.0:1788460098.397448:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788460098.397452:0:13560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bfadc7400, rc 0) 00000100:00100000:2.0:1788460098.397513:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc4719180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+57:12359:x1875336003409280:12345-192.168.206.5@tcp:101:lhsmtool_posix.0 Request processed in 333us (5736us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460098.397520:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 192 00000100:00100000:3.0:1788460098.404129:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460098.404716:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003409536 00000100:00100000:1.0:1788460098.404730:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003409536 00000100:00100000:1.0:1788460098.404800:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 193 00000100:00100000:1.0:1788460098.404810:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac43f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+57:12359:x1875336003409536:12345-192.168.206.5@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788460098.404916:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677e00/0x5dfa74784542bb48 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460098.404933:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677e00/0x5dfa74784542bb48 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460098.404963:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677e00/0x5dfa74784542bb48 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788460098.405239:0:7760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:3.0:1788460098.405258:0:7760:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 395508312466ns, next at 396508307886ns, rc = 0 00000004:00010000:3.0:1788460098.405341:0:7760:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c44a82c5 reply state 000000009249419d transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677e00/0x5dfa74784542bb48 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460098.405379:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677e00/0x5dfa74784542bb48 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460098.405390:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8c4bfa9fe800) 00010000:00010000:3.0:1788460098.405393:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788460098.405400:0:7760:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788460098.405561:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac43f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+59:12359:x1875336003409536:12345-192.168.206.5@tcp:36:lhsmtool_posix.0 Request processed in 749us (1443us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1788460098.405572:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 193 00000100:00100000:3.0:1788460098.412636:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460098.416267:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003409664 00000100:00100000:1.0:1788460098.416283:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003409664 00000100:00100000:1.0:1788460098.416352:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 194 00000100:00100000:1.0:1788460098.416364:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac43f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+59:12359:x1875336003409664:12345-192.168.206.5@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788460098.416387:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460098.416406:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676e00/0x5dfa74784542bb4f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a8ad expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460098.416471:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676e00/0x5dfa74784542bb4f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a8ad expref: 60 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460098.416485:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676e00/0x5dfa74784542bb4f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a8ad expref: 60 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460098.416503:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8c4bfa9fe800) 00010000:00010000:1.0:1788460098.416507:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788460098.416511:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ac3676e00, rc 0) 00000100:00100000:1.0:1788460098.416570:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac43f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+60:12359:x1875336003409664:12345-192.168.206.5@tcp:101:lhsmtool_posix.0 Request processed in 209us (3951us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460098.416578:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 194 00000100:00100000:3.0:1788460098.424793:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460098.426830:0:8832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003409792 00000100:00100000:1.0:1788460098.426846:0:8832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003409792 00000100:00100000:1.0:1788460098.426921:0:8832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 58 00000100:00080000:3.0:1788460098.426938:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788460098.426938:0:8832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac43f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+6:2393:x1875336003409792:12345-192.168.206.5@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788460098.427215:0:8832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac43f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+7:2393:x1875336003409792:12345-192.168.206.5@tcp:2:lhsmtool_posix.0 Request processed in 284us (2433us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1788460098.427223:0:8832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 58 00000100:00100000:0.0:1788460098.443277:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460098.444055:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003410048 00000100:00100000:1.0:1788460098.444065:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003410048 00000100:00100000:1.0:1788460098.444122:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 49 00000100:00100000:1.0:1788460098.444141:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4384a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+60:12359:x1875336003410048:12345-192.168.206.5@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788460098.444357:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4384a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+61:12359:x1875336003410048:12345-192.168.206.5@tcp:35:lhsmtool_posix.0 Request processed in 226us (1088us total) trans 4294967462 rc 0/0 00000100:00100000:1.0:1788460098.444375:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 49 00000100:00100000:2.0:1788460098.447652:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460098.447721:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003410304 00000100:00100000:1.0:1788460098.447730:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003410304 00000100:00100000:1.0:1788460098.447819:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 195 00000100:00100000:1.0:1788460098.447830:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3bc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+61:12359:x1875336003410304:12345-192.168.206.5@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788460098.447937:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3bc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+61:12359:x1875336003410304:12345-192.168.206.5@tcp:57:lhsmtool_posix.0 Request processed in 108us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460098.448094:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 195 00000100:00100000:1.0:1788460098.462076:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460098.462268:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003410432 00000100:00100000:0.0:1788460098.462280:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003410432 00000100:00100000:0.0:1788460098.462464:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 196 00000100:00100000:0.0:1788460098.462475:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc471a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+61:12359:x1875336003410432:12345-192.168.206.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788460098.462496:0:7760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460098.462515:0:7760:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542bb56 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a8b4 expref: -99 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460098.462694:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5a00/0x5dfa74784542bb5d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460098.462722:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5a00/0x5dfa74784542bb5d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460098.462732:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5a00/0x5dfa74784542bb5d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788460098.462769:0:7760:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788460098.462785:0:7760:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5a00/0x5dfa74784542bb5d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460098.462806:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542bb56 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a8b4 expref: 63 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460098.462821:0:7760:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5a00/0x5dfa74784542bb5d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a8b4 expref: 62 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460098.462829:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8c4bfa9fe800) 00010000:00010000:0.0:1788460098.462831:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788460098.462835:0:7760:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc2bd5a00, rc 0) 00000100:00100000:0.0:1788460098.466100:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc471a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+62:12359:x1875336003410432:12345-192.168.206.5@tcp:101:lhsmtool_posix.0 Request processed in 3615us (4023us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460098.466113:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 196 00000100:00100000:1.0:1788460098.475766:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460098.476383:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003410560 00000100:00100000:3.0:1788460098.476401:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003410560 00000100:00100000:3.0:1788460098.476485:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 59 00000100:00100000:3.0:1788460098.476496:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc471b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+7:2393:x1875336003410560:12345-192.168.206.5@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788460098.476534:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460098.476667:0:8448:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005069e1ce/0x5dfa74784542bb64 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a8bb expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788460098.476700:0:8448:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a99bc41, blocks: 0x0 00010000:00010000:3.0:1788460098.476725:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=395s v=(0 0) 00010000:00010000:3.0:1788460098.476731:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788460098.476742:0:8448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005069e1ce/0x5dfa74784542bb64 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a8bb expref: 8 pid: 8448 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460098.476764:0:8448:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005069e1ce/0x5dfa74784542bb64 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a8bb expref: 8 pid: 8448 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460098.476838:0:8448:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ac395f600, rc 0) 00000100:00100000:3.0:1788460098.476912:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc471b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+8:2393:x1875336003410560:12345-192.168.206.5@tcp:101:lhsmtool_posix.0 Request processed in 418us (1154us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460098.476920:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 59 00000100:00100000:2.0:1788460098.481048:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460098.481204:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003410816 00000100:00100000:3.0:1788460098.481218:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003410816 00000100:00100000:3.0:1788460098.481347:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 197 00000100:00100000:3.0:1788460098.481360:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3bc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+62:12359:x1875336003410816:12345-192.168.206.5@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788460098.481540:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3bc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+62:12359:x1875336003410816:12345-192.168.206.5@tcp:57:lhsmtool_posix.0 Request processed in 182us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460098.481550:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 197 00000100:00100000:3.0:1788460098.493038:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460098.494028:0:8832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003410944 00000100:00100000:2.0:1788460098.494046:0:8832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003410944 00000100:00100000:2.0:1788460098.494129:0:8832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 60 00000100:00100000:2.0:1788460098.494142:0:8832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac43f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+8:12359:x1875336003410944:12345-192.168.206.5@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788460098.494167:0:8832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460098.494191:0:8832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000504a61f/0x5dfa74784542bb6b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a8c2 expref: -99 pid: 8832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460098.494250:0:8832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005069e1ce/0x5dfa74784542bb64 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a8bb expref: 9 pid: 8448 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460098.494261:0:8832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788460098.494267:0:8832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788460098.494274:0:8832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000504a61f/0x5dfa74784542bb6b lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a8c2 expref: 9 pid: 8832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460098.494318:0:8832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005069e1ce/0x5dfa74784542bb64 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a8bb expref: 9 pid: 8448 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460098.494335:0:8832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005069e1ce/0x5dfa74784542bb64 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a8bb expref: 9 pid: 8448 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460098.494354:0:8832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3bc0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8832:1875336022347264:192.168.206.5@tcp:104: 00000100:00100000:2.0:1788460098.494485:0:8832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bf74efd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788460098.505986:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460098.506147:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003411072 00000100:00100000:3.0:1788460098.506161:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003411072 00010000:00010000:3.0:1788460098.506222:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005069e1ce/0x5dfa74784542bb64 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a8bb expref: 10 pid: 8448 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460098.506277:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 96 00000100:00100000:3.0:1788460098.506290:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4367800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+10:2394:x1875336003411072:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788460098.506308:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788460098.506336:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005069e1ce/0x5dfa74784542bb64 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a8bb expref: 10 pid: 8448 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460098.506353:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005069e1ce/0x5dfa74784542bb64 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a8bb expref: 10 pid: 8448 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460098.506389:0:6520:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788460098.506395:0:6520:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788460098.506407:0:6520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000504a61f/0x5dfa74784542bb6b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a8c2 expref: 10 pid: 8832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460098.506421:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000504a61f/0x5dfa74784542bb6b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a8c2 expref: 10 pid: 8832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460098.506524:0:6520:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000000504a61f/0x5dfa74784542bb6b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a8c2 expref: 10 pid: 8832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460098.506544:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac484c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6520:1875336022347392:192.168.206.5@tcp:105: 00000100:00100000:3.0:1788460098.506652:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc4d56780 going to sleep for 11 seconds 00000100:00100000:0.0:1788460098.510260:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac484c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6520:1875336022347392:192.168.206.5@tcp:105: 00010000:00010000:0.0:1788460098.510298:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788460098.510374:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4367800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+10:2394:x1875336003411072:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 4087us (4403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460098.510388:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 96 00010000:00010000:2.0:1788460098.514109:0:8832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005069e1ce/0x5dfa74784542bb64 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a8bb expref: 9 pid: 8448 timeout: 495 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460098.514145:0:8832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3bc0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8832:1875336022347264:192.168.206.5@tcp:104: 00010000:00010000:2.0:1788460098.514195:0:8832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000504a61f/0x5dfa74784542bb6b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a8c2 expref: 8 pid: 8832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460098.514215:0:8832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bfadc7600, rc 0) 00000100:00100000:2.0:1788460098.514386:0:8832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac43f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+8:12359:x1875336003410944:12345-192.168.206.5@tcp:101:lhsmtool_posix.0 Request processed in 20246us (21363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460098.514396:0:8832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 60 00000100:00100000:3.0:1788460098.532007:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460098.532120:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003411200 00000100:00100000:0.0:1788460098.532135:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003411200 00002000:00100000:0.0:1788460098.532204:0:8453:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff8c4ac484fb80 x1875336003411200/t0(0) o4->f8767d3e-bfef-4d3d-8163-ef8ae18a3514@192.168.206.5@tcp:254/0 lens 504/0 e 0 to 0 dl 1788460109 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788460098.532217:0:8453:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c4ac484fb80 with x1875336003411200 ext(0->8) 00002000:00010000:0.0:1788460098.532224:0:8453:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c4ac484fb80 00000100:00100000:0.0:1788460098.532260:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 4 00000100:00100000:0.0:1788460098.532271:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac484fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+8:2395:x1875336003411200:12345-192.168.206.5@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788460098.533268:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac484fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+10:2395:x1875336003411200:12345-192.168.206.5@tcp:4:lhsmtool_posix.0 Request processed in 992us (1317us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1788460098.533280:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 4 00002000:00100000:0.0:1788460098.533291:0:8453:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff8c4ac484fb80 x1875336003411200/t4294967315(0) o4->f8767d3e-bfef-4d3d-8163-ef8ae18a3514@192.168.206.5@tcp:254/0 lens 504/448 e 0 to 0 dl 1788460109 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788460098.533301:0:8453:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c4ac484fb80 with x1875336003411200 ext(0->8) 00002000:00010000:0.0:1788460098.533306:0:8453:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c4ac484fb80 00000100:00100000:3.0:1788460098.535140:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460098.535292:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003411328 00000100:00100000:2.0:1788460098.535305:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003411328 00000100:00100000:2.0:1788460098.535376:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 198 00000100:00100000:2.0:1788460098.535388:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac484c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+62:12359:x1875336003411328:12345-192.168.206.5@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788460098.539261:0:6513:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:2.0:1788460098.539279:0:6513:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00010000:00010000:0.0:1788460098.539370:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4000/0x5dfa74784542b9dc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788460098.539375:0:6513:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00010000:00010000:0.0:1788460098.539393:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4000/0x5dfa74784542b9dc lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788460098.539398:0:6513:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8c4bd47b99c0 refcount 2 committed 0 result 0 batchid 5 00010000:00010000:0.0:1788460098.539405:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4000/0x5dfa74784542b9dc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788460098.539407:0:6513:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8c4bfae89400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8c4bd47b9840 00000020:00080000:2.0:1788460098.539417:0:6513:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8c4bfae89300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8c4ac2bbc200 00010000:00010000:0.0:1788460098.539430:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc2bd4000 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460098.539440:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4000/0x5dfa74784542b9dc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460098.539475:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4000/0x5dfa74784542b9dc lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460098.539497:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4bc5dc1900) 00010000:00010000:0.0:1788460098.539501:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460098.539508:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4000/0x5dfa74784542b9dc lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460098.539514:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4000/0x5dfa74784542b9dc lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460098.539537:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208c00/0x5dfa74784542b9ff lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460098.539543:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208c00/0x5dfa74784542b9ff lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460098.539549:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208c00/0x5dfa74784542b9ff lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460098.539554:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bef208c00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460098.539557:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208c00/0x5dfa74784542b9ff lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460098.539562:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208c00/0x5dfa74784542b9ff lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460098.539570:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4bc5dc1900) 00010000:00010000:0.0:1788460098.539573:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460098.539575:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208c00/0x5dfa74784542b9ff lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460098.539604:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208c00/0x5dfa74784542b9ff lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460098.539618:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5000/0x5dfa74784542ba45 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460098.539625:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5000/0x5dfa74784542ba45 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460098.539631:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5000/0x5dfa74784542ba45 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460098.539635:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc2bd5000 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460098.539638:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5000/0x5dfa74784542ba45 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460098.539644:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5000/0x5dfa74784542ba45 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460098.539719:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4bc5dc1900) 00010000:00010000:0.0:1788460098.539722:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460098.539727:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5000/0x5dfa74784542ba45 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460098.539734:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5000/0x5dfa74784542ba45 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460098.539748:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677e00/0x5dfa74784542bb48 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460098.539755:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677e00/0x5dfa74784542bb48 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460098.539770:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677e00/0x5dfa74784542bb48 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460098.539788:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac3677e00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460098.539793:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677e00/0x5dfa74784542bb48 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460098.539801:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677e00/0x5dfa74784542bb48 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460098.539812:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8c4bfa9fe800) 00010000:00010000:0.0:1788460098.539815:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788460098.539819:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677e00/0x5dfa74784542bb48 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460098.539826:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677e00/0x5dfa74784542bb48 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788460098.539908:0:6565:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1788460098.539985:0:6565:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1788460098.540003:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3bc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022347520:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788460098.540067:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460098.540205:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac484c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+19:12359:x1875336003411328:12345-192.168.206.5@tcp:44:lhsmtool_posix.0 Request processed in 4817us (5077us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460098.540215:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 198 00000100:00100000:0.0:1788460098.541127:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022347520 00000100:00100000:0.0:1788460098.541142:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022347520 00000100:00100000:0.0:1788460098.541219:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788460098.541233:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc5329c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3659:x1875336022347520:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788460098.541271:0:8450:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:4 count 1 00002000:00010000:0.0:1788460098.541313:0:8450:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a99bc3e, atime: 0x6a99bc3f, ctime: 0x6a99bc3e, blocks: 0x8 00010000:00010000:0.0:1788460098.541322:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b97a320d/0x5dfa74784542bb72 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460098.541340:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=395s v=(0 0) 00010000:00010000:0.0:1788460098.541346:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460098.541369:0:8450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b97a320d/0x5dfa74784542bb72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460098.541388:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b97a320d/0x5dfa74784542bb72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460098.541399:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b97a320d/0x5dfa74784542bb72 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460098.541409:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b97a320d/0x5dfa74784542bb72 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460098.541429:0:8450:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788460098.541768:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc5329c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3659:x1875336022347520:12345-0@lo:6:osp-syn-1-0.0 Request processed in 538us (1699us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1788460098.541779:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00010000:0.0:1788460098.541814:0:9537:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788460098.541822:0:9537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b97a320d/0x5dfa74784542bb72 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460098.541831:0:9537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc2bd4200 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:0.0:1788460098.541835:0:9537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b97a320d/0x5dfa74784542bb72 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460098.541845:0:9537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b97a320d/0x5dfa74784542bb72 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460098.541878:0:9537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b97a320d/0x5dfa74784542bb72 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460098.541887:0:9537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b97a320d/0x5dfa74784542bb72 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460098.541910:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460098.541912:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460098.541914:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788460098.543491:0:3659:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8c4ac3bc0000/2, rc 0, transno 4294967308 00000100:00100000:0.0:1788460098.543511:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3bc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022347520:0@lo:6:osp-syn-1-0.0 00000100:00080000:2.0:1788460098.543672:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788460098.545208:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac484dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022347648:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788460098.545250:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460098.545338:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003411456 00000100:00100000:3.0:1788460098.545346:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003411456 00000100:00100000:3.0:1788460098.545448:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 62 00000100:00100000:3.0:1788460098.545471:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc5329880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+10:2395:x1875336003411456:12345-192.168.206.5@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788460098.545569:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460098.556573:0:8832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022347648 00000001:00080000:0.0:1788460098.556578:0:8443:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:2.0:1788460098.556598:0:8832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022347648 00000100:00100000:2.0:1788460098.556864:0:8832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788460098.556875:0:8832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4367100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022347648:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1788460098.557032:0:8832:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788460098.557036:0:8832:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788460097 00002000:00010000:2.0:1788460098.557038:0:8832:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788460098.557040:0:8832:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1788460097 -> 1788460097 00002000:00010000:2.0:1788460098.557042:0:8832:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1788460098.557106:0:8832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4367100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3660:x1875336022347648:12345-0@lo:2:osp-syn-0-0.0 Request processed in 230us (11535us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1788460098.557114:0:8832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000004:00080000:2.0:1788460098.557186:0:3660:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8c4ac484dc00/2, rc 0, transno 4294967316 00000100:00100000:2.0:1788460098.557193:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac484dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022347648:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788460098.557710:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc5329880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+7:2395:x1875336003411456:12345-192.168.206.5@tcp:16:lhsmtool_posix.0 Request processed in 12248us (12463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460098.557718:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 62 00000100:00100000:2.0:1788460098.564786:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460098.564900:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003411712 00000100:00100000:1.0:1788460098.564919:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003411712 00000100:00100000:1.0:1788460098.565068:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 199 00000100:00100000:1.0:1788460098.565083:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc5329f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+19:12359:x1875336003411712:12345-192.168.206.5@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788460098.565161:0:7760:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788460098.565197:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5a00/0x5dfa74784542bb5d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a8b4 expref: 19 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460098.565221:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8c4bfa9fe800) 00010000:00010000:1.0:1788460098.565228:0:7760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788460098.565264:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676a00/0x5dfa74784542bb79 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460098.565280:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676a00/0x5dfa74784542bb79 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460098.565292:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676a00/0x5dfa74784542bb79 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788460098.565473:0:7760:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008173c8bd reply state 00000000ef24820e transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676a00/0x5dfa74784542bb79 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460098.565489:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676a00/0x5dfa74784542bb79 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460098.565496:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8c4bfa9fe800) 00010000:00010000:1.0:1788460098.565499:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788460098.565503:0:7760:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788460098.565644:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc5329f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+20:12359:x1875336003411712:12345-192.168.206.5@tcp:36:lhsmtool_posix.0 Request processed in 565us (874us total) trans 4294967463 rc 0/0 00000100:00100000:1.0:1788460098.565653:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 199 00000100:00100000:1.0:1788460098.575264:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460098.577301:0:8832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003411840 00000100:00100000:2.0:1788460098.577325:0:8832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003411840 00000100:00100000:0.0:1788460098.585123:0:8832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 64 00000100:00100000:0.0:1788460098.585148:0:8832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4287b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+7:2396:x1875336003411840:12345-192.168.206.5@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788460098.585338:0:8832:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1788460098.585343:0:8832:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1788460097 -> 1788460096 00002000:00010000:0.0:1788460098.585347:0:8832:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788460095 00002000:00010000:0.0:1788460098.585349:0:8832:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1788460097 -> 1788460096 00002000:00010000:0.0:1788460098.585352:0:8832:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1788460098.585449:0:8832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4287b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+8:2396:x1875336003411840:12345-192.168.206.5@tcp:2:lhsmtool_posix.0 Request processed in 311us (10627us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1788460098.585459:0:8832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 64 00000100:00100000:2.0:1788460098.602604:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460098.602684:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003412096 00000100:00100000:1.0:1788460098.602696:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003412096 00000100:00100000:1.0:1788460098.602771:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 200 00000100:00100000:1.0:1788460098.602785:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc532a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+20:12359:x1875336003412096:12345-192.168.206.5@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788460098.602871:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677c00/0x5dfa74784542bb80 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460098.602892:0:6534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542bb41 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a8a6 expref: 20 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460098.602903:0:6534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677c00/0x5dfa74784542bb80 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460098.602972:0:6534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542bb41 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a8a6 expref: 20 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460098.603010:0:6534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542bb41 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a8a6 expref: 20 pid: 13560 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460098.603026:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4285880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6534:1875336022347776:192.168.206.5@tcp:104: 00000100:00100000:1.0:1788460098.603128:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac36aab40 going to sleep for 11 seconds 00000100:00100000:1.0:1788460098.607886:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460098.607926:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003412224 00000100:00100000:1.0:1788460098.607937:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003412224 00010000:00010000:1.0:1788460098.608012:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542bb41 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a8a6 expref: 21 pid: 13560 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460098.608056:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 97 00000100:00100000:1.0:1788460098.608066:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bedf6f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+21:2394:x1875336003412224:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788460098.608083:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788460098.608091:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542bb41 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a8a6 expref: 21 pid: 13560 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460098.608106:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542bb41 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a8a6 expref: 21 pid: 13560 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460098.608133:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8c4bfa9fe800) 00010000:00010000:1.0:1788460098.608139:0:6518:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677c00/0x5dfa74784542bb80 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460098.608150:0:6518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677c00/0x5dfa74784542bb80 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460098.608182:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677c00/0x5dfa74784542bb80 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460098.608205:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788460098.608338:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542bb41 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a8a6 expref: 21 pid: 13560 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460098.608357:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4285880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6534:1875336022347776:192.168.206.5@tcp:104: 00010000:00010000:3.0:1788460098.608382:0:6534:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677c00/0x5dfa74784542bb80 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460098.608392:0:6534:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677c00/0x5dfa74784542bb80 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460098.608398:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677c00/0x5dfa74784542bb80 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460098.608445:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677c00/0x5dfa74784542bb80 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460098.608464:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677c00/0x5dfa74784542bb80 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460098.608471:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677c00/0x5dfa74784542bb80 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460098.608478:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac3677c00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:3.0:1788460098.608483:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677c00/0x5dfa74784542bb80 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460098.608493:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677c00/0x5dfa74784542bb80 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460098.608504:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8c4bfa9fe800) 00010000:00010000:3.0:1788460098.608507:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788460098.608512:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677c00/0x5dfa74784542bb80 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460098.608519:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677c00/0x5dfa74784542bb80 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460098.612252:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bedf6f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+20:2394:x1875336003412224:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 4169us (4363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460098.612272:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 97 00000100:00100000:3.0:1788460098.613247:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc532a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+19:12359:x1875336003412096:12345-192.168.206.5@tcp:55:lhsmtool_posix.0 Request processed in 10458us (10646us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788460098.613262:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 200 00000100:00100000:1.0:1788460098.617620:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460098.617695:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003412352 00000100:00100000:0.0:1788460098.617708:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003412352 00000100:00100000:0.0:1788460098.617776:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 65 00000100:00100000:0.0:1788460098.617788:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4285880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+8:2395:x1875336003412352:12345-192.168.206.5@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788460098.617858:0:8450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ecd5c5d2/0x5dfa74784542bb87 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460098.617883:0:8450:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000504a61f/0x5dfa74784542bb6b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a8c2 expref: 8 pid: 8832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460098.617893:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460098.617898:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788460098.617903:0:8450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ecd5c5d2/0x5dfa74784542bb87 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460098.617981:0:8450:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000504a61f/0x5dfa74784542bb6b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a8c2 expref: 8 pid: 8832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460098.617998:0:8450:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000504a61f/0x5dfa74784542bb6b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a8c2 expref: 8 pid: 8832 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460098.618015:0:8450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4365880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8450:1875336022347904:192.168.206.5@tcp:104: 00000100:00100000:0.0:1788460098.618111:0:8450:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bd47b9c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788460098.621328:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460098.621371:0:9549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003412480 00000100:00100000:2.0:1788460098.621382:0:9549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003412480 00010000:00010000:2.0:1788460098.621431:0:9549:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000504a61f/0x5dfa74784542bb6b lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a8c2 expref: 9 pid: 8832 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460098.621475:0:9549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 98 00000100:00100000:2.0:1788460098.621486:0:9549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc5329180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+9:2393:x1875336003412480:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788460098.621503:0:9549:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460098.621529:0:9549:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000504a61f/0x5dfa74784542bb6b lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a8c2 expref: 9 pid: 8832 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460098.621565:0:9549:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000504a61f/0x5dfa74784542bb6b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a8c2 expref: 9 pid: 8832 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460098.621713:0:8450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4365880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8450:1875336022347904:192.168.206.5@tcp:104: 00010000:00010000:0.0:1788460098.625282:0:8450:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ecd5c5d2/0x5dfa74784542bb87 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460098.626491:0:9549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000504a61f/0x5dfa74784542bb6b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a8c2 expref: 9 pid: 8832 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460098.626606:0:9549:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788460098.626612:0:9549:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788460098.626618:0:9549:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ecd5c5d2/0x5dfa74784542bb87 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460098.626631:0:9549:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ecd5c5d2/0x5dfa74784542bb87 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460098.626687:0:9549:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788460098.627076:0:8450:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ecd5c5d2/0x5dfa74784542bb87 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460098.627089:0:8450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ecd5c5d2/0x5dfa74784542bb87 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460098.627124:0:8450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ecd5c5d2/0x5dfa74784542bb87 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460098.627134:0:8450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ecd5c5d2/0x5dfa74784542bb87 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460098.627143:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ecd5c5d2/0x5dfa74784542bb87 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460098.627151:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc2bd5000 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:0.0:1788460098.627156:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ecd5c5d2/0x5dfa74784542bb87 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460098.627166:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ecd5c5d2/0x5dfa74784542bb87 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460098.627199:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ecd5c5d2/0x5dfa74784542bb87 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460098.627207:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ecd5c5d2/0x5dfa74784542bb87 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460098.627268:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4285880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+8:2395:x1875336003412352:12345-192.168.206.5@tcp:1:lhsmtool_posix.0 Request processed in 9481us (9660us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460098.627280:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 65 00000100:00100000:2.0:1788460098.628226:0:9549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc5329180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+7:2393:x1875336003412480:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 5291us (5461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460098.628240:0:9549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 98 00000100:00100000:2.0:1788460098.639193:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460098.639271:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003412736 00000100:00100000:3.0:1788460098.639284:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003412736 00000100:00100000:3.0:1788460098.639356:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 201 00000100:00100000:3.0:1788460098.639367:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac43a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+19:12359:x1875336003412736:12345-192.168.206.5@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788460098.639474:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f400/0x5dfa74784542bb8e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460098.639504:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209800/0x5dfa74784542b9d5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a84b expref: 19 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460098.639515:0:6535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f400/0x5dfa74784542bb8e lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460098.639559:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209800/0x5dfa74784542b9d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a84b expref: 19 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460098.639576:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209800/0x5dfa74784542b9d5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a84b expref: 19 pid: 13560 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460098.639607:0:6535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac484f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6535:1875336022348032:192.168.206.5@tcp:104: 00000100:00100000:3.0:1788460098.639708:0:6535:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc11ca000 going to sleep for 11 seconds 00000100:00100000:2.0:1788460098.641420:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788460098.641442:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac43a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022348160:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788460098.641513:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460098.641563:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022348160 00000100:00100000:2.0:1788460098.641571:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022348160 00000100:00100000:2.0:1788460098.641634:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788460098.641643:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac43a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022348160:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788460098.641685:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1788460098.641735:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac43a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022348160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460098.641742:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788460098.641800:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac43a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022348160:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788460098.642859:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788460098.642874:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4365880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022348288:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788460098.642920:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460098.643022:0:6535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac484f800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6535:1875336022348032:192.168.206.5@tcp:104: 00010000:00010000:3.0:1788460098.643046:0:6535:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f400/0x5dfa74784542bb8e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460098.643141:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460098.643165:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003412864 00000100:00100000:3.0:1788460098.643170:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003412864 00010000:00010000:3.0:1788460098.643199:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209800/0x5dfa74784542b9d5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a84b expref: 20 pid: 13560 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460098.643244:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 99 00000100:00100000:3.0:1788460098.643253:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac484f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+20:2394:x1875336003412864:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788460098.643268:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788460098.643276:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209800/0x5dfa74784542b9d5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a84b expref: 20 pid: 13560 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460098.643289:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209800/0x5dfa74784542b9d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a84b expref: 20 pid: 13560 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460098.643313:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209800/0x5dfa74784542b9d5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a84b expref: 20 pid: 13560 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460098.643327:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4bc5dc1900) 00010000:00010000:3.0:1788460098.643333:0:6520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f400/0x5dfa74784542bb8e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460098.643344:0:6520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f400/0x5dfa74784542bb8e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460098.643353:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f400/0x5dfa74784542bb8e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460098.643375:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788460098.643426:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac484f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+19:2394:x1875336003412864:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 173us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460098.643433:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 99 00010000:00010000:3.0:1788460098.643459:0:6535:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f400/0x5dfa74784542bb8e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460098.643472:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f400/0x5dfa74784542bb8e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460098.643680:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f600/0x5dfa74784542bb95 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460098.643692:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676e00/0x5dfa74784542bb4f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a8ad expref: 19 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460098.643701:0:6535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f600/0x5dfa74784542bb95 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460098.643726:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676e00/0x5dfa74784542bb4f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a8ad expref: 19 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460098.643740:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676e00/0x5dfa74784542bb4f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a8ad expref: 19 pid: 6533 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460098.643754:0:6535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac484ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6535:1875336022348416:192.168.206.5@tcp:104: 00000100:00100000:3.0:1788460098.643801:0:6535:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc11ca300 going to sleep for 11 seconds 00000100:00100000:0.0:1788460098.644466:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022348288 00000100:00100000:0.0:1788460098.644476:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022348288 00000100:00100000:0.0:1788460098.644554:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788460098.644564:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac484df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022348288:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788460098.644599:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923509248 avail 3691958272 00000100:00100000:0.0:1788460098.644663:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac484df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022348288:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (1742us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460098.644670:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788460098.644830:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4365880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022348288:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788460098.646398:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788460098.649590:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460098.649656:0:6535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac484ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6535:1875336022348416:192.168.206.5@tcp:104: 00010000:00010000:3.0:1788460098.649691:0:6535:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f600/0x5dfa74784542bb95 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460098.649762:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003412992 00000100:00100000:1.0:1788460098.649771:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003412992 00010000:00010000:1.0:1788460098.649819:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676e00/0x5dfa74784542bb4f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a8ad expref: 20 pid: 6533 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460098.649996:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 100 00000100:00100000:1.0:1788460098.650008:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac43a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+20:2393:x1875336003412992:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788460098.650027:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788460098.650035:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676e00/0x5dfa74784542bb4f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a8ad expref: 20 pid: 6533 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460098.650049:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676e00/0x5dfa74784542bb4f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a8ad expref: 20 pid: 6533 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460098.650077:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676e00/0x5dfa74784542bb4f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a8ad expref: 20 pid: 6533 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460098.650095:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8c4bfa9fe800) 00010000:00010000:1.0:1788460098.650101:0:6518:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f600/0x5dfa74784542bb95 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460098.650131:0:6518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f600/0x5dfa74784542bb95 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460098.650140:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f600/0x5dfa74784542bb95 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460098.650175:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788460098.650236:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac43a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+19:2393:x1875336003412992:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 229us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460098.650244:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 100 00010000:00010000:2.0:1788460098.650426:0:6535:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f600/0x5dfa74784542bb95 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460098.650434:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f600/0x5dfa74784542bb95 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788460098.650595:0:6535:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:2.0:1788460098.650736:0:6535:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:2.0:1788460098.650783:0:6535:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:2.0:1788460098.650873:0:6535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac43a9180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6535:1875336022348544:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788460098.650931:0:6535:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460098.651156:0:6535:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bf74ef480 going to sleep for 11 seconds 00000100:00100000:1.0:1788460098.651993:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022348544 00000100:00100000:1.0:1788460098.652007:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022348544 00000100:00100000:1.0:1788460098.652073:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788460098.652082:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac43ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6535:x1875336022348544:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788460098.652215:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac43ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6535:x1875336022348544:12345-0@lo:1000:mdt00_002.0 Request processed in 133us (1282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460098.652223:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788460098.652459:0:6535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac43a9180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6535:1875336022348544:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1788460098.652629:0:6535:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:2.0:1788460098.652708:0:6535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac43a9180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6535:1875336022348672:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788460098.652750:0:6535:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460098.653140:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022348672 00000100:00100000:3.0:1788460098.653147:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022348672 00000100:00100000:3.0:1788460098.653188:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788460098.653202:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac43a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6535:x1875336022348672:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788460098.653338:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac43a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6535:x1875336022348672:12345-0@lo:1000:mdt00_002.0 Request processed in 137us (587us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1788460098.653346:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788460098.653896:0:6535:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bf74ef3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788460098.653930:0:6535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac43a9180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6535:1875336022348672:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1788460098.654051:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f600/0x5dfa74784542bb95 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460098.654073:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f600/0x5dfa74784542bb95 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460098.654080:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f600/0x5dfa74784542bb95 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460098.654087:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac395f600 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:2.0:1788460098.654092:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f600/0x5dfa74784542bb95 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460098.654101:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f600/0x5dfa74784542bb95 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460098.654118:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8c4bfa9fe800) 00010000:00010000:2.0:1788460098.654121:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788460098.654127:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f600/0x5dfa74784542bb95 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460098.654132:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f600/0x5dfa74784542bb95 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460098.654158:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677a00/0x5dfa74784542baca lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460098.654163:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677a00/0x5dfa74784542baca lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460098.654168:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677a00/0x5dfa74784542baca lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460098.654173:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac3677a00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:2.0:1788460098.654181:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677a00/0x5dfa74784542baca lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460098.654187:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677a00/0x5dfa74784542baca lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460098.654196:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4bc5dc1900) 00010000:00010000:2.0:1788460098.654198:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788460098.654200:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677a00/0x5dfa74784542baca lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460098.654206:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677a00/0x5dfa74784542baca lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460098.654229:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542bb9c lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460098.654243:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677800/0x5dfa74784542bae6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a891 expref: 22 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460098.654252:0:6535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542bb9c lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460098.654285:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677800/0x5dfa74784542bae6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a891 expref: 22 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460098.654300:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677800/0x5dfa74784542bae6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a891 expref: 22 pid: 13560 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460098.654313:0:6535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac43abb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6535:1875336022348800:192.168.206.5@tcp:104: 00000100:00100000:2.0:1788460098.655204:0:6535:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc6b9b180 going to sleep for 11 seconds 00000100:00100000:2.0:1788460098.665026:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460098.665116:0:6535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac43abb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6535:1875336022348800:192.168.206.5@tcp:104: 00010000:00010000:3.0:1788460098.665163:0:6535:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542bb9c lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460098.665281:0:9549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003413120 00000100:00100000:1.0:1788460098.665290:0:9549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003413120 00010000:00010000:1.0:1788460098.665339:0:9549:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677800/0x5dfa74784542bae6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a891 expref: 23 pid: 13560 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460098.665383:0:9549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 101 00000100:00100000:1.0:1788460098.665394:0:9549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac43a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+23:2394:x1875336003413120:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788460098.665414:0:9549:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788460098.665423:0:9549:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677800/0x5dfa74784542bae6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a891 expref: 23 pid: 13560 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460098.665458:0:9549:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677800/0x5dfa74784542bae6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a891 expref: 23 pid: 13560 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460098.665486:0:9549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677800/0x5dfa74784542bae6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a891 expref: 23 pid: 13560 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460098.665504:0:9549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4bc5dc1900) 00010000:00010000:1.0:1788460098.665520:0:9549:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542bb9c lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460098.665532:0:9549:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542bb9c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460098.665541:0:9549:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542bb9c lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460098.665571:0:9549:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788460098.665611:0:6535:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542bb9c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460098.665619:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542bb9c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460098.665632:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542bb9c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460098.665639:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542bb9c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460098.665643:0:9549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac43a8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+22:2394:x1875336003413120:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 251us (631us total) trans 0 rc 0/0 00010000:00010000:2.0:1788460098.665646:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542bb9c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460098.665651:0:9549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 101 00010000:00010000:2.0:1788460098.665653:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bfadc7600 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:2.0:1788460098.665657:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542bb9c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460098.665665:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542bb9c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460098.665676:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4bc5dc1900) 00010000:00010000:2.0:1788460098.665679:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460098.665683:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542bb9c lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460098.665689:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542bb9c lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460098.665701:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f400/0x5dfa74784542bb8e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460098.665717:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f400/0x5dfa74784542bb8e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460098.665722:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f400/0x5dfa74784542bb8e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460098.665727:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac395f400 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:2.0:1788460098.665730:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f400/0x5dfa74784542bb8e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460098.665735:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f400/0x5dfa74784542bb8e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460098.665744:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4bc5dc1900) 00010000:00010000:2.0:1788460098.665745:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788460098.665748:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f400/0x5dfa74784542bb8e lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460098.665753:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f400/0x5dfa74784542bb8e lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460098.666008:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac43a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+21:12359:x1875336003412736:12345-192.168.206.5@tcp:57:lhsmtool_posix.0 Request processed in 26641us (26829us total) trans 4294967468 rc 0/0 00000100:00100000:2.0:1788460098.666019:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 201 00000020:00080000:2.0:1788460098.666023:0:6535:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788460098.666122:0:13811:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788460098.666128:0:13811:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788460098.666620:0:13811:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:3.0:1788460098.666631:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788460098.676288:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460098.681118:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003413376 00000100:00100000:1.0:1788460098.681138:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003413376 00000100:00100000:1.0:1788460098.681221:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 50 00000100:00100000:1.0:1788460098.681233:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc6be0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+21:12359:x1875336003413376:12345-192.168.206.5@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788460098.681767:0:6536:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788460098.681808:0:6536:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:1.0:1788460098.681849:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677800/0x5dfa74784542bba3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460098.681877:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677800/0x5dfa74784542bba3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460098.681891:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677800/0x5dfa74784542bba3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460098.681902:0:6536:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677800/0x5dfa74784542bba3 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460098.681909:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677800/0x5dfa74784542bba3 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460098.681916:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677800/0x5dfa74784542bba3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460098.682622:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788460098.682632:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677800/0x5dfa74784542bba3 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460098.682642:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac3677800 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:0.0:1788460098.682647:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677800/0x5dfa74784542bba3 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460098.682668:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677800/0x5dfa74784542bba3 lrc: 5/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460098.682683:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8c4bfa9fe800) 00010000:00010000:0.0:1788460098.682686:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788460098.682692:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677800/0x5dfa74784542bba3 lrc: 3/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460098.682701:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460098.682703:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460098.682705:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460098.682747:0:6536:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788460098.682753:0:6536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677800/0x5dfa74784542bba3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460098.682890:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc6be0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+23:12359:x1875336003413376:12345-192.168.206.5@tcp:35:lhsmtool_posix.0 Request processed in 1655us (6611us total) trans 4294967470 rc 0/0 00000100:00100000:1.0:1788460098.682900:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 50 00000020:00080000:1.0:1788460098.682906:0:6536:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:0.0:1788460099.115128:0:14724:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788460099.115141:0:14724:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788460099.115167:0:14724:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1788460099.115174:0:14724:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788460099.256799:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460099.258735:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003413632 00000100:00100000:3.0:1788460099.258754:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003413632 00000100:00100000:3.0:1788460099.258872:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 202 00000100:00100000:3.0:1788460099.258885:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4386d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+23:12369:x1875336003413632:12345-192.168.206.5@tcp:101:lfs.0 00010000:00010000:3.0:1788460099.258921:0:7760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460099.258968:0:7760:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209800/0x5dfa74784542bbaa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a8c9 expref: -99 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460099.259109:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208c00/0x5dfa74784542bbb1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460099.259128:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208c00/0x5dfa74784542bbb1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460099.259146:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208c00/0x5dfa74784542bbb1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788460099.259178:0:7760:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788460099.259316:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209800/0x5dfa74784542bbaa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a8c9 expref: 26 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460099.259339:0:7760:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208c00/0x5dfa74784542bbb1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a8c9 expref: 25 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460099.259349:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8c4bc5dc1500) 00010000:00010000:3.0:1788460099.259353:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788460099.259357:0:7760:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bef208c00, rc 0) 00000100:00100000:3.0:1788460099.259460:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4386d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+25:12369:x1875336003413632:12345-192.168.206.5@tcp:101:lfs.0 Request processed in 577us (2675us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1788460099.259469:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 202 00000100:00080000:1.0:1788460099.260026:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788460099.263663:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460099.263707:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003413760 00000100:00100000:3.0:1788460099.263719:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003413760 00000100:00100000:3.0:1788460099.263789:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 203 00000100:00100000:3.0:1788460099.263801:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac484ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+25:12369:x1875336003413760:12345-192.168.206.5@tcp:34:lfs.0 00010000:00010000:3.0:1788460099.263894:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208200/0x5dfa74784542bbbf lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460099.263915:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208200/0x5dfa74784542bbbf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460099.263928:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208200/0x5dfa74784542bbbf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460099.263964:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542bbc6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460099.263987:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542bbc6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460099.263995:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542bbc6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460099.264092:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f1e00/0x5dfa74784542bbcd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460099.264100:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f1e00/0x5dfa74784542bbcd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460099.264107:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f1e00/0x5dfa74784542bbcd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788460099.264157:0:6534:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f1e00/0x5dfa74784542bbcd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460099.264170:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208200/0x5dfa74784542bbbf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460099.264178:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208200/0x5dfa74784542bbbf lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460099.264186:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208200/0x5dfa74784542bbbf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460099.264192:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bef208200 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:3.0:1788460099.264197:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208200/0x5dfa74784542bbbf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460099.264205:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208200/0x5dfa74784542bbbf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460099.264224:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8c4bc5dc1500) 00010000:00010000:3.0:1788460099.264227:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460099.264233:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208200/0x5dfa74784542bbbf lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460099.264240:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208200/0x5dfa74784542bbbf lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460099.264254:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542bbc6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460099.264260:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542bbc6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460099.266042:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542bbc6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460099.266065:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bef208400 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:3.0:1788460099.266071:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542bbc6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460099.266081:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542bbc6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460099.266099:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8c4bef200800) 00010000:00010000:3.0:1788460099.266102:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460099.266106:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542bbc6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460099.266113:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542bbc6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460099.266172:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f1e00/0x5dfa74784542bbcd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460099.266181:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f1e00/0x5dfa74784542bbcd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460099.266188:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f1e00/0x5dfa74784542bbcd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460099.266194:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc14f1e00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:3.0:1788460099.266197:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f1e00/0x5dfa74784542bbcd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460099.266204:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f1e00/0x5dfa74784542bbcd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460099.266213:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4bef200b00) 00010000:00010000:3.0:1788460099.266215:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460099.266218:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f1e00/0x5dfa74784542bbcd lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460099.266224:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f1e00/0x5dfa74784542bbcd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460099.282245:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac484ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+25:12369:x1875336003413760:12345-192.168.206.5@tcp:34:lfs.0 Request processed in 18429us (18578us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460099.282265:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 203 00000100:00100000:0.0:1788460099.326047:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460099.329670:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003414016 00000100:00100000:2.0:1788460099.329704:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003414016 00000100:00100000:2.0:1788460099.330070:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 204 00000100:00100000:2.0:1788460099.330085:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4365880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+25:12372:x1875336003414016:12345-192.168.206.5@tcp:101:lfs.0 00010000:00010000:2.0:1788460099.330113:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460099.330141:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542bbd4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a8d0 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.330239:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542bbdb lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.330258:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542bbdb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.330274:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542bbdb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.330292:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542bbe2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.330300:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542bbe2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.330307:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542bbe2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.330653:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542bbe9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.330663:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542bbe9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.330669:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542bbe9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788460099.330693:0:6535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:2.0:1788460099.330799:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542bbdb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.330807:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542bbdb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.330814:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542bbdb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.330820:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bfadc7800 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:2.0:1788460099.330825:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542bbdb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.330834:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542bbdb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.330848:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8c4bc5dc1500) 00010000:00010000:2.0:1788460099.330851:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460099.330856:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542bbdb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.330863:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542bbdb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.330875:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542bbe2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.330882:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542bbe2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.330898:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542bbe2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.330903:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bfadc7400 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:2.0:1788460099.330906:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542bbe2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.330912:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542bbe2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.330920:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8c4bc90d8400) 00010000:00010000:2.0:1788460099.330922:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460099.330925:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542bbe2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.330931:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542bbe2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.331973:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542bbd4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a8d0 expref: 28 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.332002:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542bbe9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a8d0 expref: 27 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.332010:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4bc90d8e00) 00010000:00010000:2.0:1788460099.332012:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788460099.332015:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bfadc7e00, rc 0) 00000100:00100000:2.0:1788460099.332113:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4365880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+27:12372:x1875336003414016:12345-192.168.206.5@tcp:101:lfs.0 Request processed in 2032us (6079us total) trans 4294967472 rc 0/0 00000100:00100000:2.0:1788460099.332137:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 204 00000100:00100000:3.0:1788460099.341048:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460099.341263:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003414144 00000100:00100000:2.0:1788460099.341286:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003414144 00000100:00100000:2.0:1788460099.341358:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 205 00000100:00100000:2.0:1788460099.341370:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac484ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+27:12372:x1875336003414144:12345-192.168.206.5@tcp:54:lfs.0 00010000:00010000:2.0:1788460099.341667:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542bbf7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.341691:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542bbf7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.341706:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542bbf7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.341753:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542bbf7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.341761:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542bbf7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.341770:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542bbf7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.341777:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bfadc7200 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:2.0:1788460099.341782:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542bbf7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.341791:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542bbf7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.341806:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4bc90d8e00) 00010000:00010000:2.0:1788460099.341826:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788460099.341833:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542bbf7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.341840:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542bbf7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460099.341972:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac484ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+27:12372:x1875336003414144:12345-192.168.206.5@tcp:54:lfs.0 Request processed in 603us (938us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460099.341981:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 205 00000100:00100000:3.0:1788460099.345379:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460099.345564:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003414400 00000100:00100000:0.0:1788460099.345587:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003414400 00000100:00100000:0.0:1788460099.345665:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 51 00000100:00100000:0.0:1788460099.345678:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac484c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+27:12372:x1875336003414400:12345-192.168.206.5@tcp:35:lfs.0 00000100:00100000:0.0:1788460099.346020:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac484c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+28:12372:x1875336003414400:12345-192.168.206.5@tcp:35:lfs.0 Request processed in 343us (653us total) trans 4294967473 rc 0/0 00000100:00100000:0.0:1788460099.346030:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 51 00010000:00010000:0.0:1788460099.346479:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460099.415196:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460099.415498:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003414656 00000100:00100000:2.0:1788460099.415511:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003414656 00000100:00100000:2.0:1788460099.415599:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 206 00000100:00100000:2.0:1788460099.415612:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac484e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+28:11905:x1875336003414656:12345-192.168.206.5@tcp:101:bash.0 00010000:00010000:2.0:1788460099.415647:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460099.415673:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542bbfe lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a8d7 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.415822:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542bc05 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.415840:0:6534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542bbe9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a8d0 expref: 29 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.415850:0:6534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542bc05 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.415891:0:6534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542bbe9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a8d0 expref: 29 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.415931:0:6534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542bbe9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a8d0 expref: 29 pid: 6535 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460099.416116:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac43a9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6534:1875336022348928:192.168.206.5@tcp:104: 00000100:00100000:2.0:1788460099.416282:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc525e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788460099.421677:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460099.421854:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003414784 00000100:00100000:1.0:1788460099.421866:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003414784 00000100:00100000:2.0:1788460099.421886:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac43a9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6534:1875336022348928:192.168.206.5@tcp:104: 00010000:00010000:1.0:1788460099.421921:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542bbe9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a8d0 expref: 30 pid: 6535 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.421929:0:6534:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542bc05 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460099.422017:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 102 00000100:00100000:1.0:1788460099.422046:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac484e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+30:2394:x1875336003414784:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788460099.422064:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788460099.422073:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542bbe9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a8d0 expref: 30 pid: 6535 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460099.422087:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542bbe9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a8d0 expref: 30 pid: 6535 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460099.422113:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542bbe9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a8d0 expref: 30 pid: 6535 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460099.422131:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4bc90d8e00) 00010000:00010000:1.0:1788460099.422135:0:6519:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542bc05 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460099.422146:0:6519:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542bc05 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460099.422154:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542bc05 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460099.422186:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788460099.422215:0:6534:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542bc05 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.422225:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542bc05 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788460099.422250:0:6534:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00000100:00100000:1.0:1788460099.422256:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac484e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+29:2394:x1875336003414784:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 210us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460099.422266:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 102 00010000:00010000:2.0:1788460099.422419:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542bbfe lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a8d7 expref: 30 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.422436:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542bc05 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a8d7 expref: 29 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.422443:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4bc90d8e00) 00010000:00010000:2.0:1788460099.422447:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788460099.422449:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bfadc7c00, rc 0) 00000100:00100000:2.0:1788460099.422479:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac484e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+29:11905:x1875336003414656:12345-192.168.206.5@tcp:101:bash.0 Request processed in 6871us (7298us total) trans 4294967474 rc 0/0 00000100:00100000:2.0:1788460099.422934:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 206 00000100:00100000:3.0:1788460099.425276:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460099.425698:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003414912 00000100:00100000:2.0:1788460099.425711:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003414912 00000100:00100000:2.0:1788460099.426125:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 207 00000100:00100000:2.0:1788460099.426139:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac484f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+29:11905:x1875336003414912:12345-192.168.206.5@tcp:101:bash.0 00010000:00010000:2.0:1788460099.426170:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460099.426197:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542bc13 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a8de expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.426250:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542bc1a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.426269:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542bc1a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.426285:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542bc1a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.426480:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542bc13 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a8de expref: 31 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.426502:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542bc1a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a8de expref: 30 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.426512:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4bc90d8e00) 00010000:00010000:2.0:1788460099.426516:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788460099.426520:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bfadc7800, rc 0) 00000100:00100000:2.0:1788460099.426615:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac484f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+30:11905:x1875336003414912:12345-192.168.206.5@tcp:101:bash.0 Request processed in 479us (1351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460099.426631:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 207 00000100:00100000:3.0:1788460099.432268:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460099.432643:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003415168 00000100:00100000:2.0:1788460099.432657:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003415168 00000100:00100000:2.0:1788460099.432730:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 208 00000100:00100000:2.0:1788460099.432743:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac484ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+30:11905:x1875336003415168:12345-192.168.206.5@tcp:36:bash.0 00010000:00010000:2.0:1788460099.433180:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542bc21 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.433201:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542bc21 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.433264:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542bc21 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788460099.433317:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:2.0:1788460099.433347:0:6533:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d9d07252 reply state 00000000fc25bd2a transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542bc21 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.433362:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542bc21 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.433371:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4bc90d8e00) 00010000:00010000:2.0:1788460099.433374:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788460099.433379:0:6533:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1788460099.433418:0:6533:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:2.0:1788460099.433612:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac484ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+34:11905:x1875336003415168:12345-192.168.206.5@tcp:36:bash.0 Request processed in 870us (1355us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1788460099.433621:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 208 00000020:00080000:2.0:1788460099.433627:0:6533:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1788460099.441925:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460099.442109:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003415296 00000100:00100000:0.0:1788460099.442122:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003415296 00000100:00100000:0.0:1788460099.442192:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 209 00000100:00100000:0.0:1788460099.442205:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac484d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+34:11905:x1875336003415296:12345-192.168.206.5@tcp:101:bash.0 00010000:00010000:0.0:1788460099.442260:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460099.442288:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4000/0x5dfa74784542bc28 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a8e5 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460099.442361:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4000/0x5dfa74784542bc28 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a8e5 expref: 35 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460099.442380:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4000/0x5dfa74784542bc28 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a8e5 expref: 35 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460099.442516:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4bc90d8e00) 00010000:00010000:0.0:1788460099.442521:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788460099.442526:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc2bd4000, rc 0) 00000100:00100000:1.0:1788460099.442766:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac484d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+35:11905:x1875336003415296:12345-192.168.206.5@tcp:101:bash.0 Request processed in 561us (854us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460099.442776:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 209 00000100:00100000:3.0:1788460099.446683:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460099.447397:0:8832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003415424 00000100:00100000:0.0:1788460099.447411:0:8832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003415424 00000100:00100000:0.0:1788460099.447484:0:8832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 66 00000100:00100000:0.0:1788460099.447495:0:8832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac484d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+7:11905:x1875336003415424:12345-192.168.206.5@tcp:101:bash.0 00010000:00010000:0.0:1788460099.447517:0:8832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460099.447541:0:8832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f19e6968/0x5dfa74784542bc2f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a8ec expref: -99 pid: 8832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788460099.447572:0:8832:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a99bc40, atime: 0x6a99bc3f, ctime: 0x6a99bc40, blocks: 0x8 00010000:00010000:0.0:1788460099.447618:0:8832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=396s v=(0 0) 00010000:00010000:0.0:1788460099.447624:0:8832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460099.447634:0:8832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f19e6968/0x5dfa74784542bc2f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a8ec expref: 8 pid: 8832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460099.447678:0:8832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f19e6968/0x5dfa74784542bc2f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a8ec expref: 8 pid: 8832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460099.447694:0:8832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc2bd5800, rc 0) 00000100:00100000:0.0:1788460099.447767:0:8832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac484d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+8:11905:x1875336003415424:12345-192.168.206.5@tcp:101:bash.0 Request processed in 274us (1098us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460099.447775:0:8832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 66 00000100:00100000:3.0:1788460099.461646:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460099.461763:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003415552 00000100:00100000:2.0:1788460099.461790:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003415552 00002000:00010000:2.0:1788460099.461848:0:8454:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:2.0:1788460099.461854:0:8454:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c4ac484ca80 with x1875336003415552 ext(0->18446744073709551615) 00002000:00010000:2.0:1788460099.461871:0:8454:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c4ac484ca80. 00000100:00100000:2.0:1788460099.461910:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 5 00000100:00100000:2.0:1788460099.461922:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac484ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+8:2393:x1875336003415552:12345-192.168.206.5@tcp:10:bash.0 00002000:00010000:2.0:1788460099.463424:0:8454:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1788460099.463432:0:8454:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1788460096 -> 1788460098 00002000:00010000:2.0:1788460099.463798:0:8454:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 1788460095 -> 1788460095 00002000:00010000:2.0:1788460099.463810:0:8454:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1788460096 -> 1788460098 00002000:00010000:2.0:1788460099.463813:0:8454:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:2.0:1788460099.464061:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac484ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+9:2393:x1875336003415552:12345-192.168.206.5@tcp:10:bash.0 Request processed in 2136us (2422us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1788460099.464073:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 5 00002000:00010000:2.0:1788460099.464179:0:8454:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:2.0:1788460099.464184:0:8454:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c4ac484ca80 with x1875336003415552 ext(0->18446744073709551615) 00002000:00010000:2.0:1788460099.464194:0:8454:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c4ac484ca80. 00000100:00100000:3.0:1788460099.593727:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460099.594042:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003415680 00000100:00100000:2.0:1788460099.594055:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003415680 00000100:00100000:2.0:1788460099.594134:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 210 00000100:00100000:2.0:1788460099.594146:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac484d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+35:12386:x1875336003415680:12345-192.168.206.5@tcp:34:lfs.0 00010000:00010000:2.0:1788460099.594376:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542bc36 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.594399:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542bc36 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.594435:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542bc36 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.594454:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542bc3d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.594462:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542bc3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.594470:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542bc3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.594590:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542bc44 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.594601:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542bc44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.594609:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542bc44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788460099.594667:0:6535:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542bc44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.594681:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542bc36 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.594688:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542bc36 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.594696:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542bc36 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.594713:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bfadc7400 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:2.0:1788460099.594719:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542bc36 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.594728:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542bc36 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.594742:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8c4bc5dc1500) 00010000:00010000:2.0:1788460099.594745:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460099.594752:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542bc36 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.594759:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542bc36 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.594888:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542bc3d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.594897:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542bc3d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.594904:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542bc3d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.594909:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bfadc7600 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:2.0:1788460099.594912:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542bc3d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.594918:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542bc3d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.594938:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8c4bc90d8400) 00010000:00010000:2.0:1788460099.594940:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460099.595064:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542bc3d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.595073:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542bc3d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.595090:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542bc44 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.595096:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542bc44 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.595102:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542bc44 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.595108:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bfadc7e00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:2.0:1788460099.595111:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542bc44 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.595117:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542bc44 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.595126:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4bc90d8e00) 00010000:00010000:2.0:1788460099.595128:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460099.595132:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542bc44 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.595137:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542bc44 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460099.595525:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac484d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+35:12386:x1875336003415680:12345-192.168.206.5@tcp:34:lfs.0 Request processed in 1377us (1808us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460099.595536:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 210 00000100:00100000:3.0:1788460099.663854:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460099.664122:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003415936 00000100:00100000:0.0:1788460099.664135:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003415936 00000100:00100000:0.0:1788460099.664212:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 211 00000100:00100000:0.0:1788460099.664225:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac484f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+35:12389:x1875336003415936:12345-192.168.206.5@tcp:101:lfs.0 00010000:00010000:0.0:1788460099.664253:0:7760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460099.664279:0:7760:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4a00/0x5dfa74784542bc4b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a8f3 expref: -99 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460099.664378:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542bc52 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460099.664398:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542bc52 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460099.664411:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542bc52 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460099.664428:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5600/0x5dfa74784542bc59 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460099.664458:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5600/0x5dfa74784542bc59 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460099.664465:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5600/0x5dfa74784542bc59 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460099.664630:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4600/0x5dfa74784542bc60 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460099.664641:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4600/0x5dfa74784542bc60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460099.664649:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4600/0x5dfa74784542bc60 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788460099.664660:0:7760:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788460099.664756:0:7760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542bc52 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460099.664764:0:7760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542bc52 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460099.664784:0:7760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542bc52 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460099.664790:0:7760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc2bd4c00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460099.664795:0:7760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542bc52 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460099.664803:0:7760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542bc52 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460099.664828:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8c4bc5dc1500) 00010000:00010000:0.0:1788460099.664831:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460099.664838:0:7760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542bc52 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460099.664844:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542bc52 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460099.664860:0:7760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5600/0x5dfa74784542bc59 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460099.664867:0:7760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5600/0x5dfa74784542bc59 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460099.664873:0:7760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5600/0x5dfa74784542bc59 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460099.664878:0:7760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc2bd5600 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460099.664881:0:7760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5600/0x5dfa74784542bc59 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460099.664887:0:7760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5600/0x5dfa74784542bc59 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460099.664895:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8c4be045a700) 00010000:00010000:0.0:1788460099.664897:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460099.664900:0:7760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5600/0x5dfa74784542bc59 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460099.664907:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5600/0x5dfa74784542bc59 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460099.665504:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4a00/0x5dfa74784542bc4b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a8f3 expref: 38 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460099.665524:0:7760:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4600/0x5dfa74784542bc60 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a8f3 expref: 37 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460099.665533:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4bc90d8e00) 00010000:00010000:0.0:1788460099.665535:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788460099.665538:0:7760:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc2bd4600, rc 0) 00000100:00100000:0.0:1788460099.665766:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac484f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+37:12389:x1875336003415936:12345-192.168.206.5@tcp:101:lfs.0 Request processed in 1541us (1924us total) trans 4294967478 rc 0/0 00000100:00100000:0.0:1788460099.665792:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 211 00000100:00100000:0.0:1788460099.665865:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788460099.665891:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4384a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022349056:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788460099.666007:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460099.666358:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022349056 00000100:00100000:1.0:1788460099.666381:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022349056 00000100:00100000:1.0:1788460099.666442:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788460099.666452:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4367b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022349056:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788460099.666484:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446453248 avail 1300213760 00000100:00100000:1.0:1788460099.666559:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4367b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022349056:12345-0@lo:41:osp-pre-1-0.0 Request processed in 109us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460099.666566:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788460099.666903:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4384a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022349056:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788460099.680120:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460099.680444:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003416064 00000100:00100000:1.0:1788460099.680453:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003416064 00000100:00100000:1.0:1788460099.680514:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 212 00000100:00100000:1.0:1788460099.680525:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac484c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+37:12389:x1875336003416064:12345-192.168.206.5@tcp:54:lfs.0 00010000:00010000:1.0:1788460099.680612:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676200/0x5dfa74784542bc6e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460099.680627:0:6534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542bc05 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a8d7 expref: 37 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460099.680637:0:6534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676200/0x5dfa74784542bc6e lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460099.680686:0:6534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542bc05 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a8d7 expref: 37 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460099.680701:0:6534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542bc05 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a8d7 expref: 37 pid: 6534 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460099.680715:0:6534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4384a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6534:1875336022349184:192.168.206.5@tcp:104: 00000100:00100000:1.0:1788460099.680812:0:6534:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac36aa3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788460099.688503:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460099.688742:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003416320 00000100:00100000:0.0:1788460099.688760:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003416320 00000100:00100000:0.0:1788460099.688845:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 52 00000100:00100000:0.0:1788460099.688858:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac490b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+38:6161:x1875336003416320:12345-192.168.206.5@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788460099.689025:0:6534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4384a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6534:1875336022349184:192.168.206.5@tcp:104: 00010000:00010000:1.0:1788460099.689052:0:6534:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676200/0x5dfa74784542bc6e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460099.689306:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac490b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+39:6161:x1875336003416320:12345-192.168.206.5@tcp:35:ldlm_bl.0 Request processed in 448us (815us total) trans 4294967479 rc 0/0 00000100:00100000:0.0:1788460099.689317:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 52 00000100:00100000:2.0:1788460099.694074:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460099.694368:0:9538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003416448 00000100:00100000:3.0:1788460099.694377:0:9538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003416448 00010000:00010000:3.0:1788460099.694417:0:9538:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542bc05 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a8d7 expref: 39 pid: 6534 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460099.694459:0:9538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 103 00000100:00100000:3.0:1788460099.694468:0:9538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac43a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+39:2394:x1875336003416448:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788460099.694482:0:9538:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788460099.694488:0:9538:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542bc05 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a8d7 expref: 39 pid: 6534 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460099.694501:0:9538:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542bc05 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a8d7 expref: 39 pid: 6534 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460099.694521:0:9538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542bc05 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a8d7 expref: 39 pid: 6534 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460099.694536:0:9538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4bc90d8e00) 00010000:00010000:3.0:1788460099.694554:0:9538:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676200/0x5dfa74784542bc6e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460099.694818:0:9538:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676200/0x5dfa74784542bc6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460099.694825:0:9538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676200/0x5dfa74784542bc6e lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460099.694895:0:9538:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788460099.695006:0:9538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac43a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+38:2394:x1875336003416448:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 537us (939us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460099.695013:0:9538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 103 00010000:00010000:1.0:1788460099.706480:0:6534:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676200/0x5dfa74784542bc6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460099.706497:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676200/0x5dfa74784542bc6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460099.706549:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676200/0x5dfa74784542bc6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460099.706557:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676200/0x5dfa74784542bc6e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460099.706565:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676200/0x5dfa74784542bc6e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460099.706571:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac3676200 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:1.0:1788460099.706584:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676200/0x5dfa74784542bc6e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460099.706591:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676200/0x5dfa74784542bc6e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460099.706609:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4bc90d8e00) 00010000:00010000:1.0:1788460099.706611:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788460099.706617:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676200/0x5dfa74784542bc6e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460099.706623:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676200/0x5dfa74784542bc6e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460099.706751:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac484c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+37:12389:x1875336003416064:12345-192.168.206.5@tcp:54:lfs.0 Request processed in 26223us (26635us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460099.706761:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 212 00000100:00100000:2.0:1788460099.715472:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460099.715551:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003416704 00000100:00100000:0.0:1788460099.715565:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003416704 00000100:00100000:0.0:1788460099.715638:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 53 00000100:00100000:0.0:1788460099.715661:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac43ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+37:12389:x1875336003416704:12345-192.168.206.5@tcp:35:lfs.0 00000100:00100000:0.0:1788460099.716168:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac43ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+38:12389:x1875336003416704:12345-192.168.206.5@tcp:35:lfs.0 Request processed in 519us (719us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1788460099.716177:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 53 00000100:00100000:3.0:1788460099.865158:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460099.868682:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003416960 00000100:00100000:2.0:1788460099.868704:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003416960 00000100:00100000:2.0:1788460099.868807:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 213 00000100:00100000:2.0:1788460099.868818:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4909f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+38:12400:x1875336003416960:12345-192.168.206.5@tcp:101:cat.0 00010000:00010000:2.0:1788460099.869079:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460099.869107:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542bc75 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a8fa expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.869313:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542bc7c lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.869331:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542bc7c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.869345:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542bc7c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.869362:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542bc83 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.869369:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542bc83 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.869376:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542bc83 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.870204:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542bc8a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.870224:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542bc8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.870234:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542bc8a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788460099.870248:0:6535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:2.0:1788460099.870358:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542bc7c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.870366:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542bc7c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.870374:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542bc7c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.870380:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bfadc7400 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:2.0:1788460099.870386:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542bc7c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.870395:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542bc7c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.871250:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8c4bc5dc1500) 00010000:00010000:2.0:1788460099.871258:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460099.871266:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542bc7c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.871298:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542bc7c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.871319:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542bc83 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.871326:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542bc83 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.871333:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542bc83 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.871339:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bfadc7c00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:2.0:1788460099.871343:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542bc83 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.871351:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542bc83 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.871361:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8c4bc90d8400) 00010000:00010000:2.0:1788460099.871363:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460099.871366:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542bc83 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.871372:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542bc83 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.872274:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542bc75 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a8fa expref: 41 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.872301:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542bc8a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a8fa expref: 40 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.872321:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4bc90d8e00) 00010000:00010000:2.0:1788460099.872325:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788460099.872329:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bfadc7e00, rc 0) 00000100:00100000:2.0:1788460099.872439:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4909f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+40:12400:x1875336003416960:12345-192.168.206.5@tcp:101:cat.0 Request processed in 3622us (7294us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1788460099.872451:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 213 00000100:00100000:3.0:1788460099.877822:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460099.884602:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003417216 00000100:00100000:2.0:1788460099.884622:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003417216 00000100:00100000:2.0:1788460099.884754:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 54 00000100:00100000:2.0:1788460099.884777:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4908e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+40:12400:x1875336003417216:12345-192.168.206.5@tcp:35:cat.0 00000100:00100000:2.0:1788460099.886588:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4908e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+41:12400:x1875336003417216:12345-192.168.206.5@tcp:35:cat.0 Request processed in 1802us (8759us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1788460099.886601:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 54 00000100:00100000:3.0:1788460099.927562:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460099.927686:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003417472 00000100:00100000:0.0:1788460099.927698:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003417472 00000100:00100000:0.0:1788460099.927775:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 214 00000100:00100000:0.0:1788460099.927786:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac490aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+41:12401:x1875336003417472:12345-192.168.206.5@tcp:36:rm.0 00010000:00010000:0.0:1788460099.927867:0:7760:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:0.0:1788460099.927901:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4000/0x5dfa74784542bc28 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a8e5 expref: 41 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460099.927932:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542bc8a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a8fa expref: 40 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460099.927996:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4600/0x5dfa74784542bc60 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a8f3 expref: 39 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460099.928010:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542bc1a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a8de expref: 38 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460099.928020:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4bc90d8e00) 00010000:00010000:0.0:1788460099.928026:0:7760:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788460099.928051:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5600/0x5dfa74784542bc98 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460099.928067:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5600/0x5dfa74784542bc98 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460099.928099:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5600/0x5dfa74784542bc98 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460099.928114:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542bc9f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460099.928122:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542bc9f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460099.928128:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542bc9f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460099.928215:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5400/0x5dfa74784542bca6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460099.928224:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5400/0x5dfa74784542bca6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460099.928230:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5400/0x5dfa74784542bca6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788460099.928484:0:7760:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:0.0:1788460099.928495:0:7760:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 397031550293ns, next at 398031547106ns, rc = 0 00010000:00010000:0.0:1788460099.928544:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4a00/0x5dfa74784542bcad lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460099.928553:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4a00/0x5dfa74784542bcad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460099.928561:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4a00/0x5dfa74784542bcad lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460099.928592:0:7760:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4a00/0x5dfa74784542bcad lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460099.928600:0:7760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4a00/0x5dfa74784542bcad lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460099.928606:0:7760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4a00/0x5dfa74784542bcad lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460099.928639:0:7760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788460099.928660:0:7760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5400/0x5dfa74784542bca6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460099.928667:0:7760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5400/0x5dfa74784542bca6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460099.928674:0:7760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5400/0x5dfa74784542bca6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460099.928681:0:7760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc2bd5400 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460099.928685:0:7760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5400/0x5dfa74784542bca6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460099.928694:0:7760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5400/0x5dfa74784542bca6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460099.928704:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4bc90d8e00) 00010000:00010000:0.0:1788460099.928707:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788460099.928711:0:7760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5400/0x5dfa74784542bca6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460099.928728:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5400/0x5dfa74784542bca6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460099.928745:0:7760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5600/0x5dfa74784542bc98 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460099.928751:0:7760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5600/0x5dfa74784542bc98 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460099.928758:0:7760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5600/0x5dfa74784542bc98 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460099.928763:0:7760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc2bd5600 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460099.928766:0:7760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5600/0x5dfa74784542bc98 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460099.928771:0:7760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5600/0x5dfa74784542bc98 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460099.928779:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8c4bc5dc1500) 00010000:00010000:0.0:1788460099.928782:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460099.928785:0:7760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5600/0x5dfa74784542bc98 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460099.928791:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5600/0x5dfa74784542bc98 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788460099.928800:0:7760:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001344ac44 reply state 000000004877a1f7 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542bc9f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460099.928812:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542bc9f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460099.928824:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8c4be045a700) 00010000:00010000:0.0:1788460099.928827:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788460099.928830:0:7760:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788460099.928926:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac490aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+39:12401:x1875336003417472:12345-192.168.206.5@tcp:36:rm.0 Request processed in 1140us (1376us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1788460099.928936:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 214 00010000:00010000:2.0:1788460099.929551:0:9536:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788460099.929560:0:9536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4a00/0x5dfa74784542bcad lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.929569:0:9536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc2bd4a00 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:2.0:1788460099.929582:0:9536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4a00/0x5dfa74784542bcad lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.929591:0:9536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4a00/0x5dfa74784542bcad lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.929602:0:9536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4bc90d8e00) 00010000:00010000:2.0:1788460099.929604:0:9536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788460099.929616:0:9536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4a00/0x5dfa74784542bcad lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.929622:0:9536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4a00/0x5dfa74784542bcad lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460099.929635:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460099.929637:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460099.929639:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460100.022636:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460100.023709:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003417728 00000100:00100000:1.0:1788460100.023724:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003417728 00000100:00100000:1.0:1788460100.023798:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 215 00000100:00100000:1.0:1788460100.023808:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4908700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+39:12407:x1875336003417728:12345-192.168.206.5@tcp:101:bash.0 00010000:00010000:1.0:1788460100.023845:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460100.023870:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676200/0x5dfa74784542bcb4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a901 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460100.024021:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677800/0x5dfa74784542bcbb lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460100.024039:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677800/0x5dfa74784542bcbb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460100.024051:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677800/0x5dfa74784542bcbb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460100.024063:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676e00/0x5dfa74784542bcc2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460100.024071:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676e00/0x5dfa74784542bcc2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460100.024078:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676e00/0x5dfa74784542bcc2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788460100.024486:0:6534:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:1.0:1788460100.024645:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677a00/0x5dfa74784542bcc9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460100.024655:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677a00/0x5dfa74784542bcc9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460100.024663:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677a00/0x5dfa74784542bcc9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460100.024693:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677800/0x5dfa74784542bcbb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460100.024701:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677800/0x5dfa74784542bcbb lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460100.024708:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677800/0x5dfa74784542bcbb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460100.024714:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac3677800 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:1.0:1788460100.024719:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677800/0x5dfa74784542bcbb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460100.024726:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677800/0x5dfa74784542bcbb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460100.024737:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8c4bc5dc1500) 00010000:00010000:1.0:1788460100.024740:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788460100.024745:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677800/0x5dfa74784542bcbb lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460100.024762:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677800/0x5dfa74784542bcbb lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788460100.024776:0:6534:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f0f58df7 reply state 00000000cfc9ef91 transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676e00/0x5dfa74784542bcc2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460100.024788:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676e00/0x5dfa74784542bcc2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460100.024795:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8c4be045a700) 00010000:00010000:1.0:1788460100.024797:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788460100.024800:0:6534:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788460100.024827:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676200/0x5dfa74784542bcb4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a901 expref: 42 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460100.024841:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677a00/0x5dfa74784542bcc9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a901 expref: 41 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460100.024848:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8c4bc2ab7400) 00010000:00010000:1.0:1788460100.024850:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788460100.024853:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ac3677a00, rc 0) 00000100:00100000:1.0:1788460100.024939:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4908700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+42:12407:x1875336003417728:12345-192.168.206.5@tcp:101:bash.0 Request processed in 1133us (2316us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1788460100.024993:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 215 00000100:00100000:0.0:1788460100.034140:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460100.034616:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003417856 00000100:00100000:3.0:1788460100.034629:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003417856 00000100:00100000:3.0:1788460100.034720:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 67 00000100:00100000:3.0:1788460100.034735:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4364a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+7:2395:x1875336003417856:12345-192.168.206.5@tcp:101:bash.0 00010000:00010000:3.0:1788460100.034760:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460100.034797:0:8449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cf865e43/0x5dfa74784542bcd7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a908 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788460100.034829:0:8449:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788460100.034854:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=397s v=(0 0) 00010000:00010000:3.0:1788460100.034860:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788460100.034871:0:8449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cf865e43/0x5dfa74784542bcd7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a908 expref: 8 pid: 8449 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.034919:0:8449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cf865e43/0x5dfa74784542bcd7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a908 expref: 8 pid: 8449 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.034973:0:8449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc0030a00, rc 0) 00000100:00100000:3.0:1788460100.035060:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4364a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+8:2395:x1875336003417856:12345-192.168.206.5@tcp:101:bash.0 Request processed in 329us (934us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460100.035069:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 67 00000100:00080000:1.0:1788460100.035974:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788460100.053381:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460100.053500:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003417984 00000100:00100000:0.0:1788460100.053524:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003417984 00000100:00100000:0.0:1788460100.053609:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 68 00000100:00100000:0.0:1788460100.053622:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac43a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+8:12407:x1875336003417984:12345-192.168.206.5@tcp:101:bash.0 00010000:00010000:0.0:1788460100.053648:0:8448:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460100.053672:0:8448:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000586a5fad/0x5dfa74784542bcde lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a90f expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460100.053715:0:8448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cf865e43/0x5dfa74784542bcd7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a908 expref: 9 pid: 8449 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460100.053725:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460100.053730:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460100.053736:0:8448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000586a5fad/0x5dfa74784542bcde lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a90f expref: 9 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460100.053791:0:8448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cf865e43/0x5dfa74784542bcd7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a908 expref: 9 pid: 8449 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460100.053831:0:8448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cf865e43/0x5dfa74784542bcd7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a908 expref: 9 pid: 8449 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460100.053847:0:8448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4367800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8448:1875336022349312:192.168.206.5@tcp:104: 00000100:00100000:0.0:1788460100.054014:0:8448:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bd47b96c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788460100.058423:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460100.058567:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003418112 00000100:00100000:3.0:1788460100.058590:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003418112 00010000:00010000:3.0:1788460100.058645:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cf865e43/0x5dfa74784542bcd7 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a908 expref: 10 pid: 8449 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460100.058697:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 104 00000100:00100000:3.0:1788460100.058709:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bedf6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+10:2394:x1875336003418112:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788460100.058727:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788460100.058752:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cf865e43/0x5dfa74784542bcd7 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a908 expref: 10 pid: 8449 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.058779:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cf865e43/0x5dfa74784542bcd7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a908 expref: 10 pid: 8449 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.058812:0:6520:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788460100.058818:0:6520:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788460100.058828:0:6520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000586a5fad/0x5dfa74784542bcde lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a90f expref: 10 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.058863:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000586a5fad/0x5dfa74784542bcde lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a90f expref: 10 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.058914:0:6520:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000586a5fad/0x5dfa74784542bcde lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a90f expref: 10 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460100.058940:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac490a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6520:1875336022349440:192.168.206.5@tcp:105: 00000100:00100000:3.0:1788460100.059081:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac25b3900 going to sleep for 11 seconds 00010000:00010000:0.0:1788460100.059487:0:8448:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf865e43/0x5dfa74784542bcd7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a908 expref: 10 pid: 8449 timeout: 497 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460100.059507:0:8448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4367800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8448:1875336022349312:192.168.206.5@tcp:104: 00010000:00010000:0.0:1788460100.059539:0:8448:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000586a5fad/0x5dfa74784542bcde lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a90f expref: 9 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460100.059550:0:8448:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc2bd5600, rc 0) 00000100:00100000:0.0:1788460100.059614:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac43a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+9:12407:x1875336003417984:12345-192.168.206.5@tcp:101:bash.0 Request processed in 5995us (6245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460100.059623:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 68 00000100:00100000:2.0:1788460100.065748:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460100.066354:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003418368 00000100:00100000:0.0:1788460100.066367:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003418368 00000100:00100000:0.0:1788460100.066438:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 55 00000100:00100000:0.0:1788460100.066450:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac43a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+42:12407:x1875336003418368:12345-192.168.206.5@tcp:35:bash.0 00000100:00100000:0.0:1788460100.067392:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac43a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+43:12407:x1875336003418368:12345-192.168.206.5@tcp:35:bash.0 Request processed in 936us (1650us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1788460100.067403:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 55 00000100:00100000:3.0:1788460100.071339:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac490a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6520:1875336022349440:192.168.206.5@tcp:105: 00010000:00010000:3.0:1788460100.071374:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788460100.071563:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bedf6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+8:2394:x1875336003418112:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 12854us (13152us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460100.071586:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 104 00000100:00100000:2.0:1788460100.177481:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac43a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3662:1875336022349824:0@lo:400:kworker.0 00000100:00100000:2.0:1788460100.177597:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460100.177663:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac43aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3662:1875336022350336:0@lo:400:kworker.0 00000100:00100000:2.0:1788460100.177689:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460100.177711:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac43abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3662:1875336022350848:0@lo:400:kworker.0 00000100:00100000:2.0:1788460100.177732:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460100.177759:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1788460100.177765:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac43aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0cf73fe6-82e2-434e-b670-631647721b2c:3662:1875336022349696:0@lo:400:kworker.0 00000100:00100000:2.0:1788460100.177796:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460100.177818:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac43ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022350208:0@lo:400:kworker.0 00000100:00100000:2.0:1788460100.177848:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460100.177866:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac43a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022350720:0@lo:400:kworker.0 00000100:00100000:2.0:1788460100.177890:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460100.177906:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4931880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022351232:0@lo:400:kworker.0 00000100:00100000:2.0:1788460100.177938:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460100.178003:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022349696 00000100:00100000:2.0:1788460100.178012:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022349696 00000100:00100000:2.0:1788460100.178067:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 429 00000100:00100000:2.0:1788460100.178077:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+29:3662:x1875336022349696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460100.178133:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+29:3662:x1875336022349696:12345-0@lo:400:kworker.0 Request processed in 58us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460100.178142:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 429 00000100:00100000:2.0:1788460100.178178:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022350720 00000100:00100000:2.0:1788460100.178182:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022350720 00000100:00100000:2.0:1788460100.178214:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022351232 00000100:00100000:2.0:1788460100.178217:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022351232 00000100:00100000:2.0:1788460100.178238:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788460100.178244:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4933b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3662:x1875336022350720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460100.178277:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4933b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3662:x1875336022350720:12345-0@lo:400:kworker.0 Request processed in 33us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460100.178283:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788460100.178295:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788460100.178300:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4930000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3662:x1875336022351232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460100.178327:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4930000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3662:x1875336022351232:12345-0@lo:400:kworker.0 Request processed in 26us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460100.178333:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788460100.178372:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac43aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0cf73fe6-82e2-434e-b670-631647721b2c:3662:1875336022349696:0@lo:400:kworker.0 00000100:00100000:2.0:1788460100.178388:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac43a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022350720:0@lo:400:kworker.0 00000100:00100000:2.0:1788460100.178399:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4931880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022351232:0@lo:400:kworker.0 00000100:00100000:2.0:1788460100.178437:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022349824 00000100:00100000:2.0:1788460100.178441:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022349824 00000100:00100000:2.0:1788460100.178473:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022350336 00000100:00100000:2.0:1788460100.178477:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022350336 00000100:00100000:2.0:1788460100.178494:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022350848 00000100:00100000:2.0:1788460100.178497:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022350848 00000100:00100000:2.0:1788460100.178512:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1788460100.178518:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4930a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1875336022349824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460100.178555:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4930a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1875336022349824:12345-0@lo:400:kworker.0 Request processed in 37us (959us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460100.178561:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1788460100.178585:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1788460100.178591:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4931180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1875336022350336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460100.178619:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4931180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1875336022350336:12345-0@lo:400:kworker.0 Request processed in 29us (930us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460100.178626:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1788460100.178637:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1788460100.178643:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4933100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1875336022350848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460100.178667:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4933100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1875336022350848:12345-0@lo:400:kworker.0 Request processed in 25us (935us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460100.178672:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1788460100.178696:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac43a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3662:1875336022349824:0@lo:400:kworker.0 00000100:00100000:2.0:1788460100.178706:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac43aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3662:1875336022350336:0@lo:400:kworker.0 00000100:00100000:2.0:1788460100.178714:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac43abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3662:1875336022350848:0@lo:400:kworker.0 00000100:00100000:1.0:1788460100.179063:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022350208 00000100:00100000:1.0:1788460100.179069:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022350208 00000100:00100000:1.0:1788460100.179109:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788460100.179116:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4930380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1875336022350208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460100.179175:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4930380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1875336022350208:12345-0@lo:400:kworker.0 Request processed in 60us (1325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460100.179181:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00080000:1.0:1788460100.179204:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788460100.179209:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788460100.179211:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788460100.179230:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac43ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022350208:0@lo:400:kworker.0 00000100:00100000:3.0:1788460100.179434:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4384a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022349568:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788460100.179487:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460100.179524:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac43aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3660:1875336022350080:0@lo:400:kworker.0 00000100:00100000:3.0:1788460100.179546:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460100.179562:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac43a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022350592:0@lo:400:kworker.0 00000100:00100000:3.0:1788460100.179595:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460100.179614:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4931500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022351104:0@lo:400:kworker.0 00000100:00100000:3.0:1788460100.179632:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460100.179651:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788460100.179659:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac43aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022349952:0@lo:400:kworker.0 00000100:00100000:3.0:1788460100.179696:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460100.179714:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac43a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3660:1875336022350464:0@lo:400:kworker.0 00000100:00100000:3.0:1788460100.179733:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460100.179749:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4932d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3660:1875336022350976:0@lo:400:kworker.0 00000100:00100000:3.0:1788460100.179778:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460100.179805:0:8832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022350592 00000100:00100000:3.0:1788460100.179809:0:8832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022350592 00000100:00100000:3.0:1788460100.179840:0:8832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022351104 00000100:00100000:3.0:1788460100.179843:0:8832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022351104 00000100:00100000:3.0:1788460100.179859:0:8832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788460100.179865:0:8832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac490b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022350592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460100.179904:0:8832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac490b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022350592:12345-0@lo:400:kworker.0 Request processed in 39us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460100.179910:0:8832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788460100.179941:0:8832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788460100.179967:0:8832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac490ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022351104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460100.179996:0:8832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac490ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022351104:12345-0@lo:400:kworker.0 Request processed in 30us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460100.180002:0:8832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:3.0:1788460100.180015:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788460100.180018:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788460100.180026:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022350080 00000100:00100000:3.0:1788460100.180029:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022350080 00000100:00100000:3.0:1788460100.180052:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022350464 00000100:00100000:3.0:1788460100.180055:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022350464 00000100:00100000:3.0:1788460100.180070:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022350976 00000100:00100000:3.0:1788460100.180073:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022350976 00000100:00100000:3.0:1788460100.180087:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1788460100.180100:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac490a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1875336022350080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460100.180132:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac490a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1875336022350080:12345-0@lo:400:kworker.0 Request processed in 32us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460100.180139:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1788460100.180150:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1788460100.180156:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4909880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1875336022350464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460100.180181:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4909880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1875336022350464:12345-0@lo:400:kworker.0 Request processed in 26us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460100.180187:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1788460100.180198:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1788460100.180203:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4908a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1875336022350976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460100.180226:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4908a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1875336022350976:12345-0@lo:400:kworker.0 Request processed in 24us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460100.180231:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00080000:3.0:1788460100.180243:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788460100.180253:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022349952 00000100:00100000:3.0:1788460100.180256:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022349952 00000100:00100000:3.0:1788460100.180272:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788460100.180278:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4909500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022349952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460100.180306:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4909500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022349952:12345-0@lo:400:kworker.0 Request processed in 28us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460100.180312:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788460100.180349:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac43aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022349952:0@lo:400:kworker.0 00010000:00080000:3.0:1788460100.180364:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac43a9880 x1875336022350464/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460116 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460100.180387:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac43a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3660:1875336022350464:0@lo:400:kworker.0 00010000:00080000:3.0:1788460100.180400:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac4932d80 x1875336022350976/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460116 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460100.180409:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4932d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3660:1875336022350976:0@lo:400:kworker.0 00000100:00100000:3.0:1788460100.180418:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac43aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3660:1875336022350080:0@lo:400:kworker.0 00000100:00100000:3.0:1788460100.180427:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac43a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022350592:0@lo:400:kworker.0 00000100:00100000:3.0:1788460100.180436:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4931500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022351104:0@lo:400:kworker.0 00000100:00100000:1.0:1788460100.181067:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022349568 00000100:00100000:1.0:1788460100.181074:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022349568 00000100:00100000:1.0:1788460100.181116:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788460100.181123:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac490a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022349568:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788460100.181153:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788460100.181208:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac490a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022349568:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (1721us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460100.181214:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788460100.181252:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4384a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022349568:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788460100.181729:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788460100.181742:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4384a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022351360:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788460100.181796:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460100.181828:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022351360 00000100:00100000:1.0:1788460100.181833:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022351360 00000100:00100000:1.0:1788460100.181852:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788460100.181859:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bef631450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3661:x1875336022351360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788460100.181872:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788460100.181904:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bef631450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3661:x1875336022351360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (107us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460100.181937:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788460100.182199:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4384a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022351360:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788460100.214377:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460100.214554:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003418496 00000100:00100000:3.0:1788460100.214569:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003418496 00000100:00100000:3.0:1788460100.214669:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 216 00000100:00100000:3.0:1788460100.214681:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4931880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+43:12423:x1875336003418496:12345-192.168.206.5@tcp:101:lfs.0 00010000:00010000:3.0:1788460100.214712:0:13560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460100.214738:0:13560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc0031c00/0x5dfa74784542bce5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a916 expref: -99 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.214834:0:13560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc0031800/0x5dfa74784542bcec lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.214853:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc0031800/0x5dfa74784542bcec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.214868:0:13560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc0031800/0x5dfa74784542bcec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788460100.214922:0:13560:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1788460100.215003:0:13560:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788460100.215030:0:13560:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc0031800/0x5dfa74784542bcec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.215060:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc0031c00/0x5dfa74784542bce5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a916 expref: 45 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.215084:0:13560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc0031800/0x5dfa74784542bcec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a916 expref: 44 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.215094:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8c4bc5dc1500) 00010000:00010000:3.0:1788460100.215097:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788460100.215102:0:13560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc0031800, rc 0) 00000100:00100000:3.0:1788460100.215173:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4931880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+44:12423:x1875336003418496:12345-192.168.206.5@tcp:101:lfs.0 Request processed in 494us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460100.215181:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 216 00000100:00100000:0.0:1788460100.225516:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460100.225604:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003418752 00000100:00100000:3.0:1788460100.225617:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003418752 00000100:00100000:3.0:1788460100.225694:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 217 00000100:00100000:3.0:1788460100.225705:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4367800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+44:12423:x1875336003418752:12345-192.168.206.5@tcp:101:lfs.0 00010000:00010000:3.0:1788460100.225733:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460100.225757:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc0031c00/0x5dfa74784542bcf3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a91d expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.225915:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc0030a00/0x5dfa74784542bcfa lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.225933:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc0030a00/0x5dfa74784542bcfa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.226489:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc0030a00/0x5dfa74784542bcfa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788460100.226516:0:6534:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788460100.226672:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc0031c00/0x5dfa74784542bcf3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a91d expref: 47 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.226696:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc0030a00/0x5dfa74784542bcfa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a91d expref: 46 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.226706:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8c4bc2ab7400) 00010000:00010000:3.0:1788460100.226710:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788460100.226714:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc0030a00, rc 0) 00000100:00100000:3.0:1788460100.227124:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4367800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+46:12423:x1875336003418752:12345-192.168.206.5@tcp:101:lfs.0 Request processed in 1419us (1618us total) trans 4294967486 rc 0/0 00000100:00100000:3.0:1788460100.227134:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 217 00000100:00100000:1.0:1788460100.231118:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460100.231204:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460100.231620:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003419136 00000100:00100000:2.0:1788460100.231633:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003419136 00000100:00100000:2.0:1788460100.231709:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 218 00000100:00100000:2.0:1788460100.231739:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac36cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+46:12423:x1875336003419136:12345-192.168.206.5@tcp:101:lfs.0 00010000:00010000:2.0:1788460100.231780:0:7760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460100.231806:0:7760:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542bd08 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a924 expref: -99 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460100.231931:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542bd0f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460100.232166:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542bd0f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460100.232183:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542bd0f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788460100.232199:0:7760:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788460100.232328:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542bd08 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a924 expref: 49 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460100.232348:0:7760:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542bd0f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a924 expref: 48 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460100.232357:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8c4bc2ab7400) 00010000:00010000:2.0:1788460100.232360:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788460100.232364:0:7760:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bfadc7c00, rc 0) 00000100:00100000:2.0:1788460100.232446:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac36cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+48:12423:x1875336003419136:12345-192.168.206.5@tcp:101:lfs.0 Request processed in 710us (1241us total) trans 4294967487 rc 0/0 00000100:00100000:2.0:1788460100.232455:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 218 00000100:00100000:3.0:1788460100.237468:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003418880 00000100:00100000:3.0:1788460100.237487:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003418880 00000100:00100000:2.0:1788460100.237655:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460100.237750:0:8832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003419264 00000100:00100000:1.0:1788460100.237755:0:8832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003419264 00000100:00100000:1.0:1788460100.237826:0:8832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 69 00000100:00100000:1.0:1788460100.237837:0:8832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4931c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+8:2394:x1875336003419264:12345-192.168.206.5@tcp:1:lfs.0 00010000:00010000:1.0:1788460100.237892:0:8832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070289e7b/0x5dfa74784542bd1d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460100.237916:0:8832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000586a5fad/0x5dfa74784542bcde lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a90f expref: 8 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460100.237926:0:8832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460100.237931:0:8832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788460100.237937:0:8832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070289e7b/0x5dfa74784542bd1d lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460100.238016:0:8832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000586a5fad/0x5dfa74784542bcde lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a90f expref: 8 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460100.238032:0:8832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000586a5fad/0x5dfa74784542bcde lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a90f expref: 8 pid: 8448 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460100.238048:0:8832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac36cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8832:1875336022351488:192.168.206.5@tcp:104: 00000100:00100000:1.0:1788460100.238175:0:8832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac36aa540 going to sleep for 11 seconds 00000100:00100000:3.0:1788460100.240297:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 14 00000100:00100000:3.0:1788460100.240311:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4384a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+48:2396:x1875336003418880:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788460100.240328:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788460100.240359:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc0030a00/0x5dfa74784542bcfa lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a91d expref: 48 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.240382:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8c4bc2ab7400) 00010000:00010000:3.0:1788460100.240387:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788460100.240466:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4384a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+47:2396:x1875336003418880:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 157us (9522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460100.240474:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 14 00000100:00100000:3.0:1788460100.241658:0:8832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac36cce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8832:1875336022351488:192.168.206.5@tcp:104: 00010000:00010000:3.0:1788460100.241691:0:8832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000070289e7b/0x5dfa74784542bd1d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460100.242857:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460100.243288:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003419392 00000100:00100000:3.0:1788460100.243300:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003419392 00002000:00100000:3.0:1788460100.243363:0:8453:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff8c4ac4366300 x1875336003419392/t0(0) o4->f8767d3e-bfef-4d3d-8163-ef8ae18a3514@192.168.206.5@tcp:256/0 lens 504/0 e 0 to 0 dl 1788460111 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788460100.243376:0:8453:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c4ac4366300 with x1875336003419392 ext(0->8) 00010000:00010000:3.0:1788460100.243387:0:8453:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000586a5fad/0x5dfa74784542bcde lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a90f expref: 9 pid: 8448 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.243403:0:8453:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000586a5fad/0x5dfa74784542bcde lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a90f expref: 9 pid: 8448 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788460100.243412:0:8453:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8c4ac4366300 00000100:00100000:3.0:1788460100.243508:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 3 00000100:00100000:3.0:1788460100.243518:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4366300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+9:2394:x1875336003419392:12345-192.168.206.5@tcp:4:lfs.0 00000100:00100000:3.0:1788460100.245059:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4366300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+11:2394:x1875336003419392:12345-192.168.206.5@tcp:4:lfs.0 Request processed in 1533us (2199us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788460100.245074:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 3 00002000:00100000:3.0:1788460100.245084:0:8453:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff8c4ac4366300 x1875336003419392/t4294967309(0) o4->f8767d3e-bfef-4d3d-8163-ef8ae18a3514@192.168.206.5@tcp:256/0 lens 504/448 e 0 to 0 dl 1788460111 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788460100.245115:0:8453:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c4ac4366300 with x1875336003419392 ext(0->8) 00010000:00010000:3.0:1788460100.245125:0:8453:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000586a5fad/0x5dfa74784542bcde lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a90f expref: 11 pid: 8448 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.245143:0:8453:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000586a5fad/0x5dfa74784542bcde lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a90f expref: 11 pid: 8448 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788460100.245153:0:8453:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8c4ac4366300 00000100:00100000:0.0:1788460100.247755:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460100.247909:0:9538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003419520 00000100:00100000:3.0:1788460100.247921:0:9538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003419520 00010000:00010000:3.0:1788460100.248178:0:9538:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000586a5fad/0x5dfa74784542bcde lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a90f expref: 11 pid: 8448 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460100.248295:0:9538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 105 00000100:00100000:3.0:1788460100.248307:0:9538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4366a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+11:2393:x1875336003419520:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788460100.248325:0:9538:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788460100.248347:0:9538:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788460100.248350:0:9538:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788460098 00002000:00010000:3.0:1788460100.248353:0:9538:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788460099 00002000:00010000:3.0:1788460100.248355:0:9538:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1788460098 00002000:00010000:3.0:1788460100.248357:0:9538:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1788460100.248364:0:9538:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000586a5fad/0x5dfa74784542bcde lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a90f expref: 11 pid: 8448 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.248380:0:9538:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000586a5fad/0x5dfa74784542bcde lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a90f expref: 11 pid: 8448 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.248426:0:9538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000586a5fad/0x5dfa74784542bcde lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a90f expref: 11 pid: 8448 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.248446:0:9538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788460100.248451:0:9538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788460100.248458:0:9538:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000070289e7b/0x5dfa74784542bd1d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.248468:0:9538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070289e7b/0x5dfa74784542bd1d lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.248515:0:9538:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788460100.248585:0:9538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4366a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+10:2393:x1875336003419520:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 280us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460100.248594:0:9538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 105 00010000:00010000:1.0:1788460100.248666:0:8832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000070289e7b/0x5dfa74784542bd1d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460100.248677:0:8832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000070289e7b/0x5dfa74784542bd1d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460100.248700:0:8832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070289e7b/0x5dfa74784542bd1d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460100.248710:0:8832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000070289e7b/0x5dfa74784542bd1d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460100.248718:0:8832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000070289e7b/0x5dfa74784542bd1d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460100.248726:0:8832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac3677c00 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:1.0:1788460100.248732:0:8832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000070289e7b/0x5dfa74784542bd1d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460100.248742:0:8832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000070289e7b/0x5dfa74784542bd1d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460100.248755:0:8832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000070289e7b/0x5dfa74784542bd1d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460100.248763:0:8832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070289e7b/0x5dfa74784542bd1d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460100.248834:0:8832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4931c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+9:2394:x1875336003419264:12345-192.168.206.5@tcp:1:lfs.0 Request processed in 10999us (11187us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460100.248843:0:8832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 69 00000100:00100000:0.0:1788460100.251638:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460100.251732:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003419776 00000100:00100000:3.0:1788460100.251744:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003419776 00000100:00100000:3.0:1788460100.251910:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 56 00000100:00100000:3.0:1788460100.251923:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bcec2ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+47:12423:x1875336003419776:12345-192.168.206.5@tcp:35:lfs.0 00000004:00010000:0.0:1788460100.252234:0:6537:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542bd0f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a924 expref: 47 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788460100.252463:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:0.0:1788460100.252512:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:0.0:1788460100.252891:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:0.0:1788460100.252932:0:6537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542bd24 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460100.253002:0:6537:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677a00/0x5dfa74784542bcc9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a901 expref: 51 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460100.253013:0:6537:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542bd24 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460100.253065:0:6537:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677a00/0x5dfa74784542bcc9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a901 expref: 51 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460100.253085:0:6537:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677a00/0x5dfa74784542bcc9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a901 expref: 51 pid: 6534 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460100.253102:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc6762300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6537:1875336022351616:192.168.206.5@tcp:104: 00000100:00100000:0.0:1788460100.253210:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bd47b96c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788460100.255851:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460100.255894:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003419904 00000100:00100000:0.0:1788460100.255922:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003419904 00010000:00010000:0.0:1788460100.256203:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677a00/0x5dfa74784542bcc9 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a901 expref: 52 pid: 6534 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460100.256316:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 106 00000100:00100000:1.0:1788460100.256331:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc6760700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+52:2393:x1875336003419904:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788460100.256349:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788460100.256357:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677a00/0x5dfa74784542bcc9 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a901 expref: 52 pid: 6534 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460100.256374:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677a00/0x5dfa74784542bcc9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a901 expref: 52 pid: 6534 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460100.256401:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8c4bc2ab7400) 00010000:00010000:1.0:1788460100.256408:0:6519:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542bd24 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460100.256419:0:6519:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542bd24 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460100.256429:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542bd24 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460100.256453:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788460100.256527:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc6760700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+52:2393:x1875336003419904:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 199us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460100.256535:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 106 00010000:00010000:3.0:1788460100.256715:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677a00/0x5dfa74784542bcc9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a901 expref: 51 pid: 6534 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460100.256735:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc6762300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6537:1875336022351616:192.168.206.5@tcp:104: 00010000:00010000:3.0:1788460100.256760:0:6537:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542bd24 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.256781:0:6537:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542bd24 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.256788:0:6537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542bd24 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788460100.256920:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:3.0:1788460100.257098:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:3.0:1788460100.257202:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4909180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6537:1875336022351744:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788460100.257258:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460100.257293:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac25b3180 going to sleep for 11 seconds 00000100:00100000:1.0:1788460100.258327:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022351744 00000100:00100000:1.0:1788460100.258339:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022351744 00000100:00100000:1.0:1788460100.258407:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788460100.258417:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac490b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6537:x1875336022351744:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788460100.258550:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac490b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6537:x1875336022351744:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 134us (1290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460100.258558:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788460100.258816:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4909180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6537:1875336022351744:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788460100.259206:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:3.0:1788460100.259282:0:6537:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4909180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6537:1875336022351872:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788460100.259330:0:6537:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460100.259358:0:6537:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac25b3c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788460100.259432:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022351872 00000100:00100000:0.0:1788460100.259438:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022351872 00000100:00100000:0.0:1788460100.259468:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788460100.259475:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4908380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6537:x1875336022351872:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788460100.259631:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4908380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:6537:x1875336022351872:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 156us (300us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788460100.259639:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788460100.259938:0:6537:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4909180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6537:1875336022351872:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788460100.260032:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:3.0:1788460100.260071:0:6537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542bd24 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.260082:0:6537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542bd24 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.260090:0:6537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542bd24 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.260096:0:6537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc2bd5c00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:3.0:1788460100.260119:0:6537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542bd24 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.260129:0:6537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542bd24 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.260147:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8c4bc2ab7400) 00010000:00010000:3.0:1788460100.260150:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788460100.260156:0:6537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542bd24 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.260163:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542bd24 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6537 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788460100.260270:0:6537:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788460100.260341:0:6537:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:3.0:1788460100.260357:0:6537:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 397363411936ns, next at 398363408394ns, rc = 0 00000001:00080000:3.0:1788460100.260364:0:6537:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:3.0:1788460100.260388:0:6537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8c4bc2ab7400) 00010000:00010000:3.0:1788460100.260391:0:6537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788460100.260399:0:6537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542bd0f lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a924 expref: 55 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460100.260518:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bcec2ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+54:12423:x1875336003419776:12345-192.168.206.5@tcp:35:lfs.0 Request processed in 8598us (8893us total) trans 4294967496 rc 0/0 00000100:00100000:3.0:1788460100.260526:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 56 00000020:00080000:3.0:1788460100.260531:0:6537:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788460100.266376:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460100.266481:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003420032 00000100:00100000:3.0:1788460100.266503:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003420032 00000100:00100000:3.0:1788460100.266584:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 219 00000100:00100000:3.0:1788460100.266596:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc6762300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+54:12423:x1875336003420032:12345-192.168.206.5@tcp:101:lfs.0 00010000:00010000:3.0:1788460100.266651:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460100.266680:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc0030a00/0x5dfa74784542bd2b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a92b expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.266753:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc0030a00/0x5dfa74784542bd2b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a92b expref: 55 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.266790:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc0030a00/0x5dfa74784542bd2b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a92b expref: 55 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.266813:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8c4bef200e00) 00010000:00010000:3.0:1788460100.266817:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788460100.266822:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc0030a00, rc 0) 00000100:00100000:3.0:1788460100.266893:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc6762300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+55:12423:x1875336003420032:12345-192.168.206.5@tcp:101:lfs.0 Request processed in 299us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460100.266902:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 219 00000100:00100000:0.0:1788460100.270293:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460100.270402:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003420288 00000100:00100000:2.0:1788460100.270434:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003420288 00000100:00100000:2.0:1788460100.270515:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 57 00000100:00100000:2.0:1788460100.270527:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac42fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+55:12423:x1875336003420288:12345-192.168.206.5@tcp:35:lfs.0 00000100:00100000:2.0:1788460100.270846:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac42fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+56:12423:x1875336003420288:12345-192.168.206.5@tcp:35:lfs.0 Request processed in 320us (564us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1788460100.270855:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 57 00010000:00010000:0.0:1788460100.370970:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788460100.383533:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460100.383652:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003420416 00000100:00100000:3.0:1788460100.383666:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003420416 00000100:00100000:3.0:1788460100.383741:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 220 00000100:00100000:3.0:1788460100.383753:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3bd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+56:12433:x1875336003420416:12345-192.168.206.5@tcp:34:lfs.0 00010000:00010000:3.0:1788460100.383852:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc0031c00/0x5dfa74784542bd32 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.383873:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc0031c00/0x5dfa74784542bd32 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.383886:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc0031c00/0x5dfa74784542bd32 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.383920:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f1e00/0x5dfa74784542bd39 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.383929:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f1e00/0x5dfa74784542bd39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.383936:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f1e00/0x5dfa74784542bd39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.384070:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542bd40 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.384080:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542bd40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.384086:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542bd40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788460100.384141:0:6534:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542bd40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.384154:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc0031c00/0x5dfa74784542bd32 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.384160:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc0031c00/0x5dfa74784542bd32 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.384167:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc0031c00/0x5dfa74784542bd32 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.384173:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc0031c00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:3.0:1788460100.384178:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc0031c00/0x5dfa74784542bd32 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.384192:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc0031c00/0x5dfa74784542bd32 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.384205:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8c4bc5dc1500) 00010000:00010000:3.0:1788460100.384208:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460100.384223:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc0031c00/0x5dfa74784542bd32 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.384230:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc0031c00/0x5dfa74784542bd32 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.384245:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f1e00/0x5dfa74784542bd39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.384251:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f1e00/0x5dfa74784542bd39 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.384258:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f1e00/0x5dfa74784542bd39 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.384263:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc14f1e00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:3.0:1788460100.384266:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f1e00/0x5dfa74784542bd39 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.384271:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f1e00/0x5dfa74784542bd39 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.384278:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8c4be045a700) 00010000:00010000:3.0:1788460100.384281:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460100.384283:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f1e00/0x5dfa74784542bd39 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.384300:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f1e00/0x5dfa74784542bd39 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.384313:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542bd40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.384319:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542bd40 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.384325:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542bd40 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.384330:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bef208400 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:3.0:1788460100.384333:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542bd40 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.384339:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542bd40 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.384347:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8c4bef200e00) 00010000:00010000:3.0:1788460100.384349:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460100.384352:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542bd40 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.384359:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542bd40 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460100.384440:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3bd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+56:12433:x1875336003420416:12345-192.168.206.5@tcp:34:lfs.0 Request processed in 688us (920us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460100.384449:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 220 00000100:00100000:0.0:1788460100.436173:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460100.436990:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003420672 00000100:00100000:2.0:1788460100.437007:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003420672 00000100:00100000:2.0:1788460100.437225:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 221 00000100:00100000:2.0:1788460100.437238:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3bdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+56:12436:x1875336003420672:12345-192.168.206.5@tcp:101:lfs.0 00010000:00010000:2.0:1788460100.437265:0:7760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460100.437294:0:7760:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542bd47 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a932 expref: -99 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460100.437391:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542bd4e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460100.437410:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542bd4e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460100.437423:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542bd4e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460100.437439:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542bd55 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460100.437447:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542bd55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460100.437454:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542bd55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460100.437830:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542bd5c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460100.437842:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542bd5c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460100.437849:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542bd5c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788460100.437862:0:7760:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788460100.438937:0:7760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542bd4e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460100.438989:0:7760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542bd4e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460100.438997:0:7760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542bd4e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460100.439004:0:7760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bfadc7800 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:2.0:1788460100.439009:0:7760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542bd4e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460100.439026:0:7760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542bd4e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460100.439042:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8c4bc5dc1500) 00010000:00010000:2.0:1788460100.439046:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460100.439052:0:7760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542bd4e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460100.439082:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542bd4e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460100.439102:0:7760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542bd55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460100.439108:0:7760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542bd55 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460100.439115:0:7760:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542bd55 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460100.439120:0:7760:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bfadc7e00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:2.0:1788460100.439123:0:7760:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542bd55 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460100.439129:0:7760:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542bd55 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460100.439137:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8c4be045a700) 00010000:00010000:2.0:1788460100.439140:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460100.439143:0:7760:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542bd55 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460100.439149:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542bd55 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460100.439203:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542bd47 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a932 expref: 59 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460100.439679:0:7760:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542bd5c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a932 expref: 58 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460100.439699:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8c4bef200e00) 00010000:00010000:2.0:1788460100.439702:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788460100.439704:0:7760:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bfadc7c00, rc 0) 00000100:00100000:2.0:1788460100.439870:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3bdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+58:12436:x1875336003420672:12345-192.168.206.5@tcp:101:lfs.0 Request processed in 2632us (3708us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1788460100.439881:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 221 00000100:00100000:0.0:1788460100.449407:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460100.449544:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003420800 00000100:00100000:2.0:1788460100.449557:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003420800 00000100:00100000:2.0:1788460100.449639:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 222 00000100:00100000:2.0:1788460100.449651:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3bd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+58:12436:x1875336003420800:12345-192.168.206.5@tcp:54:lfs.0 00010000:00010000:2.0:1788460100.449747:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542bd6a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460100.449783:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542bd6a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460100.449797:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542bd6a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460100.449843:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542bd6a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460100.449850:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542bd6a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460100.449859:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542bd6a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460100.449866:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bfadc7400 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:2.0:1788460100.449889:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542bd6a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460100.449898:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542bd6a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460100.449913:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8c4bef200e00) 00010000:00010000:2.0:1788460100.449916:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788460100.449921:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542bd6a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460100.449928:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542bd6a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460100.450076:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3bd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+58:12436:x1875336003420800:12345-192.168.206.5@tcp:54:lfs.0 Request processed in 426us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460100.450085:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 222 00000100:00100000:0.0:1788460100.454200:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460100.454289:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003421056 00000100:00100000:2.0:1788460100.454303:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003421056 00000100:00100000:2.0:1788460100.454375:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 58 00000100:00100000:2.0:1788460100.454387:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3bd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+58:12436:x1875336003421056:12345-192.168.206.5@tcp:35:lfs.0 00000100:00100000:2.0:1788460100.454709:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3bd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+59:12436:x1875336003421056:12345-192.168.206.5@tcp:35:lfs.0 Request processed in 323us (521us total) trans 4294967499 rc 0/0 00000100:00100000:2.0:1788460100.454718:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 58 00000100:00100000:0.0:1788460100.531926:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460100.535348:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003421312 00000100:00100000:1.0:1788460100.535371:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003421312 00000100:00100000:1.0:1788460100.535476:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 223 00000100:00100000:1.0:1788460100.535488:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac43cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+59:12446:x1875336003421312:12345-192.168.206.5@tcp:101:bash.0 00010000:00010000:1.0:1788460100.535525:0:13560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460100.535529:0:13560:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788460100.535565:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc0031800/0x5dfa74784542bcec lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a916 expref: 59 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460100.535601:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8c4bc5dc1500) 00010000:00010000:1.0:1788460100.535608:0:13560:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788460100.535626:0:13560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677c00/0x5dfa74784542bd71 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a939 expref: -99 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460100.535755:0:13560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676800/0x5dfa74784542bd78 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460100.535772:0:13560:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542bd5c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a932 expref: 59 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460100.535781:0:13560:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676800/0x5dfa74784542bd78 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460100.535847:0:13560:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542bd5c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a932 expref: 59 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460100.535863:0:13560:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542bd5c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a932 expref: 59 pid: 7760 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460100.535879:0:13560:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac36cce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13560:1875336022352000:192.168.206.5@tcp:104: 00000100:00100000:1.0:1788460100.536088:0:13560:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac36aa780 going to sleep for 11 seconds 00000100:00100000:1.0:1788460100.538255:0:13560:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac36cce00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13560:1875336022352000:192.168.206.5@tcp:104: 00010000:00010000:1.0:1788460100.538291:0:13560:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676800/0x5dfa74784542bd78 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460100.540103:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460100.542239:0:9549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003421440 00000100:00100000:1.0:1788460100.542258:0:9549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003421440 00010000:00010000:1.0:1788460100.542324:0:9549:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542bd5c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a932 expref: 60 pid: 7760 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460100.542387:0:9549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 107 00000100:00100000:1.0:1788460100.542399:0:9549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac413b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+60:2393:x1875336003421440:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788460100.542419:0:9549:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788460100.542427:0:9549:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542bd5c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a932 expref: 60 pid: 7760 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460100.542442:0:9549:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542bd5c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a932 expref: 60 pid: 7760 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460100.542496:0:9549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7c00/0x5dfa74784542bd5c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a932 expref: 60 pid: 7760 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460100.542519:0:9549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8c4bef200e00) 00010000:00010000:1.0:1788460100.542526:0:9549:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676800/0x5dfa74784542bd78 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460100.542538:0:9549:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676800/0x5dfa74784542bd78 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460100.542547:0:9549:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676800/0x5dfa74784542bd78 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460100.542598:0:9549:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788460100.542679:0:13560:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676800/0x5dfa74784542bd78 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460100.542685:0:9549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac413b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+59:2393:x1875336003421440:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 286us (2591us total) trans 0 rc 0/0 00010000:00010000:3.0:1788460100.542693:0:13560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676800/0x5dfa74784542bd78 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460100.542700:0:9549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 107 00000004:00200000:3.0:1788460100.542723:0:13560:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788460100.542904:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677c00/0x5dfa74784542bd71 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a939 expref: 60 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.542922:0:13560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676800/0x5dfa74784542bd78 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a939 expref: 59 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.542931:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8c4bef200e00) 00010000:00010000:3.0:1788460100.542934:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788460100.542936:0:13560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ac3676800, rc 0) 00000100:00100000:3.0:1788460100.542998:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac43cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+59:12446:x1875336003421312:12345-192.168.206.5@tcp:101:bash.0 Request processed in 7512us (11083us total) trans 4294967500 rc 0/0 00000100:00100000:3.0:1788460100.543007:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 223 00000100:00100000:0.0:1788460100.549388:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460100.549484:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460100.549617:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460100.549673:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003421952 00000100:00100000:3.0:1788460100.549685:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003421952 00000100:00100000:3.0:1788460100.549761:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 136 00000100:00100000:3.0:1788460100.549783:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac413a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+9:2394:x1875336003421952:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:3.0:1788460100.549891:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac413a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+9:2394:x1875336003421952:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 110us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460100.549900:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 136 00000100:00100000:0.0:1788460100.551807:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460100.551843:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460100.551887:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460100.552016:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003421568 00000100:00100000:1.0:1788460100.552029:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003421568 00000100:00100000:1.0:1788460100.552102:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 430 00000100:00100000:1.0:1788460100.552113:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bed032f6-c389-485e-b2f7-e2ea34763c65+14:2394:x1875336003421568:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:1.0:1788460100.552184:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bed032f6-c389-485e-b2f7-e2ea34763c65+14:2394:x1875336003421568:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 73us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460100.552193:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 430 00000100:00100000:2.0:1788460100.554911:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003421696 00000100:00100000:2.0:1788460100.554934:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003421696 00000100:00100000:2.0:1788460100.554989:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003421824 00000100:00100000:2.0:1788460100.555007:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003421824 00000100:00080000:1.0:1788460100.555079:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788460100.555123:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 137 00000100:00100000:2.0:1788460100.555137:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4138700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+9:2394:x1875336003421824:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:2.0:1788460100.555254:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4138700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+9:2394:x1875336003421824:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 120us (3409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460100.563432:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003422208 00000100:00100000:1.0:1788460100.563451:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003422208 00000100:00100000:0.0:1788460100.563507:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00080000:1.0:1788460100.563517:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788460100.563533:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003422080 00000100:00100000:0.0:1788460100.563546:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003422080 00000100:00100000:1.0:1788460100.563586:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003422336 00000100:00100000:1.0:1788460100.563592:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003422336 00000100:00100000:0.0:1788460100.563602:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 328 00000100:00100000:0.0:1788460100.563617:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4138a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a5915a6d-4114-41fb-8d95-33add86e0720+5:2394:x1875336003422208:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:1.0:1788460100.563623:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 329 00000100:00100000:1.0:1788460100.563634:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac405ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a5915a6d-4114-41fb-8d95-33add86e0720+5:2394:x1875336003422080:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:0.0:1788460100.563717:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4138a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a5915a6d-4114-41fb-8d95-33add86e0720+5:2394:x1875336003422208:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 105us (14099us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460100.563726:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 328 00000100:00100000:0.0:1788460100.563746:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 224 00000100:00100000:0.0:1788460100.563754:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac405fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+59:12446:x1875336003422336:12345-192.168.206.5@tcp:101:bash.0 00010000:00010000:0.0:1788460100.563776:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460100.563803:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5400/0x5dfa74784542bd86 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a940 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460100.565975:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5000/0x5dfa74784542bd8d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460100.566027:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5000/0x5dfa74784542bd8d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460100.566045:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5000/0x5dfa74784542bd8d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460100.566164:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 330 00000100:00100000:3.0:1788460100.566179:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4138380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2394:x1875336003421696:12345-192.168.206.5@tcp:400:kworker.0 00010000:00010000:0.0:1788460100.566218:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5400/0x5dfa74784542bd86 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a940 expref: 61 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460100.566246:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5000/0x5dfa74784542bd8d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a940 expref: 60 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460100.566256:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8c4bef200e00) 00010000:00010000:0.0:1788460100.566266:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788460100.566271:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc2bd5000, rc 0) 00000100:00100000:1.0:1788460100.566879:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac405ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a5915a6d-4114-41fb-8d95-33add86e0720+5:2394:x1875336003422080:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 3241us (14985us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460100.566892:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 329 00000100:00080000:1.0:1788460100.566962:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788460100.566967:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788460100.566980:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4138380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2394:x1875336003421696:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 806us (17605us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460100.566987:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 330 00000100:00100000:0.0:1788460100.567638:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac405fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+60:12446:x1875336003422336:12345-192.168.206.5@tcp:101:bash.0 Request processed in 3880us (4132us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460100.567647:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 224 00000100:00100000:2.0:1788460100.571940:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 137 00000100:00100000:0.0:1788460100.573431:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460100.574272:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003422592 00000100:00100000:3.0:1788460100.574289:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003422592 00000100:00100000:3.0:1788460100.574367:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 225 00000100:00100000:3.0:1788460100.574379:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc43faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+60:12446:x1875336003422592:12345-192.168.206.5@tcp:36:bash.0 00010000:00010000:3.0:1788460100.574686:0:13560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542bd94 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.574708:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542bd94 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.574721:0:13560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542bd94 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788460100.574773:0:13560:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:3.0:1788460100.574801:0:13560:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003521a457 reply state 0000000024fb5f23 transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542bd94 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.574815:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542bd94 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.574824:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8c4bef200e00) 00010000:00010000:3.0:1788460100.574827:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788460100.574832:0:13560:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788460100.574970:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc43faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+63:12446:x1875336003422592:12345-192.168.206.5@tcp:36:bash.0 Request processed in 567us (1523us total) trans 4294967502 rc 0/0 00000100:00100000:3.0:1788460100.574979:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 225 00000020:00080000:3.0:1788460100.575006:0:13560:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788460100.581063:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460100.582353:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003422720 00000100:00100000:3.0:1788460100.582371:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003422720 00000100:00100000:3.0:1788460100.582457:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 226 00000100:00100000:3.0:1788460100.582470:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac36cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+63:12446:x1875336003422720:12345-192.168.206.5@tcp:101:bash.0 00010000:00010000:3.0:1788460100.582512:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460100.582539:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208200/0x5dfa74784542bd9b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a947 expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.582665:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209800/0x5dfa74784542bda2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.582681:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676800/0x5dfa74784542bd78 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a939 expref: 64 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.582692:0:6535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209800/0x5dfa74784542bda2 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.582738:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676800/0x5dfa74784542bd78 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a939 expref: 64 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.582754:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676800/0x5dfa74784542bd78 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a939 expref: 64 pid: 13560 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460100.582771:0:6535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac490b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6535:1875336022352128:192.168.206.5@tcp:104: 00000100:00100000:3.0:1788460100.582915:0:6535:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc11ca300 going to sleep for 11 seconds 00000100:00100000:1.0:1788460100.598202:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460100.599754:0:9538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003422848 00000100:00100000:0.0:1788460100.599773:0:9538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003422848 00010000:00010000:0.0:1788460100.599840:0:9538:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676800/0x5dfa74784542bd78 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a939 expref: 65 pid: 13560 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460100.599999:0:9538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 108 00000100:00100000:0.0:1788460100.600088:0:9538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac39d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+65:2394:x1875336003422848:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788460100.600108:0:9538:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788460100.600116:0:9538:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676800/0x5dfa74784542bd78 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a939 expref: 65 pid: 13560 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460100.600139:0:9538:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676800/0x5dfa74784542bd78 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a939 expref: 65 pid: 13560 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460100.600169:0:9538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8c4bef200e00) 00010000:00010000:0.0:1788460100.600176:0:9538:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209800/0x5dfa74784542bda2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460100.600189:0:9538:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209800/0x5dfa74784542bda2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460100.600198:0:9538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209800/0x5dfa74784542bda2 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460100.600247:0:9538:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788460100.601083:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676800/0x5dfa74784542bd78 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a939 expref: 65 pid: 13560 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460100.601127:0:6535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac490b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6535:1875336022352128:192.168.206.5@tcp:104: 00010000:00010000:3.0:1788460100.601163:0:6535:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209800/0x5dfa74784542bda2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.601174:0:6535:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209800/0x5dfa74784542bda2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.601181:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209800/0x5dfa74784542bda2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788460100.601252:0:6535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788460100.601258:0:6535:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788460100.601283:0:6535:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209800/0x5dfa74784542bda2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.601321:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208200/0x5dfa74784542bd9b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a947 expref: 65 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.601337:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209800/0x5dfa74784542bda2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a947 expref: 64 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.601345:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8c4bef200e00) 00010000:00010000:3.0:1788460100.601348:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788460100.601351:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bef209800, rc 0) 00000100:00100000:3.0:1788460100.601553:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac36cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+64:12446:x1875336003422720:12345-192.168.206.5@tcp:101:bash.0 Request processed in 19084us (20500us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460100.601562:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 226 00000100:00100000:2.0:1788460100.609119:0:9538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac39d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+63:2394:x1875336003422848:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 9092us (10913us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460100.609140:0:9538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 108 00000100:00100000:1.0:1788460100.619452:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460100.619528:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003423104 00000100:00100000:2.0:1788460100.619542:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003423104 00000100:00100000:2.0:1788460100.619623:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 59 00000100:00100000:2.0:1788460100.619636:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac366b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+63:12446:x1875336003423104:12345-192.168.206.5@tcp:35:bash.0 00000100:00100000:2.0:1788460100.619908:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac366b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+64:12446:x1875336003423104:12345-192.168.206.5@tcp:35:bash.0 Request processed in 274us (469us total) trans 4294967503 rc 0/0 00000100:00100000:2.0:1788460100.619916:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 59 00000100:00100000:1.0:1788460100.719991:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460100.720145:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003423232 00000100:00100000:0.0:1788460100.720158:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003423232 00000100:00100000:0.0:1788460100.720229:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 227 00000100:00100000:0.0:1788460100.720240:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3668e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+64:12452:x1875336003423232:12345-192.168.206.5@tcp:101:lfs.0 00010000:00010000:0.0:1788460100.720271:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460100.720308:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5400/0x5dfa74784542bda9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a94e expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460100.720388:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4600/0x5dfa74784542bdb0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460100.720406:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4600/0x5dfa74784542bdb0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460100.720419:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4600/0x5dfa74784542bdb0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788460100.720471:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1788460100.720476:0:6533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788460100.720499:0:6533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4600/0x5dfa74784542bdb0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460100.720528:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5400/0x5dfa74784542bda9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a94e expref: 66 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460100.720548:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4600/0x5dfa74784542bdb0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a94e expref: 65 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460100.720588:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8c4bc5dc1500) 00010000:00010000:0.0:1788460100.720591:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788460100.720595:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc2bd4600, rc 0) 00000100:00100000:0.0:1788460100.720831:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3668e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+65:12452:x1875336003423232:12345-192.168.206.5@tcp:101:lfs.0 Request processed in 591us (895us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460100.720840:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 227 00000100:00100000:1.0:1788460100.731126:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460100.731697:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003423360 00000100:00100000:3.0:1788460100.731711:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003423360 00000100:00100000:3.0:1788460100.731792:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 228 00000100:00100000:3.0:1788460100.731803:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf3708050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+65:12452:x1875336003423360:12345-192.168.206.5@tcp:101:lfs.0 00010000:00010000:3.0:1788460100.731830:0:13560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460100.731856:0:13560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208200/0x5dfa74784542bdb7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a955 expref: -99 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.732000:0:13560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f1e00/0x5dfa74784542bdbe lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.732018:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f1e00/0x5dfa74784542bdbe lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.732031:0:13560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f1e00/0x5dfa74784542bdbe lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.732043:0:13560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc0031800/0x5dfa74784542bdc5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.732050:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc0031800/0x5dfa74784542bdc5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.732056:0:13560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc0031800/0x5dfa74784542bdc5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.732146:0:13560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc0031c00/0x5dfa74784542bdcc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.732156:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc0031c00/0x5dfa74784542bdcc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.732186:0:13560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc0031c00/0x5dfa74784542bdcc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788460100.732237:0:13560:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788460100.732243:0:13560:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788460100.732268:0:13560:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc0031c00/0x5dfa74784542bdcc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.732282:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc0031c00/0x5dfa74784542bdcc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.732291:0:13560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f1e00/0x5dfa74784542bdbe lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.732310:0:13560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f1e00/0x5dfa74784542bdbe lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.732317:0:13560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f1e00/0x5dfa74784542bdbe lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.732323:0:13560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc14f1e00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:3.0:1788460100.732328:0:13560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f1e00/0x5dfa74784542bdbe lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.732337:0:13560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f1e00/0x5dfa74784542bdbe lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.732349:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8c4bc5dc1500) 00010000:00010000:3.0:1788460100.732353:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460100.732359:0:13560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f1e00/0x5dfa74784542bdbe lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.732377:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f1e00/0x5dfa74784542bdbe lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.732395:0:13560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc0031800/0x5dfa74784542bdc5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.732402:0:13560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc0031800/0x5dfa74784542bdc5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.732408:0:13560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc0031800/0x5dfa74784542bdc5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.732412:0:13560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc0031800 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:3.0:1788460100.732415:0:13560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc0031800/0x5dfa74784542bdc5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.732421:0:13560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc0031800/0x5dfa74784542bdc5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.732429:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8c4be045a700) 00010000:00010000:3.0:1788460100.732432:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460100.732435:0:13560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc0031800/0x5dfa74784542bdc5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.732441:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc0031800/0x5dfa74784542bdc5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.732469:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208200/0x5dfa74784542bdb7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a955 expref: 67 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.732627:0:13560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc0031c00/0x5dfa74784542bdcc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a955 expref: 66 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.732636:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8c4bef200e00) 00010000:00010000:3.0:1788460100.732639:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788460100.732642:0:13560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc0031c00, rc 0) 00000100:00100000:3.0:1788460100.732725:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf3708050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+66:12452:x1875336003423360:12345-192.168.206.5@tcp:101:lfs.0 Request processed in 923us (1613us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460100.732733:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 228 00000100:00100000:0.0:1788460100.744078:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460100.744117:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460100.744218:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003423616 00000100:00100000:3.0:1788460100.744229:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003423616 00000100:00100000:3.0:1788460100.744293:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 229 00000100:00100000:3.0:1788460100.744303:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc43f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+66:12452:x1875336003423616:12345-192.168.206.5@tcp:101:lfs.0 00010000:00010000:3.0:1788460100.744320:0:6535:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460100.744338:0:6535:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc0031800/0x5dfa74784542bdd3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a95c expref: -99 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.744435:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208200/0x5dfa74784542bdda lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.744450:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209800/0x5dfa74784542bda2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a947 expref: 67 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.744458:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc0031c00/0x5dfa74784542bdcc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a955 expref: 67 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.744499:0:6535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208200/0x5dfa74784542bdda lrc: 5/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.744529:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc0031c00/0x5dfa74784542bdcc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a955 expref: 67 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.744541:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc0031c00/0x5dfa74784542bdcc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a955 expref: 67 pid: 13560 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460100.744554:0:6535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4909f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6535:1875336022352256:192.168.206.5@tcp:104: 00010000:00010000:3.0:1788460100.744660:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209800/0x5dfa74784542bda2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a947 expref: 67 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.744671:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209800/0x5dfa74784542bda2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a947 expref: 67 pid: 6535 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460100.744680:0:6535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac490aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6535:1875336022352384:192.168.206.5@tcp:104: 00000100:00100000:1.0:1788460100.744751:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003423744 00000100:00100000:1.0:1788460100.744764:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003423744 00010000:00010000:1.0:1788460100.744815:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc0031c00/0x5dfa74784542bdcc lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a955 expref: 68 pid: 13560 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460100.744856:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 109 00000100:00100000:3.0:1788460100.744867:0:6535:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc11ca300 going to sleep for 11 seconds 00000100:00100000:1.0:1788460100.744883:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc43f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+68:2394:x1875336003423744:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788460100.744901:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788460100.744909:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc0031c00/0x5dfa74784542bdcc lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a955 expref: 68 pid: 13560 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460100.744923:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc0031c00/0x5dfa74784542bdcc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a955 expref: 68 pid: 13560 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460100.745009:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8c4bef200e00) 00010000:00010000:1.0:1788460100.745015:0:6520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208200/0x5dfa74784542bdda lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460100.745025:0:6520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208200/0x5dfa74784542bdda lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460100.745032:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788460100.745080:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc43f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+68:2394:x1875336003423744:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 215us (962us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460100.745089:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 109 00010000:00010000:3.0:1788460100.750885:0:6535:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.206.5@tcp) returned -22 from blocking AST (req@0000000006b788e7 x1875336022352256) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc0031c00/0x5dfa74784542bdcc lrc: 1/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a955 expref: 67 pid: 13560 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.750909:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc0031c00/0x5dfa74784542bdcc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a955 expref: 67 pid: 13560 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460100.750927:0:6535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4909f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6535:1875336022352256:192.168.206.5@tcp:104: 00000100:00100000:3.0:1788460100.751064:0:6535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac490aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6535:1875336022352384:192.168.206.5@tcp:104: 00010000:00010000:3.0:1788460100.751091:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8c4bef200e00) 00010000:00010000:3.0:1788460100.751096:0:6535:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208200/0x5dfa74784542bdda lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.751105:0:6535:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208200/0x5dfa74784542bdda lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.751115:0:6535:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208200/0x5dfa74784542bdda lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460100.751252:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460100.751971:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003423872 00000100:00100000:3.0:1788460100.751979:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003423872 00010000:00010000:3.0:1788460100.752014:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209800/0x5dfa74784542bda2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a947 expref: 67 pid: 6535 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460100.752054:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 110 00000100:00100000:3.0:1788460100.752064:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf2ff8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+67:2393:x1875336003423872:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788460100.752077:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788460100.752083:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209800/0x5dfa74784542bda2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a947 expref: 67 pid: 6535 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.752096:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209800/0x5dfa74784542bda2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a947 expref: 67 pid: 6535 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.752116:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209800/0x5dfa74784542bda2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a947 expref: 67 pid: 6535 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.752144:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8c4bef200e00) 00010000:00010000:3.0:1788460100.752148:0:6518:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208200/0x5dfa74784542bdda lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.752156:0:6518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208200/0x5dfa74784542bdda lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.752163:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208200/0x5dfa74784542bdda lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.752184:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788460100.752228:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf2ff8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+66:2393:x1875336003423872:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 165us (977us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460100.752236:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 110 00010000:00010000:0.0:1788460100.752513:0:6535:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208200/0x5dfa74784542bdda lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460100.752522:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208200/0x5dfa74784542bdda lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788460100.752540:0:6535:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788460100.752684:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc0031800/0x5dfa74784542bdd3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a95c expref: 67 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460100.752713:0:6535:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208200/0x5dfa74784542bdda lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a95c expref: 66 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460100.752721:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8c4bef200e00) 00010000:00010000:0.0:1788460100.752723:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788460100.752726:0:6535:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bef208200, rc 0) 00000100:00100000:0.0:1788460100.752755:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc43f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+66:12452:x1875336003423616:12345-192.168.206.5@tcp:101:lfs.0 Request processed in 8453us (8686us total) trans 4294967504 rc 0/0 00000100:00100000:0.0:1788460100.752771:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 229 00000100:00100000:1.0:1788460100.757388:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460100.757490:0:9538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003424128 00000100:00100000:2.0:1788460100.757499:0:9538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003424128 00000100:00100000:2.0:1788460100.757556:0:9538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 15 00000100:00100000:2.0:1788460100.757565:0:9538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3669880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+66:12452:x1875336003424128:12345-192.168.206.5@tcp:103:lfs.0 00010000:00010000:2.0:1788460100.757589:0:9538:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460100.757611:0:9538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc0030a00/0x5dfa74784542bd2b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a92b expref: 66 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460100.757630:0:9538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8c4bef200e00) 00010000:00010000:2.0:1788460100.757866:0:9538:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788460100.757921:0:9538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3669880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+65:12452:x1875336003424128:12345-192.168.206.5@tcp:103:lfs.0 Request processed in 357us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460100.757983:0:9538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 15 00000100:00100000:3.0:1788460100.760613:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460100.762337:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003424256 00000100:00100000:1.0:1788460100.762351:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003424256 00000100:00100000:1.0:1788460100.762416:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 230 00000100:00100000:1.0:1788460100.762426:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac490aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+65:12452:x1875336003424256:12345-192.168.206.5@tcp:58:lfs.0 00010000:00010000:1.0:1788460100.762917:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677800/0x5dfa74784542bde8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460100.762936:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677800/0x5dfa74784542bde8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460100.763048:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677800/0x5dfa74784542bde8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788460100.763141:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1788460100.763276:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac490aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+65:12452:x1875336003424256:12345-192.168.206.5@tcp:58:lfs.0 Request processed in 850us (2668us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460100.763302:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 230 00000100:00100000:0.0:1788460100.771141:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460100.771223:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003424384 00000100:00100000:3.0:1788460100.771233:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003424384 00000100:00100000:3.0:1788460100.771290:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 231 00000100:00100000:3.0:1788460100.771301:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc43f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+65:12452:x1875336003424384:12345-192.168.206.5@tcp:101:lfs.0 00010000:00010000:3.0:1788460100.771319:0:13560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460100.771336:0:13560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209800/0x5dfa74784542bdef lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a963 expref: -99 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.771384:0:13560:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677800/0x5dfa74784542bde8 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.771395:0:13560:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209800/0x5dfa74784542bdef lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a963 expref: 66 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.771432:0:13560:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677800/0x5dfa74784542bde8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.771445:0:13560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209800/0x5dfa74784542bdef lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a963 expref: 66 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.771457:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8c4bef200e00) 00010000:00010000:3.0:1788460100.771460:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788460100.771464:0:13560:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209800/0x5dfa74784542bdef lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a963 expref: 66 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460100.771472:0:13560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bef209800, rc 0) 00000100:00100000:3.0:1788460100.771539:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc43f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+66:12452:x1875336003424384:12345-192.168.206.5@tcp:101:lfs.0 Request processed in 240us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460100.771546:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 231 00010000:00010000:0.0:1788460101.393604:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788460101.585657:0:13815:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00080000:3.0:1788460101.715005:0:9527:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:3.0:1788460101.715017:0:9527:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000040:00080000:3.0:1788460101.777141:0:13811:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788460101.778038:0:13811:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788460101.778077:0:13811:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1788460101.778086:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788460101.778286:0:13811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4909f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13811:1875336022352512:192.168.206.5@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788460101.778464:0:13811:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac25b3c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788460101.798145:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460101.798259:0:13811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4909f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13811:1875336022352512:192.168.206.5@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788460101.798660:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003424512 00000100:00100000:3.0:1788460101.798667:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003424512 00000100:00100000:3.0:1788460101.798746:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 232 00000100:00100000:3.0:1788460101.798756:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc43f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+66:12454:x1875336003424512:12345-192.168.206.5@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788460101.798794:0:6535:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00080000:1.0:1788460101.799242:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788460101.800191:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc43f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+66:12454:x1875336003424512:12345-192.168.206.5@tcp:53:lhsmtool_posix.0 Request processed in 1430us (2049us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460101.800202:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 232 00000100:00100000:1.0:1788460101.805170:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460101.805306:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003424640 00000100:00100000:0.0:1788460101.805315:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003424640 00000100:00100000:0.0:1788460101.805372:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 233 00000100:00100000:0.0:1788460101.805382:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3668a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+66:12454:x1875336003424640:12345-192.168.206.5@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788460101.805446:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4400/0x5dfa74784542bdf6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460101.805461:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4400/0x5dfa74784542bdf6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460101.805471:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4400/0x5dfa74784542bdf6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460101.805495:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542bdfd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460101.805503:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542bdfd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460101.805510:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542bdfd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460101.805534:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5600/0x5dfa74784542be04 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460101.805559:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5600/0x5dfa74784542be04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460101.805577:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5600/0x5dfa74784542be04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788460101.805621:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788460101.805625:0:6533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788460101.805635:0:6533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5600/0x5dfa74784542be04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460101.805646:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4400/0x5dfa74784542bdf6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460101.805652:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4400/0x5dfa74784542bdf6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460101.805658:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4400/0x5dfa74784542bdf6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460101.805663:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc2bd4400 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460101.805667:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4400/0x5dfa74784542bdf6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460101.805674:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4400/0x5dfa74784542bdf6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460101.805685:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c4bef1fde00) 00010000:00010000:0.0:1788460101.805688:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460101.805692:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4400/0x5dfa74784542bdf6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460101.805707:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4400/0x5dfa74784542bdf6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460101.805719:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542bdfd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460101.805725:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542bdfd lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460101.805731:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542bdfd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460101.805735:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc2bd5c00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460101.805738:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542bdfd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460101.805743:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542bdfd lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460101.805751:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff8c4be045a900) 00010000:00010000:0.0:1788460101.805754:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460101.805775:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542bdfd lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460101.805783:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5c00/0x5dfa74784542bdfd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460101.805799:0:6533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5600/0x5dfa74784542be04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460101.805805:0:6533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5600/0x5dfa74784542be04 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460101.805819:0:6533:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5600/0x5dfa74784542be04 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460101.805824:0:6533:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc2bd5600 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460101.805827:0:6533:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5600/0x5dfa74784542be04 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460101.805832:0:6533:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5600/0x5dfa74784542be04 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460101.805840:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8c4bef200e00) 00010000:00010000:0.0:1788460101.805843:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460101.805846:0:6533:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5600/0x5dfa74784542be04 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460101.805852:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5600/0x5dfa74784542be04 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460101.806330:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3668a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+66:12454:x1875336003424640:12345-192.168.206.5@tcp:34:lhsmtool_posix.0 Request processed in 948us (1167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460101.806339:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 233 00000100:00100000:1.0:1788460101.816514:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460101.816920:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003424896 00000100:00100000:2.0:1788460101.816931:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003424896 00000100:00100000:2.0:1788460101.817028:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 234 00000100:00100000:2.0:1788460101.817038:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3669180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+66:12454:x1875336003424896:12345-192.168.206.5@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788460101.817056:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460101.817075:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542be0b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a96a expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460101.817408:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542be12 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460101.817423:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542be12 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460101.817434:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542be12 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788460101.817445:0:6534:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788460101.817585:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542be12 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460101.817594:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542be12 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460101.817600:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542be12 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460101.817606:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bfadc7e00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:2.0:1788460101.817611:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542be12 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460101.817631:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542be12 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460101.817643:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8c4bef200e00) 00010000:00010000:2.0:1788460101.817646:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788460101.817651:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542be12 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460101.817657:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542be12 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460101.817696:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542be0b lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a96a expref: 68 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460101.817706:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c4bef1fde00) 00010000:00010000:2.0:1788460101.817709:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788460101.817713:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542be0b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a96a expref: 68 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460101.817722:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bfadc7400, rc 0) 00000100:00100000:2.0:1788460101.818300:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3669180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+67:12454:x1875336003424896:12345-192.168.206.5@tcp:101:lhsmtool_posix.0 Request processed in 1261us (1792us total) trans 4294967505 rc 301/301 00000100:00100000:2.0:1788460101.818310:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 234 00000100:00100000:1.0:1788460101.839751:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460101.839905:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003425024 00000100:00100000:0.0:1788460101.839914:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003425024 00000100:00100000:0.0:1788460101.839982:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 235 00000100:00100000:0.0:1788460101.839991:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac366b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+67:12454:x1875336003425024:12345-192.168.206.5@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788460101.840021:0:6535:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788460101.840118:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac366b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+67:12454:x1875336003425024:12345-192.168.206.5@tcp:53:lhsmtool_posix.0 Request processed in 128us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460101.840139:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 235 00000100:00100000:1.0:1788460101.843507:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460101.844284:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003425280 00000100:00100000:0.0:1788460101.844295:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003425280 00000100:00100000:0.0:1788460101.844357:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 236 00000100:00100000:0.0:1788460101.844367:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3668380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+67:12454:x1875336003425280:12345-192.168.206.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788460101.844388:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460101.844391:0:6533:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788460101.844417:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4600/0x5dfa74784542bdb0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a94e expref: 67 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460101.844435:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8c4bc5dc1500) 00010000:00010000:0.0:1788460101.844440:0:6533:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788460101.844453:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5600/0x5dfa74784542be20 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a971 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788460101.858679:0:6533:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x6:0x0], index 0: 0 00010000:00010000:1.0:1788460101.858880:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677a00/0x5dfa74784542be27 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460101.858897:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677a00/0x5dfa74784542be27 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460101.858908:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677a00/0x5dfa74784542be27 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460101.858988:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5600/0x5dfa74784542be20 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a971 expref: 69 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460101.859007:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677a00/0x5dfa74784542be27 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a971 expref: 68 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460101.859015:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8c4bc2ab7300) 00010000:00010000:1.0:1788460101.859018:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788460101.859022:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ac3677a00, rc 0) 00000100:00100000:1.0:1788460101.859095:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3668380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+68:12454:x1875336003425280:12345-192.168.206.5@tcp:101:lhsmtool_posix.0 Request processed in 14730us (15596us total) trans 4294967506 rc 0/0 00000100:00100000:1.0:1788460101.859104:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 236 00000100:00100000:1.0:1788460101.864056:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460101.864418:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003425536 00000100:00100000:2.0:1788460101.864427:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003425536 00000100:00100000:2.0:1788460101.864493:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 237 00000100:00100000:2.0:1788460101.864503:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3669c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+68:12454:x1875336003425536:12345-192.168.206.5@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788460101.864582:0:6534:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460101.864609:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677a00/0x5dfa74784542be27 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a971 expref: 68 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460101.864627:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8c4bc2ab7300) 00010000:00010000:2.0:1788460101.864635:0:6534:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788460101.864655:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542be35 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460101.864667:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542be35 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460101.864675:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542be35 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460101.864688:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542be3c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x8c7e5501 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460101.864708:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542be3c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x8c7e5501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460101.864715:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542be3c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x8c7e5501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460101.864755:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542be35 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460101.864771:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542be35 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460101.864778:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542be35 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460101.864791:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bfadc7400 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:2.0:1788460101.864795:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542be35 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460101.864802:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542be35 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460101.864810:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8c4bc5dc1500) 00010000:00010000:2.0:1788460101.864812:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460101.864816:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542be35 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460101.864821:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542be35 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460101.864830:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542be3c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x8c7e5501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460101.864835:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542be3c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x8c7e5501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460101.864841:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542be3c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x8c7e5501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460101.864846:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bfadc7e00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:2.0:1788460101.864849:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542be3c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x8c7e5501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460101.864854:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542be3c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x8c7e5501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460101.864872:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x8c7e5501 (ffff8c4bc90d8400) 00010000:00010000:2.0:1788460101.864875:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460101.864878:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542be3c lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x8c7e5501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460101.864883:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542be3c lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x8c7e5501 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460101.865302:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3669c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+67:12454:x1875336003425536:12345-192.168.206.5@tcp:36:lhsmtool_posix.0 Request processed in 798us (1252us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788460101.865310:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 237 00000100:00100000:1.0:1788460101.874378:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460101.874446:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003425664 00000100:00100000:3.0:1788460101.874456:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003425664 00000100:00100000:3.0:1788460101.874548:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 238 00000100:00100000:3.0:1788460101.874559:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3669500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+67:12454:x1875336003425664:12345-192.168.206.5@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788460101.874606:0:13560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460101.874627:0:13560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f1e00/0x5dfa74784542be43 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a978 expref: -99 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460101.874661:0:13560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d3e00/0x5dfa74784542be4a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460101.874674:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d3e00/0x5dfa74784542be4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460101.874685:0:13560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d3e00/0x5dfa74784542be4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460101.874798:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc14f1e00/0x5dfa74784542be43 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a978 expref: 69 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460101.874816:0:13560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d3e00/0x5dfa74784542be4a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a978 expref: 68 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460101.874824:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8c4bef200800) 00010000:00010000:3.0:1788460101.874826:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788460101.874835:0:13560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc29d3e00, rc 0) 00000100:00100000:3.0:1788460101.874895:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3669500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+68:12454:x1875336003425664:12345-192.168.206.5@tcp:101:lhsmtool_posix.0 Request processed in 337us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460101.874903:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 238 00000100:00100000:1.0:1788460101.880262:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460101.880443:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003425920 00000100:00100000:2.0:1788460101.880453:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003425920 00000100:00100000:3.0:1788460101.880918:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 239 00000100:00100000:3.0:1788460101.880929:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac366a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+68:12454:x1875336003425920:12345-192.168.206.5@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788460101.881055:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d3c00/0x5dfa74784542be51 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460101.881072:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d3c00/0x5dfa74784542be51 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460101.881083:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d3c00/0x5dfa74784542be51 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788460101.881231:0:6533:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:3.0:1788460101.881241:0:6533:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 398984296244ns, next at 399984293441ns, rc = 0 00000004:00010000:3.0:1788460101.881290:0:6533:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004c912bf1 reply state 00000000f03fa33e transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d3c00/0x5dfa74784542be51 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460101.881305:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d3c00/0x5dfa74784542be51 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460101.881312:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8c4bef200800) 00010000:00010000:3.0:1788460101.881315:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788460101.881318:0:6533:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788460101.881421:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac366a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+70:12454:x1875336003425920:12345-192.168.206.5@tcp:36:lhsmtool_posix.0 Request processed in 492us (1166us total) trans 4294967507 rc 0/0 00000100:00100000:3.0:1788460101.881428:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 239 00000100:00100000:0.0:1788460101.884735:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460101.884823:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003426048 00000100:00100000:2.0:1788460101.884832:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003426048 00000100:00100000:2.0:1788460101.884884:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 240 00000100:00100000:2.0:1788460101.884893:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc43f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+70:12454:x1875336003426048:12345-192.168.206.5@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788460101.884914:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460101.884933:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542be58 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a97f expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460101.885153:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542be58 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a97f expref: 71 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460101.885168:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542be58 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a97f expref: 71 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460101.885184:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8c4bef200800) 00010000:00010000:2.0:1788460101.885201:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788460101.885205:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bfadc7e00, rc 0) 00000100:00100000:2.0:1788460101.885266:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc43f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+71:12454:x1875336003426048:12345-192.168.206.5@tcp:101:lhsmtool_posix.0 Request processed in 374us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460101.885274:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 240 00000100:00100000:1.0:1788460101.888361:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460101.888449:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003426176 00000100:00100000:3.0:1788460101.888471:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003426176 00000100:00100000:3.0:1788460101.888534:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 70 00000100:00100000:3.0:1788460101.888544:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3668700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+9:2394:x1875336003426176:12345-192.168.206.5@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788460101.888747:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3668700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+10:2394:x1875336003426176:12345-192.168.206.5@tcp:2:lhsmtool_posix.0 Request processed in 203us (392us total) trans 4294967320 rc 0/0 00000100:00100000:3.0:1788460101.888755:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 70 00000100:00100000:3.0:1788460101.893045:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460101.893515:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003426432 00000100:00100000:2.0:1788460101.893524:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003426432 00000100:00100000:2.0:1788460101.893585:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 60 00000100:00100000:2.0:1788460101.893595:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4909f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+71:12454:x1875336003426432:12345-192.168.206.5@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788460101.893813:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4909f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+72:12454:x1875336003426432:12345-192.168.206.5@tcp:35:lhsmtool_posix.0 Request processed in 217us (773us total) trans 4294967508 rc 0/0 00000100:00100000:2.0:1788460101.893820:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 60 00000100:00100000:0.0:1788460101.897237:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460101.897451:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003426688 00000100:00100000:3.0:1788460101.897460:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003426688 00000100:00100000:3.0:1788460101.897519:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 241 00000100:00100000:3.0:1788460101.897528:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc43f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+72:12454:x1875336003426688:12345-192.168.206.5@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788460101.897638:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc43f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+72:12454:x1875336003426688:12345-192.168.206.5@tcp:57:lhsmtool_posix.0 Request processed in 111us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460101.897646:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 241 00000100:00100000:1.0:1788460101.901337:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460101.902479:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003426816 00000100:00100000:3.0:1788460101.902500:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003426816 00000100:00100000:3.0:1788460101.902571:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 242 00000100:00100000:3.0:1788460101.902582:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3668000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+72:12454:x1875336003426816:12345-192.168.206.5@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788460101.902602:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460101.902621:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d2e00/0x5dfa74784542be5f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a986 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460101.902690:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d2800/0x5dfa74784542be66 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460101.902703:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d2800/0x5dfa74784542be66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460101.902730:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d2800/0x5dfa74784542be66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788460101.902779:0:6533:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788460101.902796:0:6533:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d2800/0x5dfa74784542be66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460101.902818:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d2e00/0x5dfa74784542be5f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a986 expref: 74 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460101.902835:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d2800/0x5dfa74784542be66 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a986 expref: 73 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460101.902843:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8c4bef200800) 00010000:00010000:3.0:1788460101.902845:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788460101.902848:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc29d2800, rc 0) 00000100:00100000:3.0:1788460101.902911:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3668000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+73:12454:x1875336003426816:12345-192.168.206.5@tcp:101:lhsmtool_posix.0 Request processed in 330us (1582us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460101.902917:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 242 00000100:00100000:1.0:1788460101.906320:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460101.906398:0:8832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003426944 00000100:00100000:2.0:1788460101.906407:0:8832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003426944 00000100:00100000:2.0:1788460101.906456:0:8832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 71 00000100:00100000:2.0:1788460101.906464:0:8832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac366a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+10:2393:x1875336003426944:12345-192.168.206.5@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788460101.906479:0:8832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460101.906505:0:8832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fc8a9b50/0x5dfa74784542be6d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a98d expref: -99 pid: 8832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788460101.906526:0:8832:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a99bc44, blocks: 0x0 00010000:00010000:2.0:1788460101.906544:0:8832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=399s v=(0 0) 00010000:00010000:2.0:1788460101.906548:0:8832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788460101.906556:0:8832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc8a9b50/0x5dfa74784542be6d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a98d expref: 11 pid: 8832 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460101.906603:0:8832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fc8a9b50/0x5dfa74784542be6d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a98d expref: 11 pid: 8832 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460101.906615:0:8832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bfadc7400, rc 0) 00000100:00100000:2.0:1788460101.906662:0:8832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac366a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+11:2393:x1875336003426944:12345-192.168.206.5@tcp:101:lhsmtool_posix.0 Request processed in 199us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460101.906670:0:8832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 71 00000100:00100000:0.0:1788460101.909709:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460101.909848:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003427200 00000100:00100000:1.0:1788460101.909856:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003427200 00000100:00100000:1.0:1788460101.909903:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 243 00000100:00100000:1.0:1788460101.909913:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc43fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+73:12454:x1875336003427200:12345-192.168.206.5@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788460101.910094:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc43fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+73:12454:x1875336003427200:12345-192.168.206.5@tcp:57:lhsmtool_posix.0 Request processed in 182us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460101.910101:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 243 00000100:00100000:1.0:1788460101.912935:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460101.913096:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003427328 00000100:00100000:3.0:1788460101.913105:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003427328 00000100:00100000:3.0:1788460101.913149:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 72 00000100:00100000:3.0:1788460101.913159:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac366ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+11:12454:x1875336003427328:12345-192.168.206.5@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788460101.913176:0:8449:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460101.913193:0:8449:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005bc554f3/0x5dfa74784542be74 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a994 expref: -99 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460101.913242:0:8449:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fc8a9b50/0x5dfa74784542be6d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a98d expref: 12 pid: 8832 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460101.913251:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788460101.913255:0:8449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788460101.913260:0:8449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005bc554f3/0x5dfa74784542be74 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a994 expref: 12 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460101.913291:0:8449:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fc8a9b50/0x5dfa74784542be6d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a98d expref: 12 pid: 8832 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460101.913304:0:8449:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fc8a9b50/0x5dfa74784542be6d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a98d expref: 12 pid: 8832 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460101.913318:0:8449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4908700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1875336022352640:192.168.206.5@tcp:104: 00000100:00100000:3.0:1788460101.914029:0:8449:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac25b3c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788460101.917438:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460101.917518:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003427456 00000100:00100000:1.0:1788460101.917527:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003427456 00010000:00010000:1.0:1788460101.917575:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fc8a9b50/0x5dfa74784542be6d lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a98d expref: 13 pid: 8832 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460101.917649:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 111 00000100:00100000:1.0:1788460101.917660:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4933800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+13:2393:x1875336003427456:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788460101.917674:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788460101.917705:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fc8a9b50/0x5dfa74784542be6d lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a98d expref: 13 pid: 8832 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460101.917733:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fc8a9b50/0x5dfa74784542be6d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a98d expref: 13 pid: 8832 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460101.917767:0:6520:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460101.917772:0:6520:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460101.917780:0:6520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005bc554f3/0x5dfa74784542be74 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a994 expref: 13 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460101.917790:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005bc554f3/0x5dfa74784542be74 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a994 expref: 13 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460101.917826:0:6520:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000005bc554f3/0x5dfa74784542be74 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a994 expref: 13 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460101.917840:0:6520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac366b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6520:1875336022352768:192.168.206.5@tcp:105: 00000100:00100000:1.0:1788460101.917921:0:6520:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac36aa900 going to sleep for 11 seconds 00010000:00010000:3.0:1788460101.920451:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc8a9b50/0x5dfa74784542be6d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a98d expref: 13 pid: 8832 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460101.920474:0:8449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4908700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8449:1875336022352640:192.168.206.5@tcp:104: 00010000:00010000:3.0:1788460101.920573:0:8449:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005bc554f3/0x5dfa74784542be74 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a994 expref: 12 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460101.920589:0:8449:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc29d2e00, rc 0) 00000100:00100000:3.0:1788460101.920711:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac366ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+12:12454:x1875336003427328:12345-192.168.206.5@tcp:101:lhsmtool_posix.0 Request processed in 7553us (7782us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460101.920720:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 72 00000100:00100000:3.0:1788460101.924146:0:6520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac366b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6520:1875336022352768:192.168.206.5@tcp:105: 00010000:00010000:3.0:1788460101.924170:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788460101.924223:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4933800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+11:2393:x1875336003427456:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 6564us (6791us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460101.924234:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 111 00000100:00100000:0.0:1788460101.925832:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460101.925918:0:8454:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003427584 00000100:00100000:2.0:1788460101.925929:0:8454:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003427584 00002000:00100000:2.0:1788460101.926046:0:8454:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff8c4bc43fa300 x1875336003427584/t0(0) o4->f8767d3e-bfef-4d3d-8163-ef8ae18a3514@192.168.206.5@tcp:257/0 lens 504/0 e 0 to 0 dl 1788460112 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788460101.926058:0:8454:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c4bc43fa300 with x1875336003427584 ext(0->12) 00002000:00010000:2.0:1788460101.926064:0:8454:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c4bc43fa300 00000100:00100000:2.0:1788460101.926125:0:8454:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 6 00000100:00100000:2.0:1788460101.926134:0:8454:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc43fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+11:2394:x1875336003427584:12345-192.168.206.5@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788460101.926998:0:8454:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc43fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+13:2394:x1875336003427584:12345-192.168.206.5@tcp:4:lhsmtool_posix.0 Request processed in 862us (1170us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1788460101.927009:0:8454:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 6 00002000:00100000:2.0:1788460101.927017:0:8454:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff8c4bc43fa300 x1875336003427584/t4294967321(0) o4->f8767d3e-bfef-4d3d-8163-ef8ae18a3514@192.168.206.5@tcp:257/0 lens 504/448 e 0 to 0 dl 1788460112 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788460101.927025:0:8454:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c4bc43fa300 with x1875336003427584 ext(0->12) 00002000:00010000:2.0:1788460101.927030:0:8454:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c4bc43fa300 00000100:00100000:0.0:1788460101.931104:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460101.931267:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003427712 00000100:00100000:1.0:1788460101.931277:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003427712 00000100:00100000:1.0:1788460101.931362:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 244 00000100:00100000:1.0:1788460101.931373:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc43fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+73:12454:x1875336003427712:12345-192.168.206.5@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788460101.933164:0:6513:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:2.0:1788460101.933180:0:6513:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:2.0:1788460101.933223:0:6513:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:2.0:1788460101.933239:0:6513:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8c4ac25b3000 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:2.0:1788460101.933243:0:6513:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8c4ac29cd800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8c4bc4f58480 00000020:00080000:2.0:1788460101.933246:0:6513:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8c4ac29cda00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8c4ac2948a00 00000004:00080000:2.0:1788460101.933267:0:6513:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:2.0:1788460101.933290:0:6513:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8c4bf74ef480 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:2.0:1788460101.933292:0:6513:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8c4ac3af3b00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8c4bf74efa80 00000020:00080000:2.0:1788460101.933294:0:6513:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8c4ac3af3e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8c4ac3b00a00 00000020:00080000:2.0:1788460101.933304:0:6513:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:2.0:1788460101.933385:0:6565:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:2.0:1788460101.933435:0:6565:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1788460101.933578:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac366aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022353024:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788460101.933636:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460101.933669:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788460101.933675:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4931f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022352896:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788460101.933716:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460101.933739:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788460101.933747:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac366bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022353152:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788460101.933784:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460101.933811:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022353024 00000100:00100000:1.0:1788460101.933817:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022353024 00000100:00100000:1.0:1788460101.933852:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022352896 00000100:00100000:1.0:1788460101.933855:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022352896 00000100:00100000:1.0:1788460101.933864:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022353152 00000100:00100000:1.0:1788460101.933867:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022353152 00000100:00100000:1.0:1788460101.933878:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788460101.933885:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3668e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3660:x1875336022353024:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788460101.933909:0:8448:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00010000:00010000:1.0:1788460101.933931:0:8448:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a036c241/0x5dfa74784542be7b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460101.933979:0:8448:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f19e6968/0x5dfa74784542bc2f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a8ec expref: 12 pid: 8832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460101.933989:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=3s v=(0 0) 00010000:00010000:1.0:1788460101.933994:0:8448:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788460101.933998:0:8448:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a036c241/0x5dfa74784542be7b lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460101.934032:0:8448:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f19e6968/0x5dfa74784542bc2f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a8ec expref: 12 pid: 8832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460101.934046:0:8448:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f19e6968/0x5dfa74784542bc2f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a8ec expref: 12 pid: 8832 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460101.934069:0:8448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4396680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8448:1875336022353280:192.168.206.5@tcp:104: 00000100:00100000:1.0:1788460101.934127:0:8448:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac36aa240 going to sleep for 11 seconds 00000100:00100000:1.0:1788460101.934205:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc43fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+27:12454:x1875336003427712:12345-192.168.206.5@tcp:44:lhsmtool_posix.0 Request processed in 2834us (3109us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460101.934214:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 244 00000100:00100000:1.0:1788460101.934240:0:8832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788460101.934247:0:8832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac366b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022352896:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788460101.934260:0:8832:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00002000:00010000:1.0:1788460101.934282:0:8832:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a99bc42, atime: 0x6a99bc43, ctime: 0x6a99bc42, blocks: 0x8 00010000:00010000:1.0:1788460101.934288:0:8832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000806d8bda/0x5dfa74784542be82 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460101.934297:0:8832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=399s v=(0 0) 00010000:00010000:1.0:1788460101.934300:0:8832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460101.934306:0:8832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000806d8bda/0x5dfa74784542be82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460101.934320:0:8832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000806d8bda/0x5dfa74784542be82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460101.934330:0:8832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000806d8bda/0x5dfa74784542be82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460101.934337:0:8832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000806d8bda/0x5dfa74784542be82 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460101.934364:0:8832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788460101.934475:0:8832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac366b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3660:x1875336022352896:12345-0@lo:6:osp-syn-1-0.0 Request processed in 227us (757us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1788460101.934482:0:8832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788460101.934494:0:8832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788460101.934501:0:8832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc4394700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3662:x1875336022353152:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788460101.934576:0:8832:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788460101.934580:0:8832:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1788460100 00002000:00010000:1.0:1788460101.934582:0:8832:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788460101.934585:0:8832:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1788460100 -> 1788460100 00002000:00010000:1.0:1788460101.934588:0:8832:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1788460101.934616:0:8832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc4394700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3662:x1875336022353152:12345-0@lo:2:osp-syn-0-0.0 Request processed in 116us (831us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1788460101.934622:0:8832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000004:00080000:1.0:1788460101.934654:0:3662:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8c4ac366bb80/2, rc 0, transno 4294967322 00000100:00100000:1.0:1788460101.934659:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac366bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022353152:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788460101.934677:0:3660:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1788460101.934682:0:3660:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967310 00000004:00080000:1.0:1788460101.934710:0:3660:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8c4ac3bc0000, transno 4294967308 00000004:00080000:1.0:1788460101.934719:0:3660:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967310 00000100:00100000:1.0:1788460101.934732:0:3660:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8c4ac4931f80 x1875336022352896/t4294967311(4294967311) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788460117 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1788460101.934742:0:3660:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8c4ac4931f80/2, rc 0, transno 4294967311 00000100:00100000:1.0:1788460101.934746:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4931f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022352896:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1788460101.937272:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788460101.937285:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000806d8bda/0x5dfa74784542be82 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460101.937298:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac3676800 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:3.0:1788460101.937302:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000806d8bda/0x5dfa74784542be82 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460101.937312:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000806d8bda/0x5dfa74784542be82 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460101.937330:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000806d8bda/0x5dfa74784542be82 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460101.937338:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000806d8bda/0x5dfa74784542be82 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460101.937358:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460101.937376:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460101.937377:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460101.937627:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676a00/0x5dfa74784542bb79 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460101.937638:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676a00/0x5dfa74784542bb79 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460101.937645:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676a00/0x5dfa74784542bb79 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460101.937662:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac3676a00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460101.937667:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676a00/0x5dfa74784542bb79 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460101.937674:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676a00/0x5dfa74784542bb79 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460101.937686:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8c4bfa9fe800) 00010000:00010000:0.0:1788460101.937689:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460101.937693:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676a00/0x5dfa74784542bb79 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460101.937699:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676a00/0x5dfa74784542bb79 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460101.937726:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542bc21 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460101.937734:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542bc21 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460101.937739:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542bc21 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460101.937745:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bfadc7200 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460101.937748:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542bc21 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460101.937754:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542bc21 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460101.937784:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8c4bc90d8e00) 00010000:00010000:0.0:1788460101.937787:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460101.937790:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542bc21 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460101.937796:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542bc21 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460101.937814:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542bc9f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460101.937820:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542bc9f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460101.937826:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542bc9f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460101.937832:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc2bd4c00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460101.937834:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542bc9f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460101.937840:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542bc9f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460101.937847:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8c4be045a700) 00010000:00010000:0.0:1788460101.937849:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460101.937851:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542bc9f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460101.937857:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4c00/0x5dfa74784542bc9f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460101.937880:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676e00/0x5dfa74784542bcc2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460101.937886:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676e00/0x5dfa74784542bcc2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460101.937892:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676e00/0x5dfa74784542bcc2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460101.937897:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac3676e00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460101.937899:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676e00/0x5dfa74784542bcc2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460101.937906:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676e00/0x5dfa74784542bcc2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460101.937914:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8c4be045a700) 00010000:00010000:0.0:1788460101.937916:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460101.937919:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676e00/0x5dfa74784542bcc2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460101.937923:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676e00/0x5dfa74784542bcc2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460101.937939:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542bd94 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460101.937978:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542bd94 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460101.937984:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542bd94 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460101.937995:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bef208400 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460101.937999:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542bd94 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460101.938005:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542bd94 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460101.938014:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8c4bef200e00) 00010000:00010000:0.0:1788460101.938016:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460101.938020:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542bd94 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460101.938026:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542bd94 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460101.938039:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d3c00/0x5dfa74784542be51 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460101.938046:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d3c00/0x5dfa74784542be51 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460101.938052:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d3c00/0x5dfa74784542be51 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460101.938057:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc29d3c00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460101.938060:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d3c00/0x5dfa74784542be51 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460101.938065:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d3c00/0x5dfa74784542be51 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460101.938085:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8c4bef200800) 00010000:00010000:0.0:1788460101.938087:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788460101.938090:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d3c00/0x5dfa74784542be51 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460101.938096:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d3c00/0x5dfa74784542be51 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460101.938385:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460101.938853:0:8832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003427840 00000100:00100000:2.0:1788460101.938862:0:8832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003427840 00000100:00100000:2.0:1788460101.938914:0:8832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 76 00000100:00100000:2.0:1788460101.938925:0:8832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfaf6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+13:2394:x1875336003427840:12345-192.168.206.5@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788460101.940014:0:8448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4396680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8448:1875336022353280:192.168.206.5@tcp:104: 00010000:00010000:0.0:1788460101.940038:0:8448:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a036c241/0x5dfa74784542be7b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788460101.941377:0:8443:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:3.0:1788460101.941387:0:8443:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000100:00100000:2.0:1788460101.941577:0:8832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfaf6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+8:2394:x1875336003427840:12345-192.168.206.5@tcp:16:lhsmtool_posix.0 Request processed in 2641us (3182us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460101.941589:0:8832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 76 00000100:00100000:3.0:1788460101.945222:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460101.945354:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003427968 00000100:00100000:1.0:1788460101.945363:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003427968 00010000:00010000:1.0:1788460101.945399:0:6519:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f19e6968/0x5dfa74784542bc2f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a8ec expref: 8 pid: 8832 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460101.945442:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 112 00000100:00100000:1.0:1788460101.945451:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4908700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+8:2394:x1875336003427968:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788460101.945465:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788460101.945471:0:6519:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f19e6968/0x5dfa74784542bc2f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a8ec expref: 8 pid: 8832 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460101.945483:0:6519:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f19e6968/0x5dfa74784542bc2f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a8ec expref: 8 pid: 8832 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460101.945505:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f19e6968/0x5dfa74784542bc2f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a8ec expref: 8 pid: 8832 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460101.945520:0:6519:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788460101.945524:0:6519:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788460101.945529:0:6519:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a036c241/0x5dfa74784542be7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460101.945539:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a036c241/0x5dfa74784542be7b lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460101.945598:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788460101.945654:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4908700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+7:2394:x1875336003427968:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 204us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460101.945661:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 112 00010000:00010000:0.0:1788460101.945722:0:8448:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a036c241/0x5dfa74784542be7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460101.945732:0:8448:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a036c241/0x5dfa74784542be7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460101.945742:0:8448:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a036c241/0x5dfa74784542be7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460101.945750:0:8448:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a036c241/0x5dfa74784542be7b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460101.945772:0:8448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788460101.945975:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3668e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3660:x1875336022353024:12345-0@lo:6:osp-syn-0-0.0 Request processed in 12059us (12308us total) trans 4294967323 rc 0/0 00000100:00100000:0.0:1788460101.945993:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788460101.946181:0:3660:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:2.0:1788460101.946187:0:3660:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8c4ac484dc00, transno 4294967316 00000004:00080000:2.0:1788460101.946204:0:3660:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967322 00000004:00080000:2.0:1788460101.946221:0:3660:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8c4ac366bb80, transno 4294967322 00000100:00100000:2.0:1788460101.946228:0:3660:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8c4ac366aa00 x1875336022353024/t4294967323(4294967323) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788460117 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788460101.946248:0:9536:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000004:00080000:2.0:1788460101.946251:0:3660:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8c4ac366aa00/2, rc 0, transno 4294967323 00010000:00010000:1.0:1788460101.946255:0:9536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a036c241/0x5dfa74784542be7b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460101.946259:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac366aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022353024:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1788460101.946271:0:9536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac3676000 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:1.0:1788460101.946276:0:9536:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a036c241/0x5dfa74784542be7b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460101.946286:0:9536:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a036c241/0x5dfa74784542be7b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460101.946301:0:9536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a036c241/0x5dfa74784542be7b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460101.946308:0:9536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a036c241/0x5dfa74784542be7b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8448 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460101.946326:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460101.946327:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460101.946329:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788460101.955050:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460101.955176:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003428224 00000100:00100000:2.0:1788460101.955186:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003428224 00000100:00100000:2.0:1788460101.955249:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 245 00000100:00100000:2.0:1788460101.955264:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc43f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+21:12454:x1875336003428224:12345-192.168.206.5@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788460101.955314:0:6534:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460101.955338:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d2800/0x5dfa74784542be66 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a986 expref: 21 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460101.955357:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8c4bef200800) 00010000:00010000:2.0:1788460101.955362:0:6534:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788460101.955389:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542be89 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460101.955402:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542be89 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460101.955411:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542be89 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788460101.955532:0:6534:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001ac418e9 reply state 00000000fc25bd2a transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542be89 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460101.955545:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542be89 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460101.955551:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8c4bef200800) 00010000:00010000:2.0:1788460101.955579:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788460101.955582:0:6534:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788460101.955679:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc43f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+22:12454:x1875336003428224:12345-192.168.206.5@tcp:36:lhsmtool_posix.0 Request processed in 421us (636us total) trans 4294967509 rc 0/0 00000100:00100000:2.0:1788460101.955687:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 245 00000100:00100000:2.0:1788460101.959481:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460101.959620:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003428352 00000100:00100000:1.0:1788460101.959630:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003428352 00000100:00100000:1.0:1788460101.959703:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 77 00000100:00100000:1.0:1788460101.959713:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4930e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+7:2393:x1875336003428352:12345-192.168.206.5@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788460101.959844:0:8450:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1788460101.959848:0:8450:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 1788460100 -> 1788460099 00002000:00010000:1.0:1788460101.959851:0:8450:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 1788460099 00002000:00010000:1.0:1788460101.959852:0:8450:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1788460100 -> 1788460099 00002000:00010000:1.0:1788460101.959854:0:8450:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1788460101.959912:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4930e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+8:2393:x1875336003428352:12345-192.168.206.5@tcp:2:lhsmtool_posix.0 Request processed in 188us (428us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1788460101.959920:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 77 00000100:00100000:3.0:1788460101.963090:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460101.963267:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003428608 00000100:00100000:0.0:1788460101.963276:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003428608 00000100:00100000:0.0:1788460101.963330:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 246 00000100:00100000:0.0:1788460101.963339:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac490a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+22:12454:x1875336003428608:12345-192.168.206.5@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788460101.963409:0:13560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5a00/0x5dfa74784542be90 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460101.963426:0:13560:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d3e00/0x5dfa74784542be4a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a978 expref: 22 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460101.963435:0:13560:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5a00/0x5dfa74784542be90 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460101.963468:0:13560:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d3e00/0x5dfa74784542be4a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a978 expref: 22 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460101.963482:0:13560:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d3e00/0x5dfa74784542be4a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a978 expref: 22 pid: 13560 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460101.963496:0:13560:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc43f9880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13560:1875336022353408:192.168.206.5@tcp:104: 00000100:00100000:0.0:1788460101.963583:0:13560:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bd47b9f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788460101.974543:0:13560:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc43f9880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13560:1875336022353408:192.168.206.5@tcp:104: 00010000:00010000:3.0:1788460101.974580:0:13560:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5a00/0x5dfa74784542be90 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460101.979342:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460101.979502:0:9538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003428736 00000100:00100000:2.0:1788460101.979512:0:9538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003428736 00010000:00010000:2.0:1788460101.979552:0:9538:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d3e00/0x5dfa74784542be4a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a978 expref: 23 pid: 13560 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460101.979602:0:9538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 113 00000100:00100000:2.0:1788460101.979611:0:9538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4909880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+23:2393:x1875336003428736:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788460101.979624:0:9538:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460101.979630:0:9538:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d3e00/0x5dfa74784542be4a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a978 expref: 23 pid: 13560 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460101.979644:0:9538:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d3e00/0x5dfa74784542be4a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a978 expref: 23 pid: 13560 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460101.979666:0:9538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d3e00/0x5dfa74784542be4a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a978 expref: 23 pid: 13560 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460101.979682:0:9538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8c4bef200800) 00010000:00010000:2.0:1788460101.979687:0:9538:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5a00/0x5dfa74784542be90 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460101.979696:0:9538:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5a00/0x5dfa74784542be90 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460101.979717:0:9538:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5a00/0x5dfa74784542be90 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460101.979752:0:9538:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788460101.979807:0:9538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4909880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+22:2393:x1875336003428736:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 196us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460101.979814:0:9538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 113 00010000:00010000:0.0:1788460101.980408:0:13560:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5a00/0x5dfa74784542be90 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460101.980428:0:13560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5a00/0x5dfa74784542be90 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460101.980483:0:13560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5a00/0x5dfa74784542be90 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460101.980491:0:13560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5a00/0x5dfa74784542be90 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460101.980498:0:13560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5a00/0x5dfa74784542be90 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460101.980503:0:13560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc2bd5a00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460101.980507:0:13560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5a00/0x5dfa74784542be90 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460101.980514:0:13560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5a00/0x5dfa74784542be90 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460101.980523:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8c4bef200800) 00010000:00010000:0.0:1788460101.980526:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788460101.980530:0:13560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5a00/0x5dfa74784542be90 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460101.980536:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5a00/0x5dfa74784542be90 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460101.980611:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac490a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+21:12454:x1875336003428608:12345-192.168.206.5@tcp:55:lhsmtool_posix.0 Request processed in 17272us (17528us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788460101.980659:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 246 00000100:00100000:3.0:1788460101.987922:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460101.988057:0:8832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003428864 00000100:00100000:2.0:1788460101.988067:0:8832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003428864 00000100:00100000:2.0:1788460101.988121:0:8832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 78 00000100:00100000:2.0:1788460101.988131:0:8832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4908a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+8:2395:x1875336003428864:12345-192.168.206.5@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788460101.988172:0:8832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000088f49e84/0x5dfa74784542be97 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460101.988192:0:8832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005bc554f3/0x5dfa74784542be74 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a994 expref: 8 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460101.988200:0:8832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788460101.988205:0:8832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788460101.988209:0:8832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088f49e84/0x5dfa74784542be97 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460101.988243:0:8832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005bc554f3/0x5dfa74784542be74 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a994 expref: 8 pid: 8449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460101.988265:0:8832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005bc554f3/0x5dfa74784542be74 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a994 expref: 8 pid: 8449 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460101.988291:0:8832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4932a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8832:1875336022353536:192.168.206.5@tcp:104: 00000100:00100000:2.0:1788460101.988369:0:8832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac286c780 going to sleep for 11 seconds 00000100:00100000:2.0:1788460101.990290:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460101.990357:0:8832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4932a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8832:1875336022353536:192.168.206.5@tcp:104: 00010000:00010000:1.0:1788460101.990384:0:8832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000088f49e84/0x5dfa74784542be97 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460101.990462:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003428992 00000100:00100000:3.0:1788460101.990469:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003428992 00010000:00010000:3.0:1788460101.990512:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005bc554f3/0x5dfa74784542be74 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a994 expref: 9 pid: 8449 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460101.990546:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 114 00000100:00100000:3.0:1788460101.990555:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4930700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+9:2396:x1875336003428992:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788460101.990576:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788460101.990594:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005bc554f3/0x5dfa74784542be74 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a994 expref: 9 pid: 8449 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460101.990606:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005bc554f3/0x5dfa74784542be74 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a994 expref: 9 pid: 8449 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460101.990625:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005bc554f3/0x5dfa74784542be74 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a994 expref: 9 pid: 8449 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460101.990654:0:6520:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788460101.990659:0:6520:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788460101.990664:0:6520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000088f49e84/0x5dfa74784542be97 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460101.990674:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088f49e84/0x5dfa74784542be97 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460101.990703:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788460101.990753:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4930700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+8:2396:x1875336003428992:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 199us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460101.990769:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 114 00010000:00010000:2.0:1788460101.991106:0:8832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000088f49e84/0x5dfa74784542be97 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460101.991115:0:8832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088f49e84/0x5dfa74784542be97 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460101.991134:0:8832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000088f49e84/0x5dfa74784542be97 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460101.991141:0:8832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088f49e84/0x5dfa74784542be97 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460101.991148:0:8832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088f49e84/0x5dfa74784542be97 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460101.991155:0:8832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bfadc7800 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:2.0:1788460101.991159:0:8832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088f49e84/0x5dfa74784542be97 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460101.991167:0:8832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088f49e84/0x5dfa74784542be97 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460101.991191:0:8832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088f49e84/0x5dfa74784542be97 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460101.991198:0:8832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088f49e84/0x5dfa74784542be97 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460101.991320:0:8832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4908a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+7:2395:x1875336003428864:12345-192.168.206.5@tcp:1:lhsmtool_posix.0 Request processed in 3190us (3421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460101.991329:0:8832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 78 00000100:00100000:2.0:1788460102.000676:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460102.000768:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003429248 00000100:00100000:1.0:1788460102.000778:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003429248 00000100:00100000:1.0:1788460102.000837:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 247 00000100:00100000:1.0:1788460102.000846:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4932680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+21:12454:x1875336003429248:12345-192.168.206.5@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788460102.000914:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677a00/0x5dfa74784542be9e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460102.000929:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5000/0x5dfa74784542bd8d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a940 expref: 21 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460102.000938:0:6535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677a00/0x5dfa74784542be9e lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460102.001027:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5000/0x5dfa74784542bd8d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a940 expref: 21 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460102.001040:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5000/0x5dfa74784542bd8d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a940 expref: 21 pid: 6533 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460102.001054:0:6535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4395880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6535:1875336022353664:192.168.206.5@tcp:104: 00000100:00100000:1.0:1788460102.001128:0:6535:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac36aa300 going to sleep for 11 seconds 00000100:00100000:1.0:1788460102.003660:0:6535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4395880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6535:1875336022353664:192.168.206.5@tcp:104: 00010000:00010000:1.0:1788460102.003684:0:6535:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677a00/0x5dfa74784542be9e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460102.004909:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460102.004989:0:9549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003429376 00000100:00100000:3.0:1788460102.004998:0:9549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003429376 00010000:00010000:3.0:1788460102.005033:0:9549:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5000/0x5dfa74784542bd8d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a940 expref: 22 pid: 6533 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460102.005071:0:9549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 115 00000100:00100000:3.0:1788460102.005080:0:9549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4932300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+22:2394:x1875336003429376:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788460102.005093:0:9549:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788460102.005099:0:9549:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5000/0x5dfa74784542bd8d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a940 expref: 22 pid: 6533 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460102.005110:0:9549:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5000/0x5dfa74784542bd8d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a940 expref: 22 pid: 6533 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460102.005148:0:9549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5000/0x5dfa74784542bd8d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a940 expref: 22 pid: 6533 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460102.005163:0:9549:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8c4bef200e00) 00010000:00010000:3.0:1788460102.005169:0:9549:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209800/0x5dfa74784542bdef lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a963 expref: 21 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460102.005179:0:9549:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677a00/0x5dfa74784542be9e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460102.005186:0:9549:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677a00/0x5dfa74784542be9e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460102.005193:0:9549:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677a00/0x5dfa74784542be9e lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460102.005222:0:9549:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788460102.005342:0:6535:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677a00/0x5dfa74784542be9e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460102.005351:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677a00/0x5dfa74784542be9e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460102.005498:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677e00/0x5dfa74784542bea5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460102.005510:0:6535:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542be58 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a97f expref: 22 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460102.005517:0:6535:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677e00/0x5dfa74784542bea5 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460102.005543:0:6535:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542be58 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a97f expref: 22 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460102.005571:0:6535:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542be58 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a97f expref: 22 pid: 6534 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460102.005586:0:6535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4395880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6535:1875336022353792:192.168.206.5@tcp:104: 00000100:00100000:1.0:1788460102.005654:0:6535:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac36aa240 going to sleep for 11 seconds 00000100:00100000:3.0:1788460102.005806:0:9549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4932300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+22:2394:x1875336003429376:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 726us (902us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460102.005814:0:9549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 115 00000100:00100000:2.0:1788460102.010240:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460102.010386:0:6535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4395880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6535:1875336022353792:192.168.206.5@tcp:104: 00010000:00010000:1.0:1788460102.010413:0:6535:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677e00/0x5dfa74784542bea5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460102.011117:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003429504 00000100:00100000:3.0:1788460102.011126:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003429504 00010000:00010000:2.0:1788460102.011236:0:6518:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542be58 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a97f expref: 22 pid: 6534 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460102.011369:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 116 00000100:00100000:2.0:1788460102.011380:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf2ff8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+22:2394:x1875336003429504:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788460102.011394:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460102.011401:0:6518:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542be58 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a97f expref: 22 pid: 6534 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460102.011414:0:6518:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542be58 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a97f expref: 22 pid: 6534 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460102.011435:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542be58 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a97f expref: 22 pid: 6534 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460102.011463:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8c4bef200800) 00010000:00010000:2.0:1788460102.011468:0:6518:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677e00/0x5dfa74784542bea5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460102.011478:0:6518:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677e00/0x5dfa74784542bea5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460102.011498:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677e00/0x5dfa74784542bea5 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460102.011529:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788460102.011590:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf2ff8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+21:2394:x1875336003429504:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 212us (1358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460102.011597:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 116 00010000:00010000:3.0:1788460102.011841:0:6535:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677e00/0x5dfa74784542bea5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460102.011850:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677e00/0x5dfa74784542bea5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788460102.011974:0:6535:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:3.0:1788460102.012091:0:6535:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:3.0:1788460102.012126:0:6535:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:3.0:1788460102.012194:0:6535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac490b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6535:1875336022353920:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788460102.012239:0:6535:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460102.012280:0:6535:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4be27f93c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788460102.012448:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022353920 00000100:00100000:0.0:1788460102.012454:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022353920 00000100:00100000:0.0:1788460102.012507:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788460102.012523:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4908e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6535:x1875336022353920:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788460102.012602:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4908e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6535:x1875336022353920:12345-0@lo:1000:mdt00_002.0 Request processed in 82us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460102.012609:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00080000:3.0:1788460102.013799:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788460102.013845:0:6535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac490b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6535:1875336022353920:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1788460102.014005:0:6535:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:3.0:1788460102.014067:0:6535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac490b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6535:1875336022354048:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788460102.014112:0:6535:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460102.014133:0:6535:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bd1808000 going to sleep for 11 seconds 00000100:00100000:0.0:1788460102.014419:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022354048 00000100:00100000:0.0:1788460102.014425:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022354048 00000100:00100000:0.0:1788460102.014456:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788460102.014464:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac490bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6535:x1875336022354048:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788460102.014616:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac490bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6535:x1875336022354048:12345-0@lo:1000:mdt00_002.0 Request processed in 152us (504us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1788460102.014624:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788460102.014982:0:6535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac490b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6535:1875336022354048:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1788460102.015027:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677e00/0x5dfa74784542bea5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460102.015037:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677e00/0x5dfa74784542bea5 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460102.015045:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677e00/0x5dfa74784542bea5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460102.015051:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac3677e00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:3.0:1788460102.015055:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677e00/0x5dfa74784542bea5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460102.015063:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677e00/0x5dfa74784542bea5 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460102.015077:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8c4bef200800) 00010000:00010000:3.0:1788460102.015080:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788460102.015098:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677e00/0x5dfa74784542bea5 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460102.015104:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677e00/0x5dfa74784542bea5 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460102.015128:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677800/0x5dfa74784542bde8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460102.015134:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677800/0x5dfa74784542bde8 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460102.015139:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677800/0x5dfa74784542bde8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460102.015143:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac3677800 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:3.0:1788460102.015146:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677800/0x5dfa74784542bde8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460102.015152:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677800/0x5dfa74784542bde8 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460102.015160:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8c4bef200e00) 00010000:00010000:3.0:1788460102.015163:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788460102.015169:0:6535:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209800/0x5dfa74784542bdef lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a963 expref: 24 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460102.015179:0:6535:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209800/0x5dfa74784542bdef lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a963 expref: 24 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460102.015199:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209800/0x5dfa74784542bdef lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a963 expref: 24 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460102.015240:0:6535:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209800/0x5dfa74784542bdef lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a963 expref: 24 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460102.015744:0:6535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4908000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6535:1875336022354176:192.168.206.5@tcp:105: 00000100:00100000:3.0:1788460102.015880:0:6535:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bd1808000 going to sleep for 11 seconds 00000100:00100000:1.0:1788460102.018836:0:6535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4908000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6535:1875336022354176:192.168.206.5@tcp:105: 00010000:00010000:1.0:1788460102.018869:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677800/0x5dfa74784542bde8 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460102.018879:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677800/0x5dfa74784542bde8 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460102.018909:0:6535:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676200/0x5dfa74784542beac lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460102.018922:0:6535:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676200/0x5dfa74784542beac lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460102.018934:0:6535:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676200/0x5dfa74784542beac lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460102.018973:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676200/0x5dfa74784542beac lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460102.019008:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676200/0x5dfa74784542beac lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460102.019014:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676200/0x5dfa74784542beac lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460102.019020:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac3676200 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:1.0:1788460102.019023:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676200/0x5dfa74784542beac lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460102.019030:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676200/0x5dfa74784542beac lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460102.019041:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8c4bef200e00) 00010000:00010000:1.0:1788460102.019044:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788460102.019047:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676200/0x5dfa74784542beac lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460102.019054:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676200/0x5dfa74784542beac lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460102.019064:0:6535:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677a00/0x5dfa74784542be9e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460102.019070:0:6535:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677a00/0x5dfa74784542be9e lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460102.019075:0:6535:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677a00/0x5dfa74784542be9e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460102.019079:0:6535:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac3677a00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:1.0:1788460102.019088:0:6535:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677a00/0x5dfa74784542be9e lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460102.019095:0:6535:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677a00/0x5dfa74784542be9e lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460102.019103:0:6535:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8c4bef200e00) 00010000:00010000:1.0:1788460102.019106:0:6535:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788460102.019109:0:6535:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677a00/0x5dfa74784542be9e lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460102.019115:0:6535:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677a00/0x5dfa74784542be9e lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6535 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460102.019422:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4932680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+24:12454:x1875336003429248:12345-192.168.206.5@tcp:57:lhsmtool_posix.0 Request processed in 18574us (18752us total) trans 4294967514 rc 0/0 00000100:00100000:1.0:1788460102.019432:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 247 00000020:00080000:1.0:1788460102.019438:0:6535:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788460102.022370:0:13811:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788460102.022379:0:13811:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:1.0:1788460102.023155:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000040:00080000:3.0:1788460102.023548:0:13811:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1788460102.023560:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788460102.023766:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003429760 00000100:00100000:2.0:1788460102.023775:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003429760 00000100:00100000:2.0:1788460102.023822:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 61 00000100:00100000:2.0:1788460102.023832:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc4395880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+24:12454:x1875336003429760:12345-192.168.206.5@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788460102.024585:0:6536:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788460102.024617:0:6536:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00010000:00010000:2.0:1788460102.024649:0:6536:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542beb3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460102.024665:0:6536:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542beb3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460102.024676:0:6536:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542beb3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460102.024703:0:6536:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542beb3 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460102.024711:0:6536:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542beb3 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460102.024717:0:6536:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542beb3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460102.024738:0:6536:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788460102.024827:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc4395880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+26:12454:x1875336003429760:12345-192.168.206.5@tcp:35:lhsmtool_posix.0 Request processed in 995us (1677us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1788460102.024836:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 61 00000020:00080000:2.0:1788460102.024840:0:6536:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788460102.025642:0:9537:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788460102.025650:0:9537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542beb3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460102.025659:0:9537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bfadc7800 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:0.0:1788460102.025663:0:9537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542beb3 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460102.025672:0:9537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542beb3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460102.025686:0:9537:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8c4bef200800) 00010000:00010000:0.0:1788460102.025689:0:9537:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788460102.025694:0:9537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542beb3 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460102.025700:0:9537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7800/0x5dfa74784542beb3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6536 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460102.025726:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460102.025728:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460102.025730:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788460102.029629:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460102.029837:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003429888 00000100:00100000:2.0:1788460102.029847:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003429888 00000100:00100000:2.0:1788460102.029892:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 62 00000100:00100000:2.0:1788460102.029900:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bcec2c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+26:12452:x1875336003429888:12345-192.168.206.5@tcp:49:lfs.0 00000100:00100000:2.0:1788460102.030750:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bcec2c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+26:12452:x1875336003429888:12345-192.168.206.5@tcp:49:lfs.0 Request processed in 846us (1169us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460102.030767:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 62 00000100:00100000:1.0:1788460102.035442:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460102.035600:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003430144 00000100:00100000:2.0:1788460102.035609:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003430144 00000100:00100000:2.0:1788460102.035753:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 248 00000100:00100000:2.0:1788460102.035824:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc4395500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+26:12452:x1875336003430144:12345-192.168.206.5@tcp:58:lfs.0 00000040:00080000:2.0:1788460102.036212:0:6534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1788460102.036421:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc4395500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+26:12452:x1875336003430144:12345-192.168.206.5@tcp:58:lfs.0 Request processed in 599us (985us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460102.036442:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 248 00000100:00100000:0.0:1788460102.079752:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460102.080165:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003430272 00000100:00100000:3.0:1788460102.080175:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003430272 00000100:00100000:3.0:1788460102.080233:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 249 00000100:00100000:3.0:1788460102.080242:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc43f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+26:12456:x1875336003430272:12345-192.168.206.5@tcp:101:lfs.0 00010000:00010000:3.0:1788460102.080271:0:13560:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460102.080290:0:13560:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d2e00/0x5dfa74784542beba lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a99b expref: -99 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460102.080346:0:13560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d2a00/0x5dfa74784542bec1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460102.080360:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d2a00/0x5dfa74784542bec1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460102.080370:0:13560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d2a00/0x5dfa74784542bec1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460102.080384:0:13560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d2600/0x5dfa74784542bec8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460102.080404:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d2600/0x5dfa74784542bec8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460102.080411:0:13560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d2600/0x5dfa74784542bec8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460102.080481:0:13560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d3000/0x5dfa74784542becf lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460102.080623:0:13560:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208200/0x5dfa74784542bdda lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a95c expref: 27 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460102.080632:0:13560:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d3000/0x5dfa74784542becf lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460102.080663:0:13560:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208200/0x5dfa74784542bdda lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a95c expref: 27 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460102.080676:0:13560:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208200/0x5dfa74784542bdda lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a95c expref: 27 pid: 6535 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460102.080688:0:13560:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4909c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13560:1875336022354304:192.168.206.5@tcp:104: 00000100:00100000:3.0:1788460102.080847:0:13560:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bd1808f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788460102.084132:0:13560:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4909c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:13560:1875336022354304:192.168.206.5@tcp:104: 00010000:00010000:3.0:1788460102.084160:0:13560:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d3000/0x5dfa74784542becf lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460102.084899:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460102.084980:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003430528 00000100:00100000:3.0:1788460102.084999:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003430528 00000100:00100000:3.0:1788460102.085048:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 63 00000100:00100000:3.0:1788460102.085056:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc43f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+28:6161:x1875336003430528:12345-192.168.206.5@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788460102.085400:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc43f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+29:6161:x1875336003430528:12345-192.168.206.5@tcp:35:ldlm_bl.0 Request processed in 193us (353us total) trans 4294967517 rc 0/0 00000100:00100000:3.0:1788460102.085411:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 63 00000100:00100000:0.0:1788460102.089355:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460102.089436:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003430656 00000100:00100000:3.0:1788460102.089444:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003430656 00010000:00010000:3.0:1788460102.089478:0:6520:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208200/0x5dfa74784542bdda lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a95c expref: 29 pid: 6535 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460102.089593:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 117 00000100:00100000:3.0:1788460102.089603:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc43fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+29:2395:x1875336003430656:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788460102.089615:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788460102.089622:0:6520:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208200/0x5dfa74784542bdda lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a95c expref: 29 pid: 6535 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460102.089635:0:6520:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208200/0x5dfa74784542bdda lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a95c expref: 29 pid: 6535 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460102.089656:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208200/0x5dfa74784542bdda lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a95c expref: 29 pid: 6535 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460102.089672:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8c4bef200e00) 00010000:00010000:3.0:1788460102.089678:0:6520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d3000/0x5dfa74784542becf lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460102.089688:0:6520:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d3000/0x5dfa74784542becf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460102.089708:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d3000/0x5dfa74784542becf lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460102.089841:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788460102.089940:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc43fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+28:2395:x1875336003430656:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 338us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460102.090191:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 117 00010000:00010000:0.0:1788460102.090707:0:13560:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d3000/0x5dfa74784542becf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460102.090808:0:13560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d3000/0x5dfa74784542becf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788460102.090853:0:13560:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788460102.090857:0:13560:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788460102.090873:0:13560:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d3000/0x5dfa74784542becf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460102.090885:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d3000/0x5dfa74784542becf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460102.090894:0:13560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d2a00/0x5dfa74784542bec1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460102.090900:0:13560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d2a00/0x5dfa74784542bec1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460102.090906:0:13560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d2a00/0x5dfa74784542bec1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460102.090912:0:13560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc29d2a00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460102.090927:0:13560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d2a00/0x5dfa74784542bec1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460102.090935:0:13560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d2a00/0x5dfa74784542bec1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460102.091185:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8c4bc5dc1500) 00010000:00010000:0.0:1788460102.091189:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460102.091194:0:13560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d2a00/0x5dfa74784542bec1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460102.091200:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d2a00/0x5dfa74784542bec1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460102.091214:0:13560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d2600/0x5dfa74784542bec8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460102.091220:0:13560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d2600/0x5dfa74784542bec8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460102.091226:0:13560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d2600/0x5dfa74784542bec8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460102.091231:0:13560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc29d2600 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460102.091234:0:13560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d2600/0x5dfa74784542bec8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460102.091240:0:13560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d2600/0x5dfa74784542bec8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460102.091246:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8c4bef200200) 00010000:00010000:0.0:1788460102.091248:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460102.091316:0:13560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d2600/0x5dfa74784542bec8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460102.091323:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d2600/0x5dfa74784542bec8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460102.091364:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d2e00/0x5dfa74784542beba lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a99b expref: 28 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460102.091378:0:13560:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d3000/0x5dfa74784542becf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a99b expref: 27 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460102.091385:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8c4bef200e00) 00010000:00010000:0.0:1788460102.091387:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788460102.091389:0:13560:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc29d3000, rc 0) 00000100:00100000:0.0:1788460102.091428:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc43f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+27:12456:x1875336003430272:12345-192.168.206.5@tcp:101:lfs.0 Request processed in 11187us (11685us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460102.091435:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 249 00010000:00010000:0.0:1788460102.419763:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788460102.961404:0:14775:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788460102.961413:0:14775:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788460102.961446:0:14775:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788460102.961453:0:14775:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1788460103.061596:0:13811:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788460103.061603:0:13811:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788460103.061627:0:13811:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788460103.061633:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788460103.061751:0:13811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc43f9500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13811:1875336022354432:192.168.206.5@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788460103.061825:0:13811:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bd47b96c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788460103.066156:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460103.066230:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003430784 00000100:00100000:1.0:1788460103.066239:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003430784 00000100:00100000:1.0:1788460103.066310:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 250 00000100:00100000:1.0:1788460103.066321:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc43fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+28:12468:x1875336003430784:12345-192.168.206.5@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788460103.066353:0:6535:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788460103.066454:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc43fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+28:12468:x1875336003430784:12345-192.168.206.5@tcp:53:lhsmtool_posix.0 Request processed in 135us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460103.066462:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 250 00000100:00100000:1.0:1788460103.066583:0:13811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc43f9500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13811:1875336022354432:192.168.206.5@tcp:107:hsm_cdtr.0 00000100:00080000:0.0:1788460103.066752:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788460103.072354:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460103.072492:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003431040 00000100:00100000:3.0:1788460103.072501:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003431040 00000100:00100000:3.0:1788460103.072567:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 251 00000100:00100000:3.0:1788460103.072577:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc4397480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+27:12468:x1875336003431040:12345-192.168.206.5@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788460103.072596:0:6534:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460103.072614:0:6534:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d3a00/0x5dfa74784542bed6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a9a2 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460103.072709:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d3800/0x5dfa74784542bedd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460103.072724:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d3800/0x5dfa74784542bedd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460103.072736:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d3800/0x5dfa74784542bedd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788460103.072747:0:6534:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788460103.072857:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d3a00/0x5dfa74784542bed6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a9a2 expref: 30 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460103.072874:0:6534:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d3800/0x5dfa74784542bedd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a9a2 expref: 29 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460103.072882:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8c4bef200e00) 00010000:00010000:3.0:1788460103.072885:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788460103.072889:0:6534:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc29d3800, rc 0) 00000100:00100000:3.0:1788460103.072990:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc4397480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+29:12468:x1875336003431040:12345-192.168.206.5@tcp:101:lhsmtool_posix.0 Request processed in 368us (598us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1788460103.072998:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 251 00000100:00100000:1.0:1788460103.076277:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460103.076397:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003431296 00000100:00100000:0.0:1788460103.076406:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003431296 00000100:00100000:0.0:1788460103.076485:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 252 00000100:00100000:0.0:1788460103.076495:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc4396d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+29:12468:x1875336003431296:12345-192.168.206.5@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788460103.076573:0:13560:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542beeb lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460103.076589:0:13560:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542beeb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460103.076601:0:13560:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542beeb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460103.076732:0:13560:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542beeb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460103.076739:0:13560:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542beeb lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460103.076747:0:13560:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542beeb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460103.076766:0:13560:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc2bd4e00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460103.076770:0:13560:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542beeb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460103.076778:0:13560:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542beeb lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460103.076790:0:13560:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8c4bef200e00) 00010000:00010000:0.0:1788460103.076793:0:13560:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788460103.076798:0:13560:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542beeb lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460103.076816:0:13560:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd4e00/0x5dfa74784542beeb lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13560 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460103.076968:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc4396d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+30:12468:x1875336003431296:12345-192.168.206.5@tcp:57:lhsmtool_posix.0 Request processed in 474us (699us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1788460103.076977:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 252 00000040:00080000:3.0:1788460103.077577:0:13811:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788460103.077584:0:13811:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788460103.080607:0:13811:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1788460103.080627:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788460103.080912:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460103.081207:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460103.081591:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003431552 00000100:00100000:2.0:1788460103.081601:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003431552 00000100:00100000:2.0:1788460103.081651:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 64 00000100:00100000:2.0:1788460103.081663:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc4394a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+30:12468:x1875336003431552:12345-192.168.206.5@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788460103.081863:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc4394a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+31:12468:x1875336003431552:12345-192.168.206.5@tcp:35:lhsmtool_posix.0 Request processed in 202us (953us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1788460103.081871:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 64 00000100:00100000:3.0:1788460103.082025:0:9538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003431680 00000100:00100000:3.0:1788460103.082030:0:9538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003431680 00000100:00100000:3.0:1788460103.082075:0:9538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 16 00000100:00100000:3.0:1788460103.082083:0:9538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc4395c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+31:2396:x1875336003431680:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788460103.082094:0:9538:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788460103.082116:0:9538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d3800/0x5dfa74784542bedd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a9a2 expref: 31 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460103.082132:0:9538:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8c4bef200e00) 00010000:00010000:3.0:1788460103.082138:0:9538:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788460103.082185:0:9538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc4395c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+30:2396:x1875336003431680:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 103us (978us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460103.082202:0:9538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 16 00000100:00100000:2.0:1788460103.249285:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4933800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022354560:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788460103.249346:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460103.249415:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022354560 00000100:00100000:2.0:1788460103.249421:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022354560 00000100:00100000:2.0:1788460103.249481:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788460103.249490:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4930700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3662:x1875336022354560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788460103.249511:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923509248 avail 3691958272 00000100:00100000:2.0:1788460103.249565:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4930700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3662:x1875336022354560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460103.249572:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788460103.249612:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4933800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022354560:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788460103.441170:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460103.761540:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4933800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022354688:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788460103.761624:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460103.761855:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022354688 00000100:00100000:0.0:1788460103.761863:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022354688 00000100:00100000:0.0:1788460103.761922:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788460103.761931:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4909c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022354688:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788460103.761980:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1788460103.762048:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4909c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022354688:12345-0@lo:41:osp-pre-0-1.0 Request processed in 118us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460103.762055:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788460103.762175:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4933800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022354688:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788460103.762462:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788460103.762471:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4932300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022354816:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788460103.762501:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460103.762635:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022354816 00000100:00100000:2.0:1788460103.762641:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022354816 00000100:00100000:2.0:1788460103.762696:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788460103.762704:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4909f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022354816:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788460103.762719:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923509248 avail 3691958272 00000100:00100000:2.0:1788460103.762765:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4909f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022354816:12345-0@lo:13:osp-pre-0-1.0 Request processed in 62us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460103.762772:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00080000:3.0:1788460103.762862:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788460103.762888:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4932300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022354816:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788460104.470106:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788460104.786114:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788460104.786137:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4397b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022354944:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788460104.786249:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460104.786369:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022354944 00000100:00100000:3.0:1788460104.786377:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022354944 00000100:00100000:3.0:1788460104.786425:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788460104.786435:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc4394380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1875336022354944:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788460104.786466:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446453248 avail 1300213760 00000100:00100000:3.0:1788460104.786522:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc4394380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1875336022354944:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460104.786529:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788460104.786661:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4397b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022354944:0@lo:41:osp-pre-1-0.0 00000040:00080000:2.0:1788460104.870712:0:14827:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788460104.870721:0:14827:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788460104.870751:0:14827:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788460104.870757:0:14827:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788460105.024561:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460105.024605:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003431936 00000100:00100000:1.0:1788460105.024616:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003431936 00000100:00100000:1.0:1788460105.024704:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 253 00000100:00100000:1.0:1788460105.024715:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc43faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+30:12488:x1875336003431936:12345-192.168.206.5@tcp:101:lfs.0 00000100:00080000:0.0:1788460105.024718:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788460105.024739:0:6533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460105.024758:0:6533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676e00/0x5dfa74784542bef2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a9a9 expref: -99 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460105.024858:0:6533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676000/0x5dfa74784542bef9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460105.024872:0:6533:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676000/0x5dfa74784542bef9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460105.024885:0:6533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676000/0x5dfa74784542bef9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6533 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788460105.024896:0:6533:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788460105.025019:0:6533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676e00/0x5dfa74784542bef2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a9a9 expref: 33 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460105.025046:0:6533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676000/0x5dfa74784542bef9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a9a9 expref: 32 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460105.025055:0:6533:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8c4bef200e00) 00010000:00010000:1.0:1788460105.025059:0:6533:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788460105.025063:0:6533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ac3676000, rc 0) 00000100:00100000:1.0:1788460105.025123:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc43faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+32:12488:x1875336003431936:12345-192.168.206.5@tcp:101:lfs.0 Request processed in 410us (581us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1788460105.025130:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 253 00000100:00100000:3.0:1788460105.030888:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460105.031245:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003432064 00000100:00100000:2.0:1788460105.031254:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003432064 00000100:00100000:2.0:1788460105.031315:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 254 00000100:00100000:2.0:1788460105.031325:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4908000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+32:12488:x1875336003432064:12345-192.168.206.5@tcp:54:lfs.0 00010000:00010000:2.0:1788460105.031386:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542bf07 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460105.031403:0:6534:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542bf07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460105.031415:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542bf07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460105.031449:0:6534:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542bf07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460105.031457:0:6534:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542bf07 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460105.031464:0:6534:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542bf07 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460105.031482:0:6534:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bfadc7e00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:2.0:1788460105.031486:0:6534:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542bf07 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460105.031505:0:6534:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542bf07 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460105.031516:0:6534:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8c4bef200e00) 00010000:00010000:2.0:1788460105.031519:0:6534:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788460105.031524:0:6534:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542bf07 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460105.031531:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7e00/0x5dfa74784542bf07 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460105.031612:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4908000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+32:12488:x1875336003432064:12345-192.168.206.5@tcp:54:lfs.0 Request processed in 287us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460105.031620:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 254 00000100:00100000:0.0:1788460105.105936:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460105.106051:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003432192 00000100:00100000:1.0:1788460105.106065:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003432192 00000100:00100000:1.0:1788460105.106139:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 79 00000100:00100000:1.0:1788460105.106149:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc43f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+7:2395:x1875336003432192:12345-192.168.206.5@tcp:101:cat.0 00010000:00010000:1.0:1788460105.106167:0:8450:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460105.106185:0:8450:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000002813271/0x5dfa74784542bf0e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a9b0 expref: -99 pid: 8450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788460105.106225:0:8450:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 13, mtime: 0x6a99bc43, atime: 0x6a99bc43, ctime: 0x6a99bc43, blocks: 0x8 00010000:00010000:1.0:1788460105.106245:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=402s v=(0 0) 00010000:00010000:1.0:1788460105.106250:0:8450:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460105.106259:0:8450:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002813271/0x5dfa74784542bf0e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a9b0 expref: 8 pid: 8450 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460105.106283:0:8450:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000002813271/0x5dfa74784542bf0e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a9b0 expref: 8 pid: 8450 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460105.106330:0:8450:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ac3676e00, rc 0) 00000100:00100000:1.0:1788460105.106391:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc43f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+8:2395:x1875336003432192:12345-192.168.206.5@tcp:101:cat.0 Request processed in 243us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460105.106399:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 79 00000100:00080000:0.0:1788460105.106522:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788460105.120934:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460105.121078:0:8453:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003432320 00000100:00100000:0.0:1788460105.121087:0:8453:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003432320 00002000:00100000:0.0:1788460105.121133:0:8453:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff8c4ac4908700 x1875336003432320/t0(0) o3->f8767d3e-bfef-4d3d-8163-ef8ae18a3514@192.168.206.5@tcp:261/0 lens 488/0 e 0 to 0 dl 1788460116 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788460105.121143:0:8453:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c4ac4908700 with x1875336003432320 ext(0->4095) 00002000:00010000:0.0:1788460105.121147:0:8453:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c4ac4908700 00000100:00100000:0.0:1788460105.121178:0:8453:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 7 00000100:00100000:0.0:1788460105.121186:0:8453:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4908700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+8:2396:x1875336003432320:12345-192.168.206.5@tcp:3:cat.0 00000100:00100000:0.0:1788460105.121347:0:8453:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4908700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+8:2396:x1875336003432320:12345-192.168.206.5@tcp:3:cat.0 Request processed in 161us (421us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1788460105.121355:0:8453:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 7 00002000:00100000:0.0:1788460105.121361:0:8453:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff8c4ac4908700 x1875336003432320/t0(0) o3->f8767d3e-bfef-4d3d-8163-ef8ae18a3514@192.168.206.5@tcp:261/0 lens 488/4536 e 0 to 0 dl 1788460116 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788460105.121369:0:8453:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8c4ac4908700 with x1875336003432320 ext(0->4095) 00002000:00010000:0.0:1788460105.121372:0:8453:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8c4ac4908700 00000100:00100000:3.0:1788460105.297309:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788460105.297344:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4397b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022355072:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788460105.297525:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460105.297703:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3669880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022355584:0@lo:400:kworker.0 00000100:00100000:0.0:1788460105.297775:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460105.297808:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac366b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875336022355456:0@lo:400:kworker.0 00000100:00100000:0.0:1788460105.297811:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac366ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3662:1875336022356096:0@lo:400:kworker.0 00000100:00100000:0.0:1788460105.297868:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460105.297920:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022355584 00000100:00100000:1.0:1788460105.297930:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4933480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022355200:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788460105.298029:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022355072 00000100:00100000:2.0:1788460105.298036:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022355072 00000100:00100000:2.0:1788460105.298107:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788460105.298121:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4909880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3661:x1875336022355072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788460105.298162:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788460105.298205:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022355584 00000100:00100000:3.0:1788460105.298240:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788460105.298246:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4287b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022355584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460105.299792:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460105.299831:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac366bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1875336022355712:0@lo:400:kworker.0 00000100:00100000:1.0:1788460105.299860:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460105.300075:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac366b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022356224:0@lo:400:kworker.0 00000100:00100000:1.0:1788460105.300105:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460105.300124:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4286680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022356736:0@lo:400:kworker.0 00000100:00100000:1.0:1788460105.300143:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460105.300181:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788460105.300188:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc43f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0cf73fe6-82e2-434e-b670-631647721b2c:3659:1875336022355328:0@lo:400:kworker.0 00000100:00100000:1.0:1788460105.300216:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460105.300240:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3668700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022355840:0@lo:400:kworker.0 00000100:00100000:1.0:1788460105.300263:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460105.300275:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3668e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022356352:0@lo:400:kworker.0 00000100:00100000:1.0:1788460105.300294:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460105.300332:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022356096 00000100:00100000:1.0:1788460105.300338:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022356096 00000100:00100000:1.0:1788460105.300381:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022355712 00000100:00100000:1.0:1788460105.300384:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022355712 00000100:00100000:1.0:1788460105.300420:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1788460105.300428:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4285880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875336022356096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460105.300474:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4285880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875336022356096:12345-0@lo:400:kworker.0 Request processed in 47us (2605us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460105.300481:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1788460105.300497:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1788460105.300503:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc4396a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1875336022355712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460105.300536:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc4396a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1875336022355712:12345-0@lo:400:kworker.0 Request processed in 33us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460105.300542:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1788460105.300572:0:8451:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:1.0:1788460105.300579:0:8451:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:1.0:1788460105.300595:0:6538:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:1.0:1788460105.300599:0:6538:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:1.0:1788460105.300609:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022356224 00000100:00100000:1.0:1788460105.300612:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022356224 00000100:00100000:1.0:1788460105.300637:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022356736 00000100:00100000:1.0:1788460105.300640:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022356736 00000100:00100000:1.0:1788460105.300652:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022356352 00000100:00100000:1.0:1788460105.300654:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022356352 00000100:00100000:1.0:1788460105.300666:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788460105.300671:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc4394e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022356224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460105.300701:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc4394e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022356224:12345-0@lo:400:kworker.0 Request processed in 29us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460105.300707:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788460105.300718:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788460105.300724:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc4397800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022356736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460105.300750:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc4397800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022356736:12345-0@lo:400:kworker.0 Request processed in 26us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460105.300762:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788460105.300774:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788460105.300780:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc4394000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3659:x1875336022356352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460105.300809:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc4394000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3659:x1875336022356352:12345-0@lo:400:kworker.0 Request processed in 29us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460105.300814:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788460105.300830:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022355328 00000100:00100000:1.0:1788460105.300834:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022355328 00000100:00100000:1.0:1788460105.300857:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 431 00000100:00100000:1.0:1788460105.300863:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+29:3659:x1875336022355328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460105.300914:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0cf73fe6-82e2-434e-b670-631647721b2c+29:3659:x1875336022355328:12345-0@lo:400:kworker.0 Request processed in 50us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460105.300920:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 431 00000100:00100000:1.0:1788460105.301142:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc43f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0cf73fe6-82e2-434e-b670-631647721b2c:3659:1875336022355328:0@lo:400:kworker.0 00000100:00100000:1.0:1788460105.301155:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3668e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022356352:0@lo:400:kworker.0 00000100:00100000:1.0:1788460105.301164:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac366bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1875336022355712:0@lo:400:kworker.0 00000100:00100000:1.0:1788460105.301172:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac366b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022356224:0@lo:400:kworker.0 00000100:00100000:1.0:1788460105.301180:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4286680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022356736:0@lo:400:kworker.0 00000100:00100000:1.0:1788460105.301222:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022355200 00000100:00100000:1.0:1788460105.301225:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022355200 00000100:00100000:1.0:1788460105.301249:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022355840 00000100:00100000:1.0:1788460105.301252:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022355840 00000100:00100000:1.0:1788460105.301337:0:14842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788460105.301345:0:14842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc4397100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022355840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460105.301391:0:14842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc4397100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022355840:12345-0@lo:400:kworker.0 Request processed in 46us (1125us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460105.301400:0:14842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788460105.301425:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3668700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022355840:0@lo:400:kworker.0 00000100:00100000:1.0:1788460105.301496:0:14841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788460105.301500:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4909880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3661:x1875336022355072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3370us (3964us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460105.301510:0:14841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc4396300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022355200:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788460105.301523:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00002000:00000024:1.0:1788460105.301529:0:14841:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788460105.301599:0:14841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc4396300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022355200:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (1811us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460105.301605:0:14841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788460105.301640:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460105.301645:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4933480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022355200:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788460105.301701:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac366a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3661:1875336022355968:0@lo:400:kworker.0 00000100:00080000:1.0:1788460105.301793:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788460105.301799:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788460105.301801:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788460105.301816:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022355456 00000100:00100000:1.0:1788460105.301820:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022355456 00000100:00100000:1.0:1788460105.301846:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1788460105.301852:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4932300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1875336022355456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460105.301890:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4932300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1875336022355456:12345-0@lo:400:kworker.0 Request processed in 39us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460105.301896:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1788460105.302120:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460105.302156:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4285180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3661:1875336022356480:0@lo:400:kworker.0 00000100:00100000:2.0:1788460105.302187:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460105.302251:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4397b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022355072:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788460105.302282:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac366b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875336022355456:0@lo:400:kworker.0 00000100:00100000:2.0:1788460105.302309:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022355968 00000100:00100000:2.0:1788460105.302315:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022355968 00000100:00100000:2.0:1788460105.302360:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022356480 00000100:00100000:2.0:1788460105.302363:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022356480 00000100:00100000:2.0:1788460105.302383:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1788460105.302391:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4933800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1875336022355968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460105.302858:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4933800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1875336022355968:12345-0@lo:400:kworker.0 Request processed in 466us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460105.302869:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1788460105.302894:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1788460105.302903:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4932a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1875336022356480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460105.302941:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4932a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3661:x1875336022356480:12345-0@lo:400:kworker.0 Request processed in 38us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460105.302979:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00080000:2.0:1788460105.303005:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788460105.303032:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac366a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3661:1875336022355968:0@lo:400:kworker.0 00000100:00100000:2.0:1788460105.303050:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4285180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3661:1875336022356480:0@lo:400:kworker.0 00000100:00100000:3.0:1788460105.311242:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4287b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022355584:12345-0@lo:400:kworker.0 Request processed in 12980us (13451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460105.311263:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00010000:00080000:0.0:1788460105.319200:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac366ad80 x1875336022356096/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460105.319218:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac366ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3662:1875336022356096:0@lo:400:kworker.0 00000100:00100000:0.0:1788460105.319229:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4284e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1875336022356608:0@lo:400:kworker.0 00000100:00100000:0.0:1788460105.319357:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460105.319420:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3669880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022355584:0@lo:400:kworker.0 00000100:00100000:1.0:1788460105.319571:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022356608 00000100:00100000:1.0:1788460105.319578:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022356608 00000100:00100000:1.0:1788460105.319655:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1788460105.319665:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4286d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875336022356608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460105.319731:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4286d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875336022356608:12345-0@lo:400:kworker.0 Request processed in 67us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460105.319750:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00010000:00080000:0.0:1788460105.319790:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac4284e00 x1875336022356608/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460121 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460105.319807:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4284e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1875336022356608:0@lo:400:kworker.0 00000100:00080000:2.0:1788460105.319967:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1788460105.489173:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788460105.667621:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460105.667669:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460105.667694:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460105.667713:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460105.667729:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460105.667746:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460105.667788:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460105.667849:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003432704 00000100:00100000:2.0:1788460105.667861:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003432704 00000100:00100000:2.0:1788460105.667929:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003433216 00000100:00100000:2.0:1788460105.667932:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003433216 00000100:00100000:2.0:1788460105.667967:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003432576 00000100:00100000:2.0:1788460105.667970:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003432576 00000100:00100000:2.0:1788460105.667982:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003433088 00000100:00100000:2.0:1788460105.667984:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003433088 00000100:00100000:2.0:1788460105.668003:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 337 00000100:00100000:2.0:1788460105.668014:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4933b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2395:x1875336003432704:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:2.0:1788460105.668109:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4933b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2395:x1875336003432704:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 96us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460105.668118:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 337 00000100:00100000:2.0:1788460105.668138:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 338 00000100:00100000:2.0:1788460105.668145:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4931c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a5915a6d-4114-41fb-8d95-33add86e0720+5:2395:x1875336003433216:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:2.0:1788460105.668169:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4931c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a5915a6d-4114-41fb-8d95-33add86e0720+5:2395:x1875336003433216:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 25us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460105.668176:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 338 00000100:00100000:2.0:1788460105.668189:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 339 00000100:00100000:2.0:1788460105.668195:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4930a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+32:2395:x1875336003432576:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:2.0:1788460105.668221:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4930a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+32:2395:x1875336003432576:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 26us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460105.668227:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 339 00000100:00100000:2.0:1788460105.668239:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 340 00000100:00100000:2.0:1788460105.668244:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4933100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a5915a6d-4114-41fb-8d95-33add86e0720+5:2395:x1875336003433088:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:2.0:1788460105.668280:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4933100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a5915a6d-4114-41fb-8d95-33add86e0720+5:2395:x1875336003433088:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 35us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460105.668286:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 340 00000100:00100000:2.0:1788460105.668307:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003432960 00000100:00100000:2.0:1788460105.668311:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003432960 00000100:00100000:2.0:1788460105.668337:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003432832 00000100:00100000:2.0:1788460105.668340:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003432832 00000100:00100000:2.0:1788460105.668358:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 141 00000100:00100000:2.0:1788460105.668365:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4930000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2395:x1875336003432960:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:2.0:1788460105.668390:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4930000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2395:x1875336003432960:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 26us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460105.668396:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 141 00000100:00100000:2.0:1788460105.668406:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 142 00000100:00100000:2.0:1788460105.668412:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4931180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+8:2395:x1875336003432832:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:2.0:1788460105.668434:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4931180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+8:2395:x1875336003432832:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 22us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460105.668440:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 142 00000100:00080000:2.0:1788460105.668468:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788460105.668473:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788460105.668475:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788460105.668724:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003432448 00000100:00100000:3.0:1788460105.668729:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003432448 00000100:00100000:3.0:1788460105.668771:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 432 00000100:00100000:3.0:1788460105.668778:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc36ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bed032f6-c389-485e-b2f7-e2ea34763c65+14:2395:x1875336003432448:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:3.0:1788460105.668814:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc36ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bed032f6-c389-485e-b2f7-e2ea34763c65+14:2395:x1875336003432448:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 36us (1204us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460105.668821:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 432 00010000:00010000:0.0:1788460106.513317:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460107.539241:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788460107.864541:0:6513:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:3.0:1788460107.864573:0:6513:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8c4be27f9780 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1788460107.864579:0:6513:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8c4ac25cd000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8c4bd46c13c0 00000020:00080000:3.0:1788460107.864582:0:6513:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8c4ac25cde00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8c4ac3b00c00 00000020:00080000:3.0:1788460107.864603:0:6513:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:3.0:1788460107.864616:0:6565:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:3.0:1788460107.864683:0:6565:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:0.0:1788460107.864728:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542be89 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460107.864740:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542be89 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460107.864747:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542be89 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460107.864753:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bfadc7600 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460107.864758:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542be89 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460107.864764:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542be89 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460107.864779:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8c4bef200800) 00010000:00010000:0.0:1788460107.864782:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460107.864787:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542be89 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460107.864792:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7600/0x5dfa74784542be89 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6534 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788460107.865240:0:9527:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:0.0:1788460107.868633:0:8443:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00000001:00080000:0.0:1788460107.868646:0:8443:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000100:00100000:1.0:1788460108.369324:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4931880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022356864:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788460108.369393:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460108.369541:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022356864 00000100:00100000:0.0:1788460108.369550:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022356864 00000100:00100000:0.0:1788460108.369608:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788460108.369618:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc4397b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022356864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788460108.369644:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788460108.369704:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc4397b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022356864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460108.369711:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788460108.369797:0:3660:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:1.0:1788460108.369803:0:3660:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8c4ac366aa00, transno 4294967323 00000004:00080000:1.0:1788460108.369819:0:3660:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:1.0:1788460108.369842:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4931880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022356864:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788460108.370230:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788460108.568056:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460108.881422:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4931500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022356992:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788460108.881538:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460108.881625:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788460108.881632:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4932d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022357120:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788460108.881661:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460108.881698:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022357120 00000100:00100000:3.0:1788460108.881716:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022357120 00000100:00100000:3.0:1788460108.881782:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788460108.881792:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac490ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022357120:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788460108.881985:0:14841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022356992 00000100:00100000:2.0:1788460108.881991:0:14841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022356992 00000100:00100000:2.0:1788460108.882040:0:14841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788460108.882048:0:14841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac490b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022356992:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788460108.882073:0:14841:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788460108.882143:0:14841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac490b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022356992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460108.882151:0:14841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00080000:2.0:1788460108.882178:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788460108.882226:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4931500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022356992:0@lo:13:osp-pre-0-1.0 00000004:00000024:3.0:1788460108.884452:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1788460108.884585:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac490ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022357120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2790us (2918us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460108.884598:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788460108.887012:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4932d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022357120:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788460109.591089:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788460109.754325:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460109.760739:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003433344 00000100:00100000:0.0:1788460109.760754:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003433344 00000100:00100000:1.0:1788460109.761145:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 255 00000100:00100000:1.0:1788460109.761159:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4932d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+18:12141:x1875336003433344:12345-192.168.206.5@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788460109.761265:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4932d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+18:12141:x1875336003433344:12345-192.168.206.5@tcp:60:lhsmtool_posix.0 Request processed in 110us (6948us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460109.761272:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 255 00000100:00100000:3.0:1788460109.766594:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460109.766768:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003433472 00000100:00100000:0.0:1788460109.766782:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003433472 00000100:00080000:2.0:1788460109.769048:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788460109.769060:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788460109.772926:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 256 00000100:00100000:1.0:1788460109.772993:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4909180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:12141:x1875336003433472:12345-192.168.206.5@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788460109.773113:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4909180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:12141:x1875336003433472:12345-192.168.206.5@tcp:60:lhsmtool_posix.0 Request processed in 173us (6533us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460109.773120:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 256 00000100:00100000:3.0:1788460109.786334:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460109.786439:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003433728 00000100:00100000:2.0:1788460109.786459:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003433728 00000100:00100000:2.0:1788460109.786531:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 65 00000100:00100000:2.0:1788460109.786542:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac490a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+18:12141:x1875336003433728:12345-192.168.206.5@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788460109.786798:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac490a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+19:12141:x1875336003433728:12345-192.168.206.5@tcp:35:lhsmtool_posix.0 Request processed in 256us (473us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1788460109.786806:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 65 00000100:00100000:1.0:1788460109.905070:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788460109.905091:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4395880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022357248:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788460109.905163:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460109.905997:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022357248 00000100:00100000:3.0:1788460109.906007:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022357248 00000100:00100000:3.0:1788460109.906065:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788460109.906075:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc4394700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022357248:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788460109.906108:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446453248 avail 1300213760 00000100:00100000:3.0:1788460109.906176:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc4394700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022357248:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (1016us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460109.906184:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788460109.906253:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4395880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022357248:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788460110.053434:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460110.053557:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003433856 00000100:00100000:2.0:1788460110.053567:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003433856 00000100:00100000:2.0:1788460110.053643:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 257 00000100:00100000:2.0:1788460110.053654:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac490b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a5915a6d-4114-41fb-8d95-33add86e0720+5:12947:x1875336003433856:12345-192.168.206.5@tcp:101:lsof.0 00010000:00010000:2.0:1788460110.053674:0:7760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460110.053692:0:7760:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542bf15 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a9b7 expref: -99 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460110.053754:0:7760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542bf1c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460110.053783:0:7760:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542bf1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460110.053795:0:7760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542bf1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788460110.053841:0:7760:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788460110.053845:0:7760:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788460110.053867:0:7760:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542bf1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7760 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460110.053891:0:7760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7400/0x5dfa74784542bf15 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a9b7 expref: 7 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460110.053909:0:7760:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542bf1c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a9b7 expref: 6 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460110.053917:0:7760:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4bfa9fec00) 00010000:00010000:2.0:1788460110.053920:0:7760:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788460110.053923:0:7760:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bfadc7200, rc 0) 00000100:00080000:0.0:1788460110.054166:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788460110.054239:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac490b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a5915a6d-4114-41fb-8d95-33add86e0720+6:12947:x1875336003433856:12345-192.168.206.5@tcp:101:lsof.0 Request processed in 587us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460110.054247:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 257 00000100:00100000:0.0:1788460110.418194:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788460110.418221:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4931500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022357376:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788460110.418301:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460110.418494:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4395880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022357504:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788460110.418529:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460110.418608:0:14841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022357376 00000100:00100000:1.0:1788460110.418615:0:14841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022357376 00000100:00100000:1.0:1788460110.418676:0:14841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022357504 00000100:00100000:1.0:1788460110.418679:0:14841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022357504 00000100:00100000:1.0:1788460110.418693:0:14841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788460110.418702:0:14841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4284e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022357376:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788460110.418736:0:14841:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788460110.418777:0:14841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4284e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022357376:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460110.418785:0:14841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788460110.418799:0:14841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788460110.418805:0:14841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4284a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1875336022357504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788460110.418814:0:14841:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788460110.418836:0:14841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4284a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1875336022357504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 31us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460110.418841:0:14841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788460110.419032:0:3661:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:0.0:1788460110.419037:0:3661:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8c4ac4931f80, transno 4294967311 00000100:00100000:0.0:1788460110.419060:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4395880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022357504:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788460110.419081:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788460110.419100:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4931500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022357376:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788460110.420661:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0cf73fe6-82e2-434e-b670-631647721b2c:3662:1875336022357632:0@lo:400:kworker.0 00000100:00100000:0.0:1788460110.420732:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460110.420769:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3662:1875336022358144:0@lo:400:kworker.0 00000100:00100000:0.0:1788460110.420794:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460110.420816:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3662:1875336022358656:0@lo:400:kworker.0 00000100:00100000:0.0:1788460110.420835:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460110.420869:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788460110.420875:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3662:1875336022358016:0@lo:400:kworker.0 00000100:00100000:0.0:1788460110.420897:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460110.420924:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022358528:0@lo:400:kworker.0 00000100:00100000:0.0:1788460110.420972:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460110.421001:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022357888:0@lo:400:kworker.0 00000100:00100000:0.0:1788460110.421026:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460110.421042:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022358400:0@lo:400:kworker.0 00000100:00100000:0.0:1788460110.421059:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460110.421074:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788460110.421078:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3660:1875336022357760:0@lo:400:kworker.0 00000100:00100000:0.0:1788460110.421098:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460110.421113:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3660:1875336022358272:0@lo:400:kworker.0 00000100:00100000:0.0:1788460110.421131:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460110.421145:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3660:1875336022358784:0@lo:400:kworker.0 00000100:00100000:0.0:1788460110.421163:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460110.421362:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022357632 00000100:00100000:2.0:1788460110.421370:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022357632 00000100:00100000:2.0:1788460110.421417:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 433 00000100:00100000:2.0:1788460110.421426:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf363f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+29:3662:x1875336022357632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460110.421479:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf363f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+29:3662:x1875336022357632:12345-0@lo:400:kworker.0 Request processed in 55us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460110.421493:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 433 00000100:00100000:2.0:1788460110.421537:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022358528 00000100:00100000:2.0:1788460110.421540:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022358528 00000100:00100000:2.0:1788460110.421573:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022358400 00000100:00100000:2.0:1788460110.421575:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022358400 00000100:00100000:2.0:1788460110.421594:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788460110.421600:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4284700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1875336022358528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460110.421632:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4284700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1875336022358528:12345-0@lo:400:kworker.0 Request processed in 32us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460110.421638:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788460110.421649:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788460110.421656:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4287100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022358400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460110.421686:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4287100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022358400:12345-0@lo:400:kworker.0 Request processed in 31us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460110.421693:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00080000:2.0:1788460110.421718:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788460110.421756:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022358528:0@lo:400:kworker.0 00000100:00100000:2.0:1788460110.421768:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0cf73fe6-82e2-434e-b670-631647721b2c:3662:1875336022357632:0@lo:400:kworker.0 00000100:00100000:2.0:1788460110.421803:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022358400:0@lo:400:kworker.0 00000100:00100000:2.0:1788460110.421820:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022358144 00000100:00100000:2.0:1788460110.421823:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022358144 00000100:00100000:2.0:1788460110.421848:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022358656 00000100:00100000:2.0:1788460110.421851:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022358656 00000100:00100000:2.0:1788460110.421862:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022358016 00000100:00100000:2.0:1788460110.421865:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022358016 00000100:00100000:2.0:1788460110.421874:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022357760 00000100:00100000:2.0:1788460110.421883:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022357760 00000100:00100000:2.0:1788460110.421898:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022358272 00000100:00100000:2.0:1788460110.421900:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022358272 00000100:00100000:2.0:1788460110.421923:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022358784 00000100:00100000:2.0:1788460110.421926:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022358784 00000100:00100000:2.0:1788460110.421968:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1788460110.421975:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4284000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1875336022358144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460110.422011:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4284000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1875336022358144:12345-0@lo:400:kworker.0 Request processed in 36us (1215us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460110.422017:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1788460110.422029:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1788460110.422035:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4285f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1875336022358656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460110.422060:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4285f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1875336022358656:12345-0@lo:400:kworker.0 Request processed in 26us (1223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460110.422065:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1788460110.422076:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1788460110.422081:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4286a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1875336022358016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460110.422106:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4286a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1875336022358016:12345-0@lo:400:kworker.0 Request processed in 25us (1207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460110.422112:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1788460110.422122:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1788460110.422127:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4285c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1875336022357760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460110.422157:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4285c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1875336022357760:12345-0@lo:400:kworker.0 Request processed in 29us (1058us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460110.422163:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1788460110.422175:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:2.0:1788460110.422182:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4287480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1875336022358272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460110.422219:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4287480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1875336022358272:12345-0@lo:400:kworker.0 Request processed in 37us (1086us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460110.422225:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:2.0:1788460110.422239:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1788460110.422245:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4285180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1875336022358784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460110.422271:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4285180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1875336022358784:12345-0@lo:400:kworker.0 Request processed in 26us (1107us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460110.422277:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00080000:2.0:1788460110.422293:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788460110.422296:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788460110.422314:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3662:1875336022358016:0@lo:400:kworker.0 00000100:00100000:2.0:1788460110.422324:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3662:1875336022358144:0@lo:400:kworker.0 00000100:00100000:2.0:1788460110.422334:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3662:1875336022358656:0@lo:400:kworker.0 00000100:00100000:2.0:1788460110.422360:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3660:1875336022357760:0@lo:400:kworker.0 00010000:00080000:2.0:1788460110.422371:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bf75e3100 x1875336022358272/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460126 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460110.422381:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3660:1875336022358272:0@lo:400:kworker.0 00010000:00080000:2.0:1788460110.422392:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bf75e3480 x1875336022358784/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460126 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460110.422400:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3660:1875336022358784:0@lo:400:kworker.0 00000100:00100000:1.0:1788460110.423096:0:14842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022357888 00000100:00100000:1.0:1788460110.423103:0:14842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022357888 00000100:00100000:1.0:1788460110.423146:0:14842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1788460110.423154:0:14842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4286300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022357888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460110.423210:0:14842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4286300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022357888:12345-0@lo:400:kworker.0 Request processed in 58us (2183us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460110.423217:0:14842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1788460110.423252:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022357888:0@lo:400:kworker.0 00010000:00010000:0.0:1788460110.609240:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460110.782197:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460110.782243:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460110.782279:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460110.782313:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460110.782331:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460110.782353:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460110.782381:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460110.782406:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003434112 00000100:00100000:3.0:1788460110.782415:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003434112 00000100:00100000:3.0:1788460110.782480:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003434624 00000100:00100000:3.0:1788460110.782495:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003434624 00000100:00100000:3.0:1788460110.782511:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003434240 00000100:00100000:3.0:1788460110.782512:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003434240 00000100:00100000:3.0:1788460110.782539:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003434752 00000100:00100000:3.0:1788460110.782541:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003434752 00000100:00100000:3.0:1788460110.782566:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 347 00000100:00100000:3.0:1788460110.782576:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf75e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+19:2393:x1875336003434112:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:3.0:1788460110.782652:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf75e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+19:2393:x1875336003434112:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 76us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460110.782659:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 347 00000100:00100000:3.0:1788460110.782677:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 348 00000100:00100000:3.0:1788460110.782683:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf75e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a5915a6d-4114-41fb-8d95-33add86e0720+6:2393:x1875336003434624:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:3.0:1788460110.782707:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf75e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a5915a6d-4114-41fb-8d95-33add86e0720+6:2393:x1875336003434624:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 24us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460110.782713:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 348 00000100:00100000:3.0:1788460110.782737:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 349 00000100:00100000:3.0:1788460110.782743:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf75e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2393:x1875336003434240:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:3.0:1788460110.782767:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf75e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2393:x1875336003434240:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 24us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460110.782773:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 349 00000100:00100000:3.0:1788460110.782785:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 350 00000100:00100000:3.0:1788460110.782791:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf75e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a5915a6d-4114-41fb-8d95-33add86e0720+5:2393:x1875336003434752:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:3.0:1788460110.782813:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf75e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a5915a6d-4114-41fb-8d95-33add86e0720+5:2393:x1875336003434752:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 22us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460110.782819:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 350 00000100:00100000:0.0:1788460110.783209:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003434368 00000100:00100000:0.0:1788460110.783215:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003434368 00000100:00100000:0.0:1788460110.783250:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003434496 00000100:00100000:0.0:1788460110.783254:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003434496 00000100:00100000:0.0:1788460110.783285:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 145 00000100:00100000:0.0:1788460110.783293:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf75e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+7:2393:x1875336003434368:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:0.0:1788460110.783334:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf75e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+7:2393:x1875336003434368:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 41us (1090us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460110.783341:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 145 00000100:00100000:0.0:1788460110.783362:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 146 00000100:00100000:0.0:1788460110.783369:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf75e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2393:x1875336003434496:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:0.0:1788460110.783395:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf75e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2393:x1875336003434496:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 27us (1041us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460110.783402:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 146 00000100:00100000:2.0:1788460110.784349:0:6526:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003433984 00000100:00100000:2.0:1788460110.784359:0:6526:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003433984 00000100:00100000:2.0:1788460110.784408:0:6526:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 434 00000100:00100000:2.0:1788460110.784426:0:6526:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf363d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bed032f6-c389-485e-b2f7-e2ea34763c65+14:2393:x1875336003433984:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:2.0:1788460110.784495:0:6526:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf363d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bed032f6-c389-485e-b2f7-e2ea34763c65+14:2393:x1875336003433984:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 70us (2181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460110.784502:0:6526:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 434 00000100:00080000:2.0:1788460110.784550:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788460110.784554:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788460110.784556:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:0.0:1788460111.249188:0:13811:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788460111.249211:0:13811:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788460111.249288:0:13811:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:0.0:1788460111.249295:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788460111.633785:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788460111.831117:0:13815:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788460112.657341:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460113.489155:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4396680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022358912:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788460113.489257:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460113.489583:0:14841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022358912 00000100:00100000:1.0:1788460113.489592:0:14841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022358912 00000100:00100000:1.0:1788460113.489664:0:14841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788460113.489676:0:14841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf75e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022358912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788460113.489725:0:14841:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788460113.489786:0:14841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf75e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022358912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460113.489795:0:14841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788460113.489854:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4396680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022358912:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788460113.490078:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788460113.685567:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788460113.827409:0:15026:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 14:28:31 (1788460111) 00000100:00100000:0.0:1788460114.001594:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788460114.001623:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4286680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022359040:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788460114.001730:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460114.006871:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022359040 00000100:00100000:2.0:1788460114.006882:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022359040 00000100:00100000:3.0:1788460114.007064:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788460114.007082:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022359168:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788460114.007142:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460114.007187:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022359168 00000100:00100000:3.0:1788460114.007191:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022359168 00000100:00100000:3.0:1788460114.007225:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788460114.007234:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf75e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022359168:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788460114.007255:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788460114.007291:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf75e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022359168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 59us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460114.007298:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:3.0:1788460114.007315:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788460114.007488:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788460114.007515:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc532ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022359040:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788460114.007603:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022359168:0@lo:13:osp-pre-0-1.0 00000004:00000024:2.0:1788460114.007734:0:6539:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000001:00080000:0.0:1788460114.009055:0:6513:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:0.0:1788460114.009067:0:6513:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000100:00100000:2.0:1788460114.009159:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc532ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022359040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1023us (6788us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460114.009171:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788460114.009237:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4286680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022359040:0@lo:41:osp-pre-0-1.0 00000020:00080000:1.0:1788460114.011192:0:6565:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:1.0:1788460114.011216:0:6565:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:1.0:1788460114.706108:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788460115.025376:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4396680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022359296:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788460115.025523:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460115.025606:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022359296 00000100:00100000:0.0:1788460115.025613:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022359296 00000100:00100000:0.0:1788460115.025654:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788460115.025663:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc532c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022359296:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788460115.025705:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446453248 avail 1300213760 00000100:00100000:0.0:1788460115.025752:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc532c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022359296:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460115.025760:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788460115.025822:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4396680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022359296:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788460115.538407:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3669880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1875336022359808:0@lo:400:kworker.0 00000100:00100000:1.0:1788460115.538475:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460115.538536:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3668700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022360320:0@lo:400:kworker.0 00000100:00100000:1.0:1788460115.538564:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460115.538586:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc43f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022360832:0@lo:400:kworker.0 00000100:00100000:1.0:1788460115.538613:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460115.538638:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788460115.538644:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4396680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0cf73fe6-82e2-434e-b670-631647721b2c:3659:1875336022359424:0@lo:400:kworker.0 00000100:00100000:1.0:1788460115.538673:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460115.538695:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac366ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1875336022359936:0@lo:400:kworker.0 00000100:00100000:1.0:1788460115.538716:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460115.538734:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac366b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1875336022360448:0@lo:400:kworker.0 00000100:00100000:1.0:1788460115.538757:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460115.538784:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4395880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875336022359552:0@lo:400:kworker.0 00000100:00100000:1.0:1788460115.538810:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460115.538839:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac366a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1875336022360064:0@lo:400:kworker.0 00000100:00100000:1.0:1788460115.538864:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460115.538880:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac366bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1875336022360576:0@lo:400:kworker.0 00000100:00100000:1.0:1788460115.538903:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460115.539040:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac366aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022359680:0@lo:400:kworker.0 00000100:00100000:2.0:1788460115.539072:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460115.539092:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac366b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022360192:0@lo:400:kworker.0 00000100:00100000:2.0:1788460115.539112:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460115.539765:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022359808 00000100:00100000:1.0:1788460115.539775:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022359808 00000100:00100000:1.0:1788460115.539811:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022359936 00000100:00100000:1.0:1788460115.539814:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022359936 00000100:00100000:1.0:1788460115.539843:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022360448 00000100:00100000:1.0:1788460115.539846:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022360448 00000100:00100000:1.0:1788460115.539858:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022359552 00000100:00100000:1.0:1788460115.539861:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022359552 00000100:00100000:1.0:1788460115.539872:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022360064 00000100:00100000:1.0:1788460115.539874:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022360064 00000100:00100000:1.0:1788460115.539886:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022360576 00000100:00100000:1.0:1788460115.539888:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022360576 00000100:00100000:1.0:1788460115.539904:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1788460115.540004:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3668e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022360704:0@lo:400:kworker.0 00000100:00100000:2.0:1788460115.540045:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460115.540319:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1875336022359808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460115.540379:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1875336022359808:12345-0@lo:400:kworker.0 Request processed in 65us (1903us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460115.540546:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3669880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1875336022359808:0@lo:400:kworker.0 00000100:00100000:2.0:1788460115.541373:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1788460115.541390:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1875336022359936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460115.541451:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1875336022359936:12345-0@lo:400:kworker.0 Request processed in 69us (2733us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460115.541466:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1788460115.541499:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1788460115.541507:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1875336022360448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460115.541539:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1875336022360448:12345-0@lo:400:kworker.0 Request processed in 35us (2782us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460115.541545:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1788460115.541558:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1788460115.541565:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1875336022359552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460115.541599:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1875336022359552:12345-0@lo:400:kworker.0 Request processed in 35us (2789us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460115.541605:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1788460115.541618:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1788460115.541624:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1875336022360064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460115.541653:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1875336022360064:12345-0@lo:400:kworker.0 Request processed in 29us (2788us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460115.541659:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1788460115.541672:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1788460115.541679:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1875336022360576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460115.541708:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1875336022360576:12345-0@lo:400:kworker.0 Request processed in 29us (2804us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460115.541713:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1788460115.541732:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022359680 00000100:00100000:2.0:1788460115.541738:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022359680 00000100:00100000:2.0:1788460115.541772:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788460115.541779:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4931f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022359680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460115.542473:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00080000:1.0:1788460115.542516:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788460115.542520:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788460115.542571:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac41bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022360960:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788460115.542615:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460115.542655:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022360960 00000100:00100000:1.0:1788460115.542660:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022360960 00000100:00100000:1.0:1788460115.542697:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788460115.542703:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022360960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788460115.542746:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788460115.542784:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022360960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460115.543305:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4931f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022359680:12345-0@lo:400:kworker.0 Request processed in 1526us (4231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460115.543313:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788460115.543339:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022360320 00000100:00100000:2.0:1788460115.543343:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022360320 00000100:00100000:2.0:1788460115.543362:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022360832 00000100:00100000:2.0:1788460115.543365:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022360832 00000100:00100000:2.0:1788460115.543379:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022360192 00000100:00100000:2.0:1788460115.543381:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022360192 00000100:00100000:2.0:1788460115.543392:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022360704 00000100:00100000:2.0:1788460115.543395:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022360704 00000100:00100000:2.0:1788460115.543411:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788460115.543418:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022360320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460115.543450:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022360320:12345-0@lo:400:kworker.0 Request processed in 33us (4886us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460115.543455:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788460115.543466:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788460115.543472:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3659:x1875336022360832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460115.543507:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3659:x1875336022360832:12345-0@lo:400:kworker.0 Request processed in 37us (4894us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460115.543513:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788460115.543524:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788460115.543530:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4931500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022360192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460115.543557:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4931500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022360192:12345-0@lo:400:kworker.0 Request processed in 28us (4444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460115.543565:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788460115.543575:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788460115.543590:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4931880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022360704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460115.543619:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4931880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022360704:12345-0@lo:400:kworker.0 Request processed in 31us (3574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460115.543624:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788460115.543690:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac366aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022359680:0@lo:400:kworker.0 00000100:00100000:2.0:1788460115.543701:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac366b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022360192:0@lo:400:kworker.0 00000100:00100000:2.0:1788460115.543709:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3668e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022360704:0@lo:400:kworker.0 00000100:00100000:2.0:1788460115.543729:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788460115.543735:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4933480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022361088:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788460115.543762:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460115.543792:0:14841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022361088 00000100:00100000:3.0:1788460115.544370:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac366ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1875336022359936:0@lo:400:kworker.0 00000100:00100000:3.0:1788460115.544384:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac366b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1875336022360448:0@lo:400:kworker.0 00000100:00100000:3.0:1788460115.544395:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3668700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022360320:0@lo:400:kworker.0 00000100:00100000:3.0:1788460115.544405:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc43f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022360832:0@lo:400:kworker.0 00000100:00100000:1.0:1788460115.544589:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:1.0:1788460115.544615:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788460115.544619:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788460115.544649:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac41bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022360960:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788460115.544688:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022359424 00000100:00100000:1.0:1788460115.544692:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022359424 00000100:00100000:1.0:1788460115.544786:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 435 00000100:00100000:3.0:1788460115.544789:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4395880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875336022359552:0@lo:400:kworker.0 00010000:00080000:3.0:1788460115.544807:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac366a680 x1875336022360064/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460131 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460115.544825:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac366a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1875336022360064:0@lo:400:kworker.0 00010000:00080000:3.0:1788460115.544838:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac366bb80 x1875336022360576/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460131 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460115.544846:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac366bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1875336022360576:0@lo:400:kworker.0 00000100:00100000:1.0:1788460115.547392:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf363cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+29:3659:x1875336022359424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460115.547503:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf363cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0cf73fe6-82e2-434e-b670-631647721b2c+29:3659:x1875336022359424:12345-0@lo:400:kworker.0 Request processed in 2697us (8816us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460115.547514:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 435 00000100:00100000:0.0:1788460115.547584:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4396680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0cf73fe6-82e2-434e-b670-631647721b2c:3659:1875336022359424:0@lo:400:kworker.0 00000100:00100000:2.0:1788460115.547698:0:14841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022361088 00000100:00100000:2.0:1788460115.547751:0:14841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788460115.547759:0:14841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4286680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022361088:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788460115.547779:0:14841:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788460115.547837:0:14841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4286680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022361088:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (4073us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460115.547843:0:14841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788460115.547900:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4933480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022361088:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788460115.731936:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460115.902176:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460115.902203:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460115.902226:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460115.902251:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460115.902268:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460115.902285:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460115.902307:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460115.902331:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003435264 00000100:00100000:3.0:1788460115.902339:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003435264 00000100:00100000:3.0:1788460115.902382:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003435392 00000100:00100000:3.0:1788460115.902384:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003435392 00000100:00100000:3.0:1788460115.902404:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 151 00000100:00100000:3.0:1788460115.902412:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf75e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+7:2394:x1875336003435264:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:3.0:1788460115.902499:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf75e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+7:2394:x1875336003435264:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 87us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460115.902507:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 151 00000100:00100000:3.0:1788460115.902522:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 152 00000100:00100000:3.0:1788460115.902528:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf75e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2394:x1875336003435392:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:3.0:1788460115.902548:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf75e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2394:x1875336003435392:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 21us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460115.902568:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 152 00000100:00100000:2.0:1788460115.902993:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003435008 00000100:00100000:2.0:1788460115.902999:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003435008 00000100:00100000:2.0:1788460115.903028:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003435520 00000100:00100000:2.0:1788460115.903031:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003435520 00000100:00100000:2.0:1788460115.903043:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003435136 00000100:00100000:2.0:1788460115.903045:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003435136 00000100:00100000:2.0:1788460115.903056:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003435648 00000100:00100000:2.0:1788460115.903058:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003435648 00000100:00100000:2.0:1788460115.903083:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 357 00000100:00100000:2.0:1788460115.903097:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf75e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+18:2394:x1875336003435008:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:2.0:1788460115.903138:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf75e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+18:2394:x1875336003435008:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 42us (970us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460115.903145:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 357 00000100:00100000:2.0:1788460115.903160:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 358 00000100:00100000:2.0:1788460115.903166:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf75e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a5915a6d-4114-41fb-8d95-33add86e0720+6:2394:x1875336003435520:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:2.0:1788460115.903190:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf75e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a5915a6d-4114-41fb-8d95-33add86e0720+6:2394:x1875336003435520:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 24us (963us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460115.903196:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 358 00000100:00100000:2.0:1788460115.903207:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 359 00000100:00100000:2.0:1788460115.903214:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf75e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2394:x1875336003435136:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:2.0:1788460115.903236:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf75e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2394:x1875336003435136:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 23us (967us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460115.903242:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 359 00000100:00100000:2.0:1788460115.903252:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 360 00000100:00100000:2.0:1788460115.903258:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf75e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a5915a6d-4114-41fb-8d95-33add86e0720+5:2394:x1875336003435648:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:2.0:1788460115.903277:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf75e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a5915a6d-4114-41fb-8d95-33add86e0720+5:2394:x1875336003435648:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 21us (969us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460115.903284:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 360 00000100:00100000:1.0:1788460115.903717:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003434880 00000100:00100000:1.0:1788460115.903722:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003434880 00000100:00100000:1.0:1788460115.903857:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 436 00000100:00100000:1.0:1788460115.903866:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf363dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bed032f6-c389-485e-b2f7-e2ea34763c65+14:2394:x1875336003434880:12345-192.168.206.5@tcp:400:kworker.0 00000100:00080000:2.0:1788460115.904026:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788460115.904030:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788460115.904033:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788460115.904035:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788460115.904507:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf363dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bed032f6-c389-485e-b2f7-e2ea34763c65+14:2394:x1875336003434880:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 639us (2252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460115.904516:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 436 00010000:00010000:0.0:1788460116.757207:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460117.777231:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788460118.200641:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460118.200753:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003435904 00000100:00100000:2.0:1788460118.200775:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003435904 00000100:00100000:2.0:1788460118.200846:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 66 00000100:00100000:2.0:1788460118.200857:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc532e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+18:13170:x1875336003435904:12345-192.168.206.5@tcp:35:umount.0 00000100:00100000:2.0:1788460118.201124:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc532e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+19:13170:x1875336003435904:12345-192.168.206.5@tcp:35:umount.0 Request processed in 268us (489us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1788460118.201132:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 66 00000100:00080000:1.0:1788460118.201204:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788460118.211253:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460118.211457:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003436160 00000100:00100000:2.0:1788460118.211467:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003436160 00000100:00100000:2.0:1788460118.211584:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 67 00000100:00100000:2.0:1788460118.211595:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf75e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+19:13170:x1875336003436160:12345-192.168.206.5@tcp:35:umount.0 00000100:00100000:2.0:1788460118.211883:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf75e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+20:13170:x1875336003436160:12345-192.168.206.5@tcp:35:umount.0 Request processed in 280us (630us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1788460118.211891:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 67 00000100:00100000:3.0:1788460118.215886:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460118.215987:0:6536:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003436416 00000100:00100000:0.0:1788460118.215997:0:6536:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003436416 00000100:00100000:0.0:1788460118.216057:0:6536:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 68 00000100:00100000:0.0:1788460118.216066:0:6536:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bcec2c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+20:13170:x1875336003436416:12345-192.168.206.5@tcp:35:umount.0 00000100:00100000:0.0:1788460118.216369:0:6536:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bcec2c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+21:13170:x1875336003436416:12345-192.168.206.5@tcp:35:umount.0 Request processed in 303us (491us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1788460118.216378:0:6536:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 68 00000100:00100000:1.0:1788460118.224605:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460118.224690:0:6537:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003436672 00000100:00100000:2.0:1788460118.224700:0:6537:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003436672 00000100:00100000:2.0:1788460118.224753:0:6537:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 69 00000100:00100000:2.0:1788460118.224762:0:6537:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+21:13170:x1875336003436672:12345-192.168.206.5@tcp:35:umount.0 00000100:00100000:2.0:1788460118.225080:0:6537:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+22:13170:x1875336003436672:12345-192.168.206.5@tcp:35:umount.0 Request processed in 317us (483us total) trans 4294967526 rc 0/0 00000100:00100000:2.0:1788460118.225089:0:6537:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 69 00000100:00100000:3.0:1788460118.229247:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460118.229289:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460118.229329:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460118.229429:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003436800 00000100:00100000:0.0:1788460118.229438:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003436800 00000100:00100000:0.0:1788460118.229506:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003437056 00000100:00100000:0.0:1788460118.229510:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003437056 00000100:00100000:0.0:1788460118.229530:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003436928 00000100:00100000:0.0:1788460118.229533:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003436928 00000100:00100000:0.0:1788460118.229551:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 17 00000100:00100000:0.0:1788460118.229559:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf75e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bed032f6-c389-485e-b2f7-e2ea34763c65+16:2396:x1875336003436800:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788460118.229572:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788460118.229590:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4ac395e000/0x5dfa74784542ae44 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 18 type: PLN flags: 0x44801000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a503 expref: 16 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460118.229621:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788460118.229668:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf75e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bed032f6-c389-485e-b2f7-e2ea34763c65+15:2396:x1875336003436800:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 109us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460118.229676:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 17 00000100:00100000:0.0:1788460118.229694:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 18 00000100:00100000:0.0:1788460118.229700:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf75e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bed032f6-c389-485e-b2f7-e2ea34763c65+14:2396:x1875336003437056:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788460118.229708:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788460118.229717:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4bc29d0200/0x5dfa74784542b146 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a5e3 expref: 14 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460118.229726:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788460118.229742:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf75e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bed032f6-c389-485e-b2f7-e2ea34763c65+13:2396:x1875336003437056:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 42us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460118.229748:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 18 00000100:00100000:0.0:1788460118.229762:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 19 00000100:00100000:0.0:1788460118.229768:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc4394a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bed032f6-c389-485e-b2f7-e2ea34763c65+12:2396:x1875336003436928:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788460118.229774:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788460118.229782:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4ac2840200/0x5dfa74784542ae05 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a4c4 expref: 12 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460118.229791:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788460118.229808:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc4394a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bed032f6-c389-485e-b2f7-e2ea34763c65+11:2396:x1875336003436928:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 40us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460118.229814:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 19 00000100:00100000:3.0:1788460118.238557:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460118.238632:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003437184 00000100:00100000:0.0:1788460118.238654:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003437184 00000100:00100000:0.0:1788460118.238732:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 20 00000100:00100000:0.0:1788460118.238741:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc4396680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bed032f6-c389-485e-b2f7-e2ea34763c65+11:2395:x1875336003437184:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788460118.238755:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788460118.238773:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4bfadc7a00/0x5dfa74784542ae4b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x44801000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a50a expref: 11 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460118.238789:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788460118.238841:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc4396680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:bed032f6-c389-485e-b2f7-e2ea34763c65+10:2395:x1875336003437184:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 101us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460118.238848:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 20 00000100:00100000:1.0:1788460118.242858:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460118.243090:0:8450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003437312 00000100:00100000:3.0:1788460118.243100:0:8450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003437312 00000100:00100000:3.0:1788460118.243167:0:8450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 80 00000100:00100000:3.0:1788460118.243177:0:8450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2392:x1875336003437312:12345-192.168.206.5@tcp:9:umount.0 00000020:00000080:3.0:1788460118.243206:0:8450:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5dfa74784542b211 00000100:00080000:3.0:1788460118.243216:0:8450:0:(import.c:65:import_set_state_nolock()) ffff8c4ac41f0800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788460118.243305:0:8450:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:3.0:1788460118.243461:0:8450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+2:2392:x1875336003437312:12345-192.168.206.5@tcp:9:umount.0 Request processed in 285us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460118.243469:0:8450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 80 00000100:00080000:1.0:1788460118.244079:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788460118.247724:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460118.251766:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460118.251987:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003437696 00000100:00100000:1.0:1788460118.251996:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003437696 00000100:00100000:1.0:1788460118.252057:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 81 00000100:00080000:2.0:1788460118.252065:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788460118.252067:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc4395880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+7:2392:x1875336003437696:12345-192.168.206.5@tcp:9:umount.0 00000020:00000080:1.0:1788460118.252094:0:8449:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5dfa74784542b487 00000020:00010000:1.0:1788460118.252102:0:8449:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8c4ac40a6800: total 0 00000100:00080000:1.0:1788460118.252106:0:8449:0:(import.c:65:import_set_state_nolock()) ffff8c4ac40a6000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788460118.252148:0:8449:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000020:00010000:0.0:1788460118.252153:0:6521:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8c4ac40a6800: total 0 00010000:00010000:0.0:1788460118.252193:0:6521:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8c4ac40a6800, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1788460118.252240:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd4e6ef7/0x5dfa74784542b83f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a7cd expref: 5 pid: 8448 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460118.252268:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000002813271/0x5dfa74784542bf0e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a9b0 expref: 4 pid: 8450 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460118.252282:0:6521:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8c4ac40a6800, canceled 2 locks, left on hash table 0. 00000100:00100000:1.0:1788460118.252290:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc4395880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+3:2392:x1875336003437696:12345-192.168.206.5@tcp:9:umount.0 Request processed in 224us (532us total) trans 0 rc 0/0 00010000:00010000:0.0:1788460118.252294:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460118.252296:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460118.252297:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788460118.252298:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 81 00000100:00100000:2.0:1788460118.270393:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460118.271672:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003438720 00000100:00100000:0.0:1788460118.271686:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003438720 00000100:00100000:0.0:1788460118.271755:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 258 00000100:00100000:0.0:1788460118.271767:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac43a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+22:2392:x1875336003438720:12345-192.168.206.5@tcp:39:umount.0 00000020:00000080:0.0:1788460118.271812:0:7760:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5dfa74784542ae13 00000020:00010000:0.0:1788460118.271831:0:7760:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8c4ac35cc800: total 0 00000100:00080000:0.0:1788460118.271835:0:7760:0:(import.c:65:import_set_state_nolock()) ffff8c4ac35ce800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788460118.272062:0:7760:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:0.0:1788460118.272213:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac43a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+21:2392:x1875336003438720:12345-192.168.206.5@tcp:39:umount.0 Request processed in 448us (1828us total) trans 4294967527 rc 0/0 00000100:00100000:0.0:1788460118.272222:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 258 00000020:00010000:2.0:1788460118.272466:0:9536:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8c4ac35cc800: total 0 00010000:00010000:2.0:1788460118.272539:0:9536:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8c4ac35cc800, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1788460118.272571:0:9536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8c4bc5dc1100) 00010000:00010000:2.0:1788460118.272575:0:9536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788460118.272589:0:9536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d1200/0x5dfa74784542b170 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a5f1 expref: 20 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460118.272615:0:9536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8c4bef200e00) 00010000:00010000:2.0:1788460118.272618:0:9536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788460118.272623:0:9536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc29d3000/0x5dfa74784542becf lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a99b expref: 19 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460118.272637:0:9536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8c4bc5dc1500) 00010000:00010000:2.0:1788460118.272639:0:9536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788460118.272643:0:9536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208c00/0x5dfa74784542bbb1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a8c9 expref: 18 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460118.272657:0:9536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4bfa9fec00) 00010000:00010000:2.0:1788460118.272659:0:9536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788460118.272663:0:9536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6800/0x5dfa74784542b8a8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a7e9 expref: 17 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460118.272673:0:9536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8c4bef200e00) 00010000:00010000:2.0:1788460118.272675:0:9536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788460118.272679:0:9536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3676000/0x5dfa74784542bef9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a9a9 expref: 16 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460118.272690:0:9536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8c4bc2ab7100) 00010000:00010000:2.0:1788460118.272692:0:9536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788460118.272696:0:9536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac3677600/0x5dfa74784542b1e7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a60d expref: 15 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460118.272706:0:9536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8c4bfa9fe700) 00010000:00010000:2.0:1788460118.272714:0:9536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788460118.272719:0:9536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5e00/0x5dfa74784542b800 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a7b8 expref: 14 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460118.272733:0:9536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8c4bfa9fe700) 00010000:00010000:2.0:1788460118.272735:0:9536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788460118.272739:0:9536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209400/0x5dfa74784542b82a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a7c6 expref: 13 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460118.272750:0:9536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8c4bc2ab7100) 00010000:00010000:2.0:1788460118.272752:0:9536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788460118.272755:0:9536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc2bd5200/0x5dfa74784542b4e2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a6e6 expref: 12 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460118.272769:0:9536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c4bef1fde00) 00010000:00010000:2.0:1788460118.272771:0:9536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460118.272774:0:9536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6a00/0x5dfa74784542b18c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a5f8 expref: 11 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460118.272786:0:9536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8c4bef200e00) 00010000:00010000:2.0:1788460118.272789:0:9536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788460118.272792:0:9536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209800/0x5dfa74784542bdef lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a963 expref: 10 pid: 13560 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460118.272807:0:9536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8c4bc5dc1500) 00010000:00010000:2.0:1788460118.272809:0:9536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788460118.272812:0:9536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc6400/0x5dfa74784542b8c4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a7f0 expref: 9 pid: 6535 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460118.272841:0:9536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8c4bfa9fe700) 00010000:00010000:2.0:1788460118.272844:0:9536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788460118.272848:0:9536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209e00/0x5dfa74784542b720 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a780 expref: 8 pid: 6533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460118.273109:0:9536:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8c4ac35cc800, canceled 13 locks, left on hash table 0. 00010000:00010000:2.0:1788460118.273128:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460118.273130:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460118.273132:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788460118.307194:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460118.307343:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003438848 00000100:00100000:0.0:1788460118.307355:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003438848 00000100:00100000:0.0:1788460118.307427:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 259 00000100:00100000:0.0:1788460118.307440:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac43a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+5:2392:x1875336003438848:12345-192.168.206.5@tcp:39:umount.0 00000020:00000080:0.0:1788460118.307471:0:6535:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5dfa74784542ae1a 00000100:00080000:0.0:1788460118.307499:0:6535:0:(import.c:65:import_set_state_nolock()) ffff8c4ac35cb800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788460118.307655:0:6535:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1788460118.307808:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac43a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f8767d3e-bfef-4d3d-8163-ef8ae18a3514+3:2392:x1875336003438848:12345-192.168.206.5@tcp:39:umount.0 Request processed in 371us (620us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788460118.307816:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 259 00010000:00010000:3.0:1788460118.308075:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788460118.308312:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788460118.609158:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788460118.609178:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac41baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022361216:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788460118.609256:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460118.609576:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022361216 00000100:00100000:1.0:1788460118.609583:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022361216 00000100:00100000:1.0:1788460118.609659:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788460118.609669:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac43a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1875336022361216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788460118.609697:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788460118.609755:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac43a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1875336022361216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460118.609763:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00080000:2.0:1788460118.609829:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788460118.609908:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac41baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022361216:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788460118.801601:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788460119.122086:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788460119.122118:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc43f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022361344:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788460119.122196:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460119.124466:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc532e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022361472:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788460119.124529:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460119.124662:0:14842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022361472 00000100:00100000:0.0:1788460119.124671:0:14842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022361472 00000100:00100000:0.0:1788460119.124723:0:14842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788460119.124733:0:14842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac43a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022361472:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788460119.124767:0:14842:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1788460119.124814:0:14842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac43a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022361472:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460119.124836:0:14842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1788460119.125006:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc532e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022361472:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788460119.130333:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022361344 00000100:00100000:3.0:1788460119.130346:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022361344 00000100:00100000:3.0:1788460119.130415:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788460119.130424:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac43ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022361344:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788460119.130449:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788460119.130549:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac43ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022361344:12345-0@lo:13:osp-pre-0-1.0 Request processed in 125us (8351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460119.130572:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788460119.130583:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc43f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022361344:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788460119.130890:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788460119.825243:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788460120.146846:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788460120.146868:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac41b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022361600:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788460120.146932:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460120.147229:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022361600 00000100:00100000:3.0:1788460120.147237:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022361600 00000100:00100000:3.0:1788460120.147286:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1788460120.147295:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac43a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1875336022361600:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788460120.147327:0:6538:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446453248 avail 1300213760 00000100:00100000:3.0:1788460120.147380:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac43a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1875336022361600:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460120.147387:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788460120.147518:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac41b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022361600:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788460120.262006:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460120.262050:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460120.262081:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460120.262116:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460120.262207:0:9538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003439104 00000100:00100000:0.0:1788460120.262217:0:9538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003439104 00000100:00100000:0.0:1788460120.262274:0:9538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003439232 00000100:00100000:0.0:1788460120.262278:0:9538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003439232 00000100:00100000:0.0:1788460120.262291:0:9538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003438976 00000100:00100000:0.0:1788460120.262293:0:9538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003438976 00000100:00100000:0.0:1788460120.262303:0:9538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003439360 00000100:00100000:0.0:1788460120.262306:0:9538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003439360 00000100:00100000:0.0:1788460120.262322:0:9538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 21 00000100:00100000:0.0:1788460120.262330:0:9538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf2ffa450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bed032f6-c389-485e-b2f7-e2ea34763c65+13:2396:x1875336003439104:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788460120.262356:0:9538:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788460120.262375:0:9538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4bef208600/0x5dfa74784542af4e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a550 expref: 13 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460120.262391:0:9538:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788460120.262437:0:9538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf2ffa450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bed032f6-c389-485e-b2f7-e2ea34763c65+12:2396:x1875336003439104:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 108us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460120.262444:0:9538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 21 00000100:00100000:0.0:1788460120.262494:0:9538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 22 00000100:00100000:0.0:1788460120.262502:0:9538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc43f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bed032f6-c389-485e-b2f7-e2ea34763c65+11:2396:x1875336003439232:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788460120.262509:0:9538:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788460120.262517:0:9538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4bef208a00/0x5dfa74784542af40 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x44801000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a518 expref: 11 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460120.262557:0:9538:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788460120.262588:0:9538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc43f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bed032f6-c389-485e-b2f7-e2ea34763c65+10:2396:x1875336003439232:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 86us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460120.262594:0:9538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 22 00000100:00100000:0.0:1788460120.262608:0:9538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 23 00000100:00100000:0.0:1788460120.262614:0:9538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc43f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bed032f6-c389-485e-b2f7-e2ea34763c65+9:2394:x1875336003438976:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788460120.262621:0:9538:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788460120.262629:0:9538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4ac3677400/0x5dfa74784542af47 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x44801000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a51f expref: 9 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460120.262637:0:9538:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788460120.262653:0:9538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc43f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bed032f6-c389-485e-b2f7-e2ea34763c65+8:2394:x1875336003438976:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 40us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460120.262659:0:9538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 23 00000100:00100000:0.0:1788460120.262671:0:9538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 24 00000100:00100000:0.0:1788460120.262677:0:9538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3670e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bed032f6-c389-485e-b2f7-e2ea34763c65+7:2394:x1875336003439360:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788460120.262683:0:9538:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788460120.262690:0:9538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4ac2840600/0x5dfa74784542b13f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a5dc expref: 7 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460120.262711:0:9538:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788460120.262728:0:9538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3670e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bed032f6-c389-485e-b2f7-e2ea34763c65+6:2394:x1875336003439360:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 51us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460120.262733:0:9538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 24 00000100:00100000:1.0:1788460120.270833:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460120.270988:0:6534:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003439616 00000100:00100000:2.0:1788460120.270998:0:6534:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003439616 00000100:00100000:2.0:1788460120.271074:0:6534:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 260 00000100:00100000:2.0:1788460120.271086:0:6534:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a5915a6d-4114-41fb-8d95-33add86e0720+6:2392:x1875336003439616:12345-192.168.206.5@tcp:39:umount.0 00000020:00000080:2.0:1788460120.271123:0:6534:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5dfa74784542af5c 00000020:00010000:2.0:1788460120.271130:0:6534:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8c4ac3ae6000: total 0 00000100:00080000:2.0:1788460120.271134:0:6534:0:(import.c:65:import_set_state_nolock()) ffff8c4ac3ae6800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788460120.271166:0:6534:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000020:00010000:3.0:1788460120.271187:0:9536:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8c4ac3ae6000: total 0 00010000:00010000:3.0:1788460120.271242:0:9536:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8c4ac3ae6000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788460120.271282:0:9536:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4bfa9fec00) 00010000:00010000:3.0:1788460120.271286:0:9536:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788460120.271305:0:9536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bfadc7200/0x5dfa74784542bf1c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a9b7 expref: 5 pid: 7760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460120.271323:0:6534:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a5915a6d-4114-41fb-8d95-33add86e0720+4:2392:x1875336003439616:12345-192.168.206.5@tcp:39:umount.0 Request processed in 239us (497us total) trans 4294967528 rc 0/0 00010000:00010000:3.0:1788460120.271332:0:9536:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8c4ac3ae6000, canceled 1 locks, left on hash table 0. 00000100:00100000:2.0:1788460120.271344:0:6534:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 260 00010000:00010000:3.0:1788460120.271347:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460120.271351:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460120.271353:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788460120.271748:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788460120.293519:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460120.293873:0:6533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003439744 00000100:00100000:1.0:1788460120.293883:0:6533:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003439744 00000100:00100000:1.0:1788460120.294133:0:6533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 261 00000100:00100000:1.0:1788460120.294143:0:6533:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc532df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a5915a6d-4114-41fb-8d95-33add86e0720+5:2392:x1875336003439744:12345-192.168.206.5@tcp:39:umount.0 00000020:00000080:1.0:1788460120.294180:0:6533:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5dfa74784542af63 00000100:00080000:1.0:1788460120.294190:0:6533:0:(import.c:65:import_set_state_nolock()) ffff8c4ac3ae4800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788460120.294260:0:6533:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1788460120.294424:0:6533:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc532df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a5915a6d-4114-41fb-8d95-33add86e0720+3:2392:x1875336003439744:12345-192.168.206.5@tcp:39:umount.0 Request processed in 281us (912us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788460120.294432:0:6533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 261 00000100:00080000:2.0:1788460120.294714:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1788460120.294832:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460120.341126:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460120.342679:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003439872 00000100:00100000:1.0:1788460120.342692:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003439872 00000100:00100000:1.0:1788460120.342810:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 437 00000100:00100000:1.0:1788460120.342821:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf363f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bed032f6-c389-485e-b2f7-e2ea34763c65+6:2392:x1875336003439872:12345-192.168.206.5@tcp:251:umount.0 00000020:00000080:1.0:1788460120.342865:0:6525:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5dfa74784542adf0 00000100:00080000:1.0:1788460120.342874:0:6525:0:(import.c:65:import_set_state_nolock()) ffff8c4ac35df800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788460120.342979:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf363f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bed032f6-c389-485e-b2f7-e2ea34763c65+1:2392:x1875336003439872:12345-192.168.206.5@tcp:251:umount.0 Request processed in 159us (1859us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460120.342986:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 437 00000020:00000080:1.0:1788460120.342995:0:6525:0:(genops.c:885:class_export_put()) final put ffff8c4ac35de800/bed032f6-c389-485e-b2f7-e2ea34763c65 00000020:00000080:2.0:1788460120.343177:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c4ac35de800/bed032f6-c389-485e-b2f7-e2ea34763c65 for MGS 00000020:00000080:2.0:1788460120.343210:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c4ac35df800 for MGS 00010000:00010000:0.0:1788460120.346392:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788460120.657147:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788460120.657168:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac41b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022361728:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788460120.657227:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460120.657682:0:14841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022361728 00000100:00100000:3.0:1788460120.657690:0:14841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022361728 00000100:00100000:0.0:1788460120.657706:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc532ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3660:1875336022361984:0@lo:400:kworker.0 00000100:00100000:0.0:1788460120.657740:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460120.657762:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc532f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3660:1875336022362496:0@lo:400:kworker.0 00000100:00100000:3.0:1788460120.657776:0:14841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788460120.657782:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460120.657789:0:14841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1875336022361728:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788460120.657804:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc532ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3660:1875336022363008:0@lo:400:kworker.0 00002000:00000024:3.0:1788460120.657821:0:14841:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788460120.657827:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460120.657850:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788460120.657856:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc532fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0cf73fe6-82e2-434e-b670-631647721b2c:3660:1875336022361856:0@lo:400:kworker.0 00000100:00100000:3.0:1788460120.657876:0:14841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3661:x1875336022361728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460120.657885:0:14841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788460120.657890:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460120.657914:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc532d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3660:1875336022362368:0@lo:400:kworker.0 00000100:00100000:3.0:1788460120.657934:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022361984 00000100:00100000:0.0:1788460120.657940:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460120.657959:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022361984 00000100:00100000:0.0:1788460120.657981:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc532ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3660:1875336022362880:0@lo:400:kworker.0 00000100:00100000:3.0:1788460120.657990:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022362496 00000100:00100000:3.0:1788460120.657995:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022362496 00000100:00100000:0.0:1788460120.658008:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460120.658014:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022363008 00000100:00100000:3.0:1788460120.658019:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022363008 00000100:00100000:0.0:1788460120.658036:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022362368 00000100:00100000:3.0:1788460120.658038:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022362880 00000100:00100000:0.0:1788460120.658042:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022362368 00000100:00100000:3.0:1788460120.658043:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022362880 00000100:00100000:3.0:1788460120.658071:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:0.0:1788460120.658079:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:3.0:1788460120.658081:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc43fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1875336022361984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460120.658092:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf75e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1875336022362496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460120.658132:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc43fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1875336022361984:12345-0@lo:400:kworker.0 Request processed in 53us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460120.658140:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf75e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1875336022362496:12345-0@lo:400:kworker.0 Request processed in 51us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460120.658145:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:0.0:1788460120.658153:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:3.0:1788460120.658167:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:0.0:1788460120.658173:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:3.0:1788460120.658179:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf75e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1875336022363008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460120.658185:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc4394a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1875336022362880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460120.658221:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf75e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1875336022363008:12345-0@lo:400:kworker.0 Request processed in 46us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460120.658227:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc4394a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1875336022362880:12345-0@lo:400:kworker.0 Request processed in 44us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460120.658232:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:0.0:1788460120.658243:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:3.0:1788460120.658253:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:3.0:1788460120.658263:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc4395c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1875336022362368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460120.658300:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc4395c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1875336022362368:12345-0@lo:400:kworker.0 Request processed in 40us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460120.658305:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc532ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3660:1875336022362880:0@lo:400:kworker.0 00000100:00100000:3.0:1788460120.658320:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:0.0:1788460120.658322:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc532ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3660:1875336022361984:0@lo:400:kworker.0 00010000:00080000:0.0:1788460120.658338:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bc532f100 x1875336022362496/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460136 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460120.658348:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc532f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3660:1875336022362496:0@lo:400:kworker.0 00010000:00080000:0.0:1788460120.658357:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bc532ca80 x1875336022363008/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460136 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460120.658365:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc532ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3660:1875336022363008:0@lo:400:kworker.0 00000100:00100000:0.0:1788460120.658397:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc532d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3660:1875336022362368:0@lo:400:kworker.0 00000100:00080000:2.0:1788460120.658586:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788460120.658590:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788460120.658592:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788460120.658614:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc532d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3662:1875336022362240:0@lo:400:kworker.0 00000100:00100000:2.0:1788460120.658639:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460120.658670:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc532f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022362752:0@lo:400:kworker.0 00000100:00100000:2.0:1788460120.658688:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460120.658707:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac43aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022363264:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788460120.658724:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460120.658741:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788460120.658746:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc532c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022362112:0@lo:400:kworker.0 00000100:00100000:2.0:1788460120.658766:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460120.658774:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022362752 00000100:00100000:3.0:1788460120.658780:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022362752 00000100:00100000:2.0:1788460120.658791:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc532c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022362624:0@lo:400:kworker.0 00000100:00100000:2.0:1788460120.658816:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460120.658826:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022362624 00000100:00100000:3.0:1788460120.658830:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022362624 00000100:00100000:2.0:1788460120.658834:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc532e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022363136:0@lo:400:kworker.0 00000100:00100000:2.0:1788460120.658854:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460120.658858:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788460120.658869:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac43aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1875336022362752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460120.658878:0:8451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022363264 00000100:00100000:2.0:1788460120.658882:0:8451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022363264 00000100:00100000:3.0:1788460120.658917:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac43aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1875336022362752:12345-0@lo:400:kworker.0 Request processed in 51us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460120.658921:0:8451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788460120.658929:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788460120.658935:0:8451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac43ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022363264:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788460120.658964:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022363136 00000100:00100000:3.0:1788460120.658969:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022363136 00002000:00000024:2.0:1788460120.658975:0:8451:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788460120.658987:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788460120.658994:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac43aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022362624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460120.659011:0:8451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac43ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3662:x1875336022363264:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460120.659018:0:8451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788460120.659035:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac43aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022362624:12345-0@lo:400:kworker.0 Request processed in 39us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460120.659043:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788460120.659044:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022362112 00000100:00100000:2.0:1788460120.659049:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022362112 00000100:00100000:3.0:1788460120.659060:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788460120.659069:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac43a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022363136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460120.659081:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1788460120.659091:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac43abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022362112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460120.659101:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac43a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022363136:12345-0@lo:400:kworker.0 Request processed in 33us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460120.659108:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788460120.659131:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac43abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022362112:12345-0@lo:400:kworker.0 Request processed in 42us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460120.659139:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00080000:3.0:1788460120.659149:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788460120.659153:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788460120.659178:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc532c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022362112:0@lo:400:kworker.0 00000100:00100000:3.0:1788460120.659188:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc532c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022362624:0@lo:400:kworker.0 00000100:00100000:3.0:1788460120.659205:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc532e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022363136:0@lo:400:kworker.0 00000100:00100000:3.0:1788460120.659214:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc532f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022362752:0@lo:400:kworker.0 00000100:00100000:3.0:1788460120.659226:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac43aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022363264:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788460120.659268:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022362240 00000100:00100000:0.0:1788460120.659273:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022362240 00000100:00100000:0.0:1788460120.659308:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:0.0:1788460120.659315:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac43a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1875336022362240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460120.659366:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac43a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1875336022362240:12345-0@lo:400:kworker.0 Request processed in 51us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460120.659372:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:3.0:1788460120.659447:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc532d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3662:1875336022362240:0@lo:400:kworker.0 00000100:00100000:1.0:1788460120.659522:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022361856 00000100:00100000:1.0:1788460120.659527:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022361856 00000100:00100000:1.0:1788460120.659563:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 438 00000100:00100000:1.0:1788460120.659570:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf363d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+29:3660:x1875336022361856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460120.659620:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf363d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0cf73fe6-82e2-434e-b670-631647721b2c+29:3660:x1875336022361856:12345-0@lo:400:kworker.0 Request processed in 50us (1733us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460120.659625:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 438 00000100:00100000:1.0:1788460120.659681:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac41b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022361728:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788460120.659988:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc532fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0cf73fe6-82e2-434e-b670-631647721b2c:3660:1875336022361856:0@lo:400:kworker.0 00010000:00010000:0.0:1788460120.851867:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788460121.046326:0:13815:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1788460121.489557:0:13811:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788460121.489567:0:13811:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788460121.489677:0:13811:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1788460121.489683:0:13811:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788460121.875097:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788460121.999835:0:15222:0:(tgt_mount.c:2326:server_umount_begin()) umount -f 00000020:01000004:1.0:1788460122.013085:0:15222:0:(tgt_mount.c:2182:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1788460122.013140:0:15222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac395f200/0x5dfa74784542aed0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542aed7 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460122.013156:0:15222:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac395f200/0x5dfa74784542aed0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542aed7 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460122.013164:0:15222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac395f200/0x5dfa74784542aed0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x11000400000000 nid: local remote: 0x5dfa74784542aed7 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460122.013171:0:15222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mgc192.168.206.105@tcp lock: ffff8c4ac395f200/0x5dfa74784542aed0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x11000400000000 nid: local remote: 0x5dfa74784542aed7 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460122.013196:0:15222:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788460122.013202:0:15222:0:(mgc_request.c:651:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788460122.013232:0:15222:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788460122.013237:0:15222:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788460122.013242:0:15222:0:(pinger.c:405:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788460122.013266:0:15222:0:(import.c:65:import_set_state_nolock()) ffff8c4bfa02b000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1788460122.013307:0:9537:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788460122.013314:0:9537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: ffff8c4ac395f200/0x5dfa74784542aed0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x1000400000000 nid: local remote: 0x5dfa74784542aed7 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460122.013322:0:9537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac395f200 already unused, calling callback (ffffffffc125ae00) 10000000:00010000:1.0:1788460122.013326:0:9537:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: ffff8c4ac395f200/0x5dfa74784542aed0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x1000400000000 nid: local remote: 0x5dfa74784542aed7 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460122.013352:0:9537:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: ffff8c4ac395f200/0x5dfa74784542aed0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x1008400000000 nid: local remote: 0x5dfa74784542aed7 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788460122.013359:0:9537:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: ffff8c4ac395f200/0x5dfa74784542aed0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x1009400000000 nid: local remote: 0x5dfa74784542aed7 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788460122.013365:0:9537:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788460122.013368:0:9537:0:(mgc_request.c:1242:mgc_blocking_ast()) log lustre-client: stale lock, won't requeue 10000000:01000000:1.0:1788460122.013485:0:9537:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788460122.013528:0:9537:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.206.105@tcp lock: ffff8c4ac395f200/0x5dfa74784542aed0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x5809400000020 nid: local remote: 0x5dfa74784542aed7 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460122.013536:0:9537:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788460122.013560:0:9537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: ffff8c4ac395f200/0x5dfa74784542aed0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x5809400000020 nid: local remote: 0x5dfa74784542aed7 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460122.013567:0:9537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: ffff8c4ac395f200/0x5dfa74784542aed0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x5809400000020 nid: local remote: 0x5dfa74784542aed7 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460122.013579:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460122.013581:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460122.013583:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788460122.013598:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac41b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0cf73fe6-82e2-434e-b670-631647721b2c:3659:1875336022363520:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788460122.013750:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460122.013896:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac41b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3658:1875336022363392:0@lo:39:umount.0 00000100:00100000:1.0:1788460122.013927:0:3658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460122.013980:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022363392 00000100:00100000:3.0:1788460122.013987:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022363392 00000100:00100000:3.0:1788460122.014038:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1788460122.014048:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac1e60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1875336022363392:12345-0@lo:39:umount.0 00000100:00100000:1.0:1788460122.014063:0:9538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022363520 00000100:00100000:1.0:1788460122.014068:0:9538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022363520 00000020:00000080:3.0:1788460122.014072:0:6535:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5dfa74784542a997 00000100:00080000:3.0:1788460122.014081:0:6535:0:(import.c:65:import_set_state_nolock()) ffff8c4bfa1bd000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788460122.014113:0:9538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788460122.014121:0:9538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0cf73fe6-82e2-434e-b670-631647721b2c+29:3659:x1875336022363520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788460122.014132:0:9538:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788460122.014149:0:9538:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4ac2841000/0x5dfa74784542aed7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5dfa74784542aed0 expref: 29 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460122.014150:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac1e60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3658:x1875336022363392:12345-0@lo:39:umount.0 Request processed in 102us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460122.014167:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00010000:00010000:1.0:1788460122.014172:0:9538:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000020:00000080:3.0:1788460122.014180:0:6535:0:(genops.c:885:class_export_put()) final put ffff8c4bfa1ba000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:3.0:1788460122.014203:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788460122.014208:0:9538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0cf73fe6-82e2-434e-b670-631647721b2c+28:3659:x1875336022363520:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460122.014215:0:9538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1788460122.014232:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c4bfa02b000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788460122.014245:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac41b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3658:1875336022363392:0@lo:39:umount.0 00000100:00100000:1.0:1788460122.014250:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac41b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0cf73fe6-82e2-434e-b670-631647721b2c:3659:1875336022363520:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1788460122.014274:0:15222:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788460122.014277:0:15222:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788460122.014280:0:15222:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788460122.015074:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c4bfa1ba000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788460122.015120:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c4bfa1bd000 for lustre-MDT0000 00010000:00010000:1.0:1788460122.017068:0:15222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac2841a00/0x5dfa74784542aede lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542aee5 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460122.017085:0:15222:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac2841a00/0x5dfa74784542aede lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542aee5 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460122.017093:0:15222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac2841a00/0x5dfa74784542aede lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x11000400000000 nid: local remote: 0x5dfa74784542aee5 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460122.017100:0:15222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mgc192.168.206.105@tcp lock: ffff8c4ac2841a00/0x5dfa74784542aede lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x11000400000000 nid: local remote: 0x5dfa74784542aee5 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460122.017173:0:15222:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788460122.017180:0:15222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac395e200/0x5dfa74784542adaa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542adb1 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460122.017205:0:15222:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac395e200/0x5dfa74784542adaa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542adb1 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460122.017211:0:15222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac395e200/0x5dfa74784542adaa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5dfa74784542adb1 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460122.017217:0:15222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mgc192.168.206.105@tcp lock: ffff8c4ac395e200/0x5dfa74784542adaa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5dfa74784542adb1 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460122.018471:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788460122.018481:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: ffff8c4ac2841a00/0x5dfa74784542aede lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1000400000000 nid: local remote: 0x5dfa74784542aee5 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460122.018491:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac2841a00 already unused, calling callback (ffffffffc125ae00) 10000000:00010000:2.0:1788460122.018494:0:6521:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: ffff8c4ac2841a00/0x5dfa74784542aede lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1000400000000 nid: local remote: 0x5dfa74784542aee5 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460122.018512:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: ffff8c4ac2841a00/0x5dfa74784542aede lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1008400000000 nid: local remote: 0x5dfa74784542aee5 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788460122.018520:0:6521:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: ffff8c4ac2841a00/0x5dfa74784542aede lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1009400000000 nid: local remote: 0x5dfa74784542aee5 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788460122.018525:0:6521:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788460122.018528:0:6521:0:(mgc_request.c:1242:mgc_blocking_ast()) log lustre-MDT0000: stale lock, won't requeue 00010000:00010000:2.0:1788460122.018561:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.206.105@tcp lock: ffff8c4ac2841a00/0x5dfa74784542aede lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x5809400000020 nid: local remote: 0x5dfa74784542aee5 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460122.018568:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788460122.018599:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: ffff8c4ac2841a00/0x5dfa74784542aede lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x5809400000020 nid: local remote: 0x5dfa74784542aee5 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460122.018607:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: ffff8c4ac2841a00/0x5dfa74784542aede lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x5809400000020 nid: local remote: 0x5dfa74784542aee5 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460122.018621:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788460122.018624:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: ffff8c4ac395e200/0x5dfa74784542adaa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5dfa74784542adb1 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460122.018630:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac395e200 already unused, calling callback (ffffffffc125ae00) 10000000:00010000:2.0:1788460122.018633:0:6521:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: ffff8c4ac395e200/0x5dfa74784542adaa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5dfa74784542adb1 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460122.018640:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: ffff8c4ac395e200/0x5dfa74784542adaa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x5dfa74784542adb1 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788460122.018657:0:6521:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: ffff8c4ac395e200/0x5dfa74784542adaa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x5dfa74784542adb1 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788460122.018669:0:6521:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1788460122.018671:0:6521:0:(mgc_request.c:1249:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:2.0:1788460122.018685:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.206.105@tcp lock: ffff8c4ac395e200/0x5dfa74784542adaa lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5dfa74784542adb1 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460122.018691:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788460122.018708:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: ffff8c4ac395e200/0x5dfa74784542adaa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5dfa74784542adb1 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460122.018715:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460122.018716:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460122.018718:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788460122.018725:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788460122.018742:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac43a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0cf73fe6-82e2-434e-b670-631647721b2c:3659:1875336022363648:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788460122.018811:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460122.018859:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac43aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0cf73fe6-82e2-434e-b670-631647721b2c:3661:1875336022363776:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788460122.018882:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460122.018913:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022363648 00000100:00100000:2.0:1788460122.018919:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022363648 00000100:00100000:2.0:1788460122.018988:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022363776 00000100:00100000:2.0:1788460122.018992:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022363776 00000100:00100000:2.0:1788460122.019015:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788460122.019022:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac43aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0cf73fe6-82e2-434e-b670-631647721b2c+29:3659:x1875336022363648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788460122.019033:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460122.019045:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4ac395e400/0x5dfa74784542aee5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5dfa74784542aede expref: 29 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460122.019062:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788460122.019081:0:15222:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788460122.019089:0:15222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: ffff8c4ac395e200/0x5dfa74784542adaa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5dfa74784542adb1 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460122.019103:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac43aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0cf73fe6-82e2-434e-b670-631647721b2c+28:3659:x1875336022363648:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (290us total) trans 0 rc 0/0 10000000:01000000:1.0:1788460122.019103:0:15222:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00000100:00100000:2.0:1788460122.019113:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788460122.019135:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00010000:00010000:1.0:1788460122.019141:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788460122.019142:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac42f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0cf73fe6-82e2-434e-b670-631647721b2c+27:3661:x1875336022363776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788460122.019150:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788460122.019154:0:15222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac3676600/0x5dfa74784542b131 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542b138 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460122.019160:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4ac2840c00/0x5dfa74784542adb1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5dfa74784542adaa expref: 27 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460122.019168:0:15222:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac3676600/0x5dfa74784542b131 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542b138 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460122.019173:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788460122.019180:0:15222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac3676600/0x5dfa74784542b131 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5dfa74784542b138 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460122.019188:0:15222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mgc192.168.206.105@tcp lock: ffff8c4ac3676600/0x5dfa74784542b131 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5dfa74784542b138 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460122.019199:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac42f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0cf73fe6-82e2-434e-b670-631647721b2c+26:3661:x1875336022363776:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (315us total) trans 0 rc 0/0 00010000:00010000:1.0:1788460122.019204:0:15222:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788460122.019207:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788460122.019245:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac43a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0cf73fe6-82e2-434e-b670-631647721b2c:3659:1875336022363648:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788460122.019269:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac43aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0cf73fe6-82e2-434e-b670-631647721b2c:3661:1875336022363776:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788460122.019284:0:9537:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788460122.019294:0:9537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: ffff8c4ac3676600/0x5dfa74784542b131 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5dfa74784542b138 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460122.019302:0:9537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac3676600 already unused, calling callback (ffffffffc125ae00) 10000000:00010000:1.0:1788460122.019305:0:9537:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: ffff8c4ac3676600/0x5dfa74784542b131 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5dfa74784542b138 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460122.019312:0:9537:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: ffff8c4ac3676600/0x5dfa74784542b131 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x5dfa74784542b138 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788460122.019319:0:9537:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: ffff8c4ac3676600/0x5dfa74784542b131 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x5dfa74784542b138 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788460122.019324:0:9537:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788460122.019326:0:9537:0:(mgc_request.c:1242:mgc_blocking_ast()) log params: stale lock, won't requeue 10000000:01000000:1.0:1788460122.019328:0:9537:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788460122.019360:0:9537:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.206.105@tcp lock: ffff8c4ac3676600/0x5dfa74784542b131 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5dfa74784542b138 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460122.019367:0:9537:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788460122.019388:0:9537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: ffff8c4ac3676600/0x5dfa74784542b131 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5dfa74784542b138 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460122.019395:0:9537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: ffff8c4ac3676600/0x5dfa74784542b131 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5dfa74784542b138 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460122.019405:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460122.019407:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460122.019408:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460122.019419:0:15222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0600/0x5dfa74784542a8f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542a8fd expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460122.019438:0:15222:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0600/0x5dfa74784542a8f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542a8fd expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460122.019444:0:15222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0600/0x5dfa74784542a8f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5dfa74784542a8fd expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460122.019451:0:15222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0600/0x5dfa74784542a8f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5dfa74784542a8fd expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460122.019582:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0cf73fe6-82e2-434e-b670-631647721b2c:3662:1875336022363904:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788460122.019610:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460122.019641:0:9549:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022363904 00000100:00100000:2.0:1788460122.019730:0:9549:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022363904 00000100:00100000:2.0:1788460122.019760:0:9549:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788460122.019767:0:9549:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf2ff9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0cf73fe6-82e2-434e-b670-631647721b2c+26:3662:x1875336022363904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788460122.019829:0:9549:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460122.019842:0:9549:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4ac2841e00/0x5dfa74784542b138 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5dfa74784542b131 expref: 26 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460122.019852:0:9549:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788460122.019885:0:9549:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf2ff9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0cf73fe6-82e2-434e-b670-631647721b2c+25:3662:x1875336022363904:12345-0@lo:103:ldlm_bl.0 Request processed in 119us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460122.019892:0:9549:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788460122.019935:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0cf73fe6-82e2-434e-b670-631647721b2c:3662:1875336022363904:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788460122.020364:0:15222:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788460122.020371:0:15222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac395f000/0x5dfa74784542aeec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542aef3 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460122.020377:0:15222:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac395f000/0x5dfa74784542aeec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542aef3 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460122.020384:0:15222:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac395f000/0x5dfa74784542aeec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x11000400000000 nid: local remote: 0x5dfa74784542aef3 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460122.020389:0:15222:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mgc192.168.206.105@tcp lock: ffff8c4ac395f000/0x5dfa74784542aeec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x11000400000000 nid: local remote: 0x5dfa74784542aef3 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460122.020405:0:15222:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1788460122.020408:0:15222:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1788460122.020423:0:15222:0:(mgc_request.c:651:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1788460122.020446:0:15222:0:(tgt_mount.c:2232:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1788460122.020450:0:15222:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00010000:00010000:0.0:1788460122.020532:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788460122.020539:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0600/0x5dfa74784542a8f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5dfa74784542a8fd expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460122.020558:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc14f0600 already unused, calling callback (ffffffffc125ae00) 10000000:00010000:0.0:1788460122.020561:0:6522:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0600/0x5dfa74784542a8f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5dfa74784542a8fd expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460122.020569:0:6522:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0600/0x5dfa74784542a8f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5dfa74784542a8fd expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788460122.020575:0:6522:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0600/0x5dfa74784542a8f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5dfa74784542a8fd expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788460122.020585:0:6522:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1788460122.020588:0:6522:0:(mgc_request.c:1242:mgc_blocking_ast()) log lustre-barrier: stale lock, won't requeue 10000000:01000000:0.0:1788460122.020591:0:6522:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1788460122.020600:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788460122.020624:0:6522:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0600/0x5dfa74784542a8f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5dfa74784542a8fd expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460122.020632:0:6522:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788460122.020684:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: ffff8c4ac395f000/0x5dfa74784542aeec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1000400000000 nid: local remote: 0x5dfa74784542aef3 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460122.020693:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac395f000 already unused, calling callback (ffffffffc125ae00) 10000000:00010000:2.0:1788460122.020697:0:6521:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: ffff8c4ac395f000/0x5dfa74784542aeec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1000400000000 nid: local remote: 0x5dfa74784542aef3 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460122.020705:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: ffff8c4ac395f000/0x5dfa74784542aeec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1008400000000 nid: local remote: 0x5dfa74784542aef3 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788460122.020711:0:6521:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: ffff8c4ac395f000/0x5dfa74784542aeec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1009400000000 nid: local remote: 0x5dfa74784542aef3 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788460122.020717:0:6521:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788460122.020719:0:6521:0:(mgc_request.c:1242:mgc_blocking_ast()) log lustre-sptlrpc: stale lock, won't requeue 10000000:01000000:2.0:1788460122.020721:0:6521:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1788460122.020748:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.206.105@tcp lock: ffff8c4ac395f000/0x5dfa74784542aeec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5809400000020 nid: local remote: 0x5dfa74784542aef3 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460122.020754:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00000080:1.0:1788460122.020797:0:15222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788460122.020804:0:15222:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:1.0:1788460122.020815:0:15222:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8c4ac2a19800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788460122.020822:0:15222:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8c4bf76af000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788460122.020826:0:15222:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8c4bfa3cb800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788460122.020830:0:15222:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8c4bef371800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:1.0:1788460122.020836:0:15222:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff8c4ac3ae6000 a5915a6d-4114-41fb-8d95-33add86e0720 192.168.206.5@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000100:00100000:3.0:1788460122.020840:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4396680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0cf73fe6-82e2-434e-b670-631647721b2c:3659:1875336022364032:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1788460122.020841:0:15222:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff8c4ac35cc800 f8767d3e-bfef-4d3d-8163-ef8ae18a3514 192.168.206.5@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967522 stale:0 00000020:00080000:1.0:1788460122.020852:0:15222:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff8c4bc4723310) has exports, disconnecting them 00000020:00080000:1.0:1788460122.020856:0:15222:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8c4ac2a19800), last request at 1788460120 00000020:00000080:1.0:1788460122.020861:0:15222:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5dfa74784542acdf 00000100:00080000:1.0:1788460122.020878:0:15222:0:(import.c:65:import_set_state_nolock()) ffff8c4ac2a1c800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788460122.020890:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788460122.020935:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460122.020939:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0600/0x5dfa74784542a8f6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5dfa74784542a8fd expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460122.020969:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0600/0x5dfa74784542a8f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5dfa74784542a8fd expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460122.020994:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460122.020997:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460122.020999:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1788460122.021057:0:15222:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c4ac2a19800): rc 0 00000020:00000080:1.0:1788460122.021060:0:15222:0:(genops.c:885:class_export_put()) final put ffff8c4ac2a19800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1788460122.021077:0:15222:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8c4bf76af000), last request at 1788460120 00000020:00000080:1.0:1788460122.021081:0:15222:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5dfa74784542ab8f 00000100:00080000:1.0:1788460122.021087:0:15222:0:(import.c:65:import_set_state_nolock()) ffff8c4bef375000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788460122.021100:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1788460122.021107:0:15222:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c4bf76af000): rc 0 00000020:00000080:1.0:1788460122.021109:0:15222:0:(genops.c:885:class_export_put()) final put ffff8c4bf76af000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:1.0:1788460122.021113:0:15222:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8c4bfa3cb800), last request at 1788459893 00000020:00000080:1.0:1788460122.021116:0:15222:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5dfa74784542aa7e 00000100:00080000:1.0:1788460122.021120:0:15222:0:(import.c:65:import_set_state_nolock()) ffff8c4bfa3c8000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788460122.021128:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1788460122.021135:0:15222:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c4bfa3cb800): rc 0 00000020:00000080:1.0:1788460122.021136:0:15222:0:(genops.c:885:class_export_put()) final put ffff8c4bfa3cb800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:1.0:1788460122.021140:0:15222:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8c4bef371800), last request at 1788459893 00000020:00000080:1.0:1788460122.021149:0:15222:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5dfa74784542aa3f 00000100:00080000:1.0:1788460122.021153:0:15222:0:(import.c:65:import_set_state_nolock()) ffff8c4bfa3cb000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788460122.021162:0:15222:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000020:00080000:1.0:1788460122.021238:0:15222:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c4bef371800): rc 0 00000004:00000080:1.0:1788460122.021244:0:15222:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffba0a018d3ae0 00000100:00080000:1.0:1788460122.021260:0:15222:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788460122.021263:0:15222:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00010000:00010000:2.0:1788460122.021533:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: ffff8c4ac395f000/0x5dfa74784542aeec lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5809400000020 nid: local remote: 0x5dfa74784542aef3 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460122.021542:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: ffff8c4ac395f000/0x5dfa74784542aeec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5809400000020 nid: local remote: 0x5dfa74784542aef3 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460122.021564:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460122.021565:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460122.021567:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788460122.021579:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac42f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0cf73fe6-82e2-434e-b670-631647721b2c:3660:1875336022364160:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788460122.021625:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460122.021663:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022364032 00000100:00100000:2.0:1788460122.021669:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022364032 00000100:00100000:2.0:1788460122.021700:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022364160 00000100:00100000:2.0:1788460122.021703:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022364160 00000100:00100000:2.0:1788460122.021726:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788460122.021742:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3670700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0cf73fe6-82e2-434e-b670-631647721b2c+26:3659:x1875336022364032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788460122.021754:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460122.021768:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4bc0031200/0x5dfa74784542a8fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5dfa74784542a8f6 expref: 26 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460122.021779:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788460122.021805:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3670700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0cf73fe6-82e2-434e-b670-631647721b2c+25:3659:x1875336022364032:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (916us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460122.021813:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788460122.021834:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788460122.021842:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac42f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0cf73fe6-82e2-434e-b670-631647721b2c+24:3660:x1875336022364160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788460122.021850:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460122.021859:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4bef208e00/0x5dfa74784542aef3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5dfa74784542aeec expref: 24 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460122.021868:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788460122.021900:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac42f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0cf73fe6-82e2-434e-b670-631647721b2c+23:3660:x1875336022364160:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460122.021907:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788460122.021969:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac42f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0cf73fe6-82e2-434e-b670-631647721b2c:3660:1875336022364160:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788460122.022058:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4396680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0cf73fe6-82e2-434e-b670-631647721b2c:3659:1875336022364032:0@lo:103:ldlm_bl.0 00000020:00000080:0.0:1788460122.022091:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c4ac2a19800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000100:00080000:1.0:1788460122.022700:0:15222:0:(pinger.c:405:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788460122.022722:0:15222:0:(import.c:65:import_set_state_nolock()) ffff8c4bf7510800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1788460122.022862:0:15222:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788460122.022866:0:15222:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:1.0:1788460122.022877:0:15222:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788460122.022958:0:15222:0:(pinger.c:405:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788460122.022969:0:15222:0:(import.c:65:import_set_state_nolock()) ffff8c4bff80d000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1788460122.022975:0:15222:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788460122.022976:0:15222:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:1.0:1788460122.022984:0:15222:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788460122.023049:0:15222:0:(pinger.c:405:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788460122.023057:0:15222:0:(import.c:65:import_set_state_nolock()) ffff8c4ac35dd000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1788460122.023081:0:15222:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8c4bc4723310) has no exports 00000100:00100000:3.0:1788460122.023495:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1875336022364288:0@lo:39:umount.0 00000100:00100000:3.0:1788460122.023714:0:3658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460122.023743:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1875336022364416:0@lo:9:umount.0 00000100:00100000:3.0:1788460122.023834:0:3658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460122.023853:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1875336022364544:0@lo:9:umount.0 00000100:00100000:3.0:1788460122.023965:0:3658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460122.023999:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022364416 00000100:00100000:3.0:1788460122.024005:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022364416 00000100:00100000:3.0:1788460122.024045:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022364544 00000100:00100000:3.0:1788460122.024048:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022364544 00000100:00100000:3.0:1788460122.024066:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788460122.024074:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3673b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3658:x1875336022364416:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788460122.024261:0:8448:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5dfa74784542ac53 00000100:00080000:3.0:1788460122.024271:0:8448:0:(import.c:65:import_set_state_nolock()) ffff8c4bff80a000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788460122.024313:0:8448:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:3.0:1788460122.025057:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3673b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3658:x1875336022364416:12345-0@lo:9:umount.0 Request processed in 981us (1219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460122.025066:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788460122.025086:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788460122.025269:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3670380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3658:x1875336022364544:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788460122.025291:0:8448:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5dfa74784542addb 00000100:00080000:3.0:1788460122.025298:0:8448:0:(import.c:65:import_set_state_nolock()) ffff8c4ac3846000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788460122.025437:0:8448:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:3.0:1788460122.025706:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3670380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3658:x1875336022364544:12345-0@lo:9:umount.0 Request processed in 613us (1762us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460122.025714:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:3.0:1788460122.025742:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788460122.025746:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788460122.025760:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460122.025831:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788460122.025928:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c4bff80d000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788460122.025973:0:3658:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788460122.025975:0:3658:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788460122.025979:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1875336022364416:0@lo:9:umount.0 00000100:00080000:3.0:1788460122.025995:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c4ac35dd000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788460122.026004:0:3658:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788460122.026006:0:3658:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788460122.026009:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1875336022364544:0@lo:9:umount.0 00000020:00000080:0.0:1788460122.026468:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c4bf76af000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788460122.026693:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c4bfa3cb800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00010000:00010000:1.0:1788460122.026797:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788460122.026818:0:14842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022364288 00000100:00100000:1.0:1788460122.026825:0:14842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022364288 00000020:00000080:0.0:1788460122.026934:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c4ac2a1c800 for lustre-MDT0000 00000020:00000080:0.0:1788460122.027009:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c4bef375000 for lustre-MDT0000 00000020:00000080:0.0:1788460122.027017:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c4bfa3c8000 for lustre-MDT0000 00000100:00100000:1.0:1788460122.027144:0:14842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1788460122.027154:0:14842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3672680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3658:x1875336022364288:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788460122.027178:0:14842:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5dfa74784542aad9 00000100:00080000:1.0:1788460122.027185:0:14842:0:(import.c:65:import_set_state_nolock()) ffff8c4bef218800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788460122.027216:0:14842:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00010000:00010000:2.0:1788460122.027233:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788460122.027359:0:14842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3672680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3658:x1875336022364288:12345-0@lo:39:umount.0 Request processed in 207us (3644us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788460122.027366:0:14842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00080000:2.0:1788460122.027427:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c4bf7510800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788460122.027434:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1875336022364288:0@lo:39:umount.0 00000020:00080000:2.0:1788460122.033155:0:15222:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8c4bc4723310) has no exports 00000020:00000080:2.0:1788460122.087660:0:15222:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5dfa74784542a951 00000020:00000080:2.0:1788460122.087675:0:15222:0:(genops.c:885:class_export_put()) final put ffff8c4bc4389800/lustre-QMT0000_UUID 00000020:01000000:2.0:1788460122.087693:0:15222:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1788460122.088397:0:15222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788460122.088397:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c4bc4389800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1788460122.088410:0:15222:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788460122.088415:0:15222:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff8c4bcec51988) has no exports 00000020:00000080:1.0:1788460122.088709:0:15222:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5dfa74784542a94a 00000020:00000080:1.0:1788460122.088716:0:15222:0:(genops.c:885:class_export_put()) final put ffff8c4bf6bc3000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788460122.088780:0:15222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788460122.088788:0:15222:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788460122.088791:0:15222:0:(genops.c:885:class_export_put()) final put ffff8c4bede3f800/lustre-QMT0000_UUID 00000020:00000080:1.0:1788460122.088793:0:15222:0:(genops.c:844:class_export_destroy()) destroying export ffff8c4bede3f800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1788460122.088800:0:15222:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:0.0:1788460122.090297:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c4bf6bc3000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:3.0:1788460122.897289:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788460123.733217:0:8443:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788460123.733225:0:8443:0:(genops.c:885:class_export_put()) final put ffff8c4bff80e800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1788460123.733254:0:8443:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f8767d3e-bfef-4d3d-8163-ef8ae18a3514 00000020:00000080:3.0:1788460123.733257:0:8443:0:(genops.c:885:class_export_put()) final put ffff8c4ac40a6800/f8767d3e-bfef-4d3d-8163-ef8ae18a3514 00000020:00000080:0.0:1788460123.734363:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c4bff80e800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1788460123.734589:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c4ac40a6800/f8767d3e-bfef-4d3d-8163-ef8ae18a3514 for lustre-OST0000 00000020:00000080:0.0:1788460123.734610:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c4bff80a000 for lustre-OST0000 00000020:00000080:0.0:1788460123.734615:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c4ac40a6000 for lustre-OST0000 00000001:00100000:3.0:1788460123.740618:0:9527:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788460123.740627:0:9527:0:(genops.c:885:class_export_put()) final put ffff8c4ac3846800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1788460123.740657:0:9527:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f8767d3e-bfef-4d3d-8163-ef8ae18a3514 00000020:00000080:3.0:1788460123.740660:0:9527:0:(genops.c:885:class_export_put()) final put ffff8c4ac41f2000/f8767d3e-bfef-4d3d-8163-ef8ae18a3514 00000001:00100000:2.0:1788460123.740922:0:7465:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1788460123.740935:0:7465:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:2.0:1788460123.740939:0:7465:0:(genops.c:885:class_export_put()) final put ffff8c4bef21f000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1788460123.740972:0:7465:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of a5915a6d-4114-41fb-8d95-33add86e0720 00000001:00080000:2.0:1788460123.740983:0:7465:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:2.0:1788460123.740985:0:7465:0:(genops.c:885:class_export_put()) final put ffff8c4ac3ae2000/a5915a6d-4114-41fb-8d95-33add86e0720 00000001:00100000:2.0:1788460123.740990:0:7465:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of f8767d3e-bfef-4d3d-8163-ef8ae18a3514 00000001:00080000:2.0:1788460123.740994:0:7465:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:2.0:1788460123.740996:0:7465:0:(genops.c:885:class_export_put()) final put ffff8c4ac35ca000/f8767d3e-bfef-4d3d-8163-ef8ae18a3514 00000020:00000080:0.0:1788460123.741649:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c4ac3846800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788460123.741699:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c4ac41f2000/f8767d3e-bfef-4d3d-8163-ef8ae18a3514 for lustre-OST0001 00000020:00000080:0.0:1788460123.741717:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c4bef21f000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:0.0:1788460123.741743:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c4ac3ae2000/a5915a6d-4114-41fb-8d95-33add86e0720 for lustre-MDT0001 00000020:00000080:0.0:1788460123.741771:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c4ac35ca000/f8767d3e-bfef-4d3d-8163-ef8ae18a3514 for lustre-MDT0001 00000020:00000080:0.0:1788460123.741794:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c4ac3846000 for lustre-OST0001 00000020:00000080:0.0:1788460123.741799:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c4ac41f0800 for lustre-OST0001 00000020:00000080:0.0:1788460123.741802:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c4bef218800 for lustre-MDT0001 00000020:00000080:0.0:1788460123.741806:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c4ac3ae4800 for lustre-MDT0001 00000020:00000080:0.0:1788460123.741808:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c4ac35cb800 for lustre-MDT0001 00000001:00100000:1.0:1788460123.743996:0:6513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788460123.744004:0:6513:0:(genops.c:885:class_export_put()) final put ffff8c4bef371800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1788460123.744625:0:6513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a5915a6d-4114-41fb-8d95-33add86e0720 00000001:00080000:1.0:1788460123.744635:0:6513:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:1.0:1788460123.744639:0:6513:0:(genops.c:885:class_export_put()) final put ffff8c4ac3ae6000/a5915a6d-4114-41fb-8d95-33add86e0720 00000020:00000080:2.0:1788460123.751650:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c4bef371800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:2.0:1788460123.751751:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c4bfa3cb000 for lustre-MDT0000 00000001:00100000:1.0:1788460123.755452:0:6513:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f8767d3e-bfef-4d3d-8163-ef8ae18a3514 00000001:00080000:1.0:1788460123.755466:0:6513:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:1.0:1788460123.755480:0:6513:0:(genops.c:885:class_export_put()) final put ffff8c4ac35cc800/f8767d3e-bfef-4d3d-8163-ef8ae18a3514 00000020:00000080:0.0:1788460123.756786:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c4ac3ae6000/a5915a6d-4114-41fb-8d95-33add86e0720 for lustre-MDT0000 00000020:00000080:0.0:1788460123.756849:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c4ac35cc800/f8767d3e-bfef-4d3d-8163-ef8ae18a3514 for lustre-MDT0000 00000020:00000080:0.0:1788460123.756878:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c4ac3ae6800 for lustre-MDT0000 00000020:00000080:0.0:1788460123.756882:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c4ac35ce800 for lustre-MDT0000 00010000:00010000:3.0:1788460123.923597:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788460124.113426:0:15222:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8c4bcec3ed80 - data ffff8c4beb757438/ffff8c4ac39fb400 00000020:01000000:2.0:1788460124.113596:0:15222:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8c4bd16b7000 - data ffff8c4beb449000/ffff8c4bf306c000 00000001:00000004:2.0:1788460124.122331:0:15222:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:1.0:1788460124.192302:0:15222:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788460124.192310:0:15222:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:1.0:1788460124.192325:0:15222:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8c4ac1e61f80 x1875336022364288/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788460132 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460124.192351:0:15222:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1788460124.193710:0:15222:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788460124.193716:0:15222:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:1.0:1788460124.193781:0:15222:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788460124.193793:0:15222:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788460124.196932:0:8828:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788460124.196940:0:8828:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:0.0:1788460124.196966:0:8828:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:1.0:1788460124.198203:0:15222:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788460124.198209:0:15222:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:1.0:1788460124.198252:0:15222:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788460124.198255:0:15222:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788460124.198925:0:10062:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788460124.198930:0:10062:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:3.0:1788460124.198941:0:10062:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1788460124.203173:0:15222:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5dfa74784542a919 00000020:00000080:1.0:1788460124.203185:0:15222:0:(genops.c:885:class_export_put()) final put ffff8c4bc473e800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788460124.209893:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c4bc473e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788460124.219872:0:15222:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5dfa74784542a92e 00000020:00000080:1.0:1788460124.219886:0:15222:0:(genops.c:885:class_export_put()) final put ffff8c4bc473c000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788460124.219939:0:15222:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1788460124.219961:0:15222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788460124.219969:0:15222:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788460124.219973:0:15222:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff8c4bc4726620) has no exports 00000004:01000000:1.0:1788460124.220145:0:15222:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788460124.220153:0:15222:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5dfa74784542add4 00000020:00000080:1.0:1788460124.220157:0:15222:0:(genops.c:885:class_export_put()) final put ffff8c4ac35d9000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788460124.220602:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c4bc473c000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1788460124.220670:0:15222:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788460124.220675:0:15222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788460124.220684:0:15222:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788460124.220688:0:15222:0:(genops.c:1558:class_disconnect_exports()) OBD device 28 (ffff8c4c019a6620) has no exports 00000020:00000080:1.0:1788460124.220694:0:15222:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5dfa74784542adcd 00000020:00000080:1.0:1788460124.220700:0:15222:0:(genops.c:885:class_export_put()) final put ffff8c4ac35dc800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788460124.220722:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c4ac35d9000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:1.0:1788460124.221132:0:15222:0:(obd_class.h:688:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788460124.221137:0:15222:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788460124.221141:0:15222:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:1.0:1788460124.221146:0:15222:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788460124.221149:0:15222:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788460124.221273:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c4ac35dc800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788460124.221474:0:15222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788460124.221484:0:15222:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788460124.221490:0:15222:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5dfa74784542ac4c 00000020:00000080:1.0:1788460124.221495:0:15222:0:(genops.c:885:class_export_put()) final put ffff8c4bff80e000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788460124.221517:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c4ac35dd000 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788460124.221523:0:8:0:(genops.c:885:class_export_put()) final put ffff8c4ac35da000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788460124.221525:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c4ac35da000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1788460124.221530:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788460124.221668:0:15222:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788460124.221672:0:15222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788460124.221682:0:15222:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788460124.221685:0:15222:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff8c4bef210000) has no exports 00000020:00000080:1.0:1788460124.221690:0:15222:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5dfa74784542ac45 00000020:00000080:1.0:1788460124.221693:0:15222:0:(genops.c:885:class_export_put()) final put ffff8c4bff80c800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788460124.221709:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c4bff80e000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:1.0:1788460124.222119:0:15222:0:(obd_class.h:688:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788460124.222122:0:15222:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788460124.222125:0:15222:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:1.0:1788460124.222130:0:15222:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788460124.222131:0:15222:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788460124.222468:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c4bff80c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788460124.222546:0:15222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788460124.222553:0:15222:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1788460124.222565:0:15222:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1788460124.222570:0:15222:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5dfa74784542aad2 00000020:00000080:1.0:1788460124.222576:0:15222:0:(genops.c:885:class_export_put()) final put ffff8c4bf7515000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788460124.222593:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c4bff80d000 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788460124.222598:0:8:0:(genops.c:885:class_export_put()) final put ffff8c4bff808800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788460124.222600:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c4bff808800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1788460124.222604:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788460124.222672:0:15222:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1788460124.222675:0:15222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788460124.222680:0:15222:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788460124.222683:0:15222:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8c4bd0b89988) has no exports 00000020:00000080:1.0:1788460124.222687:0:15222:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5dfa74784542aacb 00000020:00000080:1.0:1788460124.222690:0:15222:0:(genops.c:885:class_export_put()) final put ffff8c4bf7514000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788460124.222882:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c4bf7515000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1788460124.222889:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c4bf7514000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1788460124.225055:0:15222:0:(obd_class.h:688:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1788460124.225073:0:15222:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788460124.225077:0:15222:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1788460124.225086:0:15222:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788460124.225133:0:15222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788460124.225165:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c4bf7510800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1788460124.225687:0:15222:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788460124.225693:0:15222:0:(genops.c:885:class_export_put()) final put ffff8c4bf7513000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788460124.225697:0:15222:0:(genops.c:844:class_export_destroy()) destroying export ffff8c4bf7513000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:0.0:1788460124.225710:0:15222:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788460124.225815:0:15222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788460124.225819:0:15222:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788460124.225822:0:15222:0:(genops.c:885:class_export_put()) final put ffff8c4bced6b000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788460124.225824:0:15222:0:(genops.c:844:class_export_destroy()) destroying export ffff8c4bced6b000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788460124.225829:0:15222:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788460124.225879:0:15222:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5dfa74784542a935 00000020:00000080:0.0:1788460124.225887:0:15222:0:(genops.c:885:class_export_put()) final put ffff8c4bc4738800/lustre-MDD0000_UUID 00000020:01000000:0.0:1788460124.225966:0:15222:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1788460124.225971:0:15222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788460124.225976:0:15222:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788460124.225985:0:15222:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8c4bc4720000) has no exports 00000020:00000080:0.0:1788460124.226006:0:15222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788460124.226009:0:15222:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1788460124.226014:0:15222:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5dfa74784542a93c 00000020:00000080:0.0:1788460124.226018:0:15222:0:(genops.c:885:class_export_put()) final put ffff8c4bc473a800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788460124.226647:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c4bc4738800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1788460124.226655:0:8:0:(genops.c:885:class_export_put()) final put ffff8c4bc473b800/lustre-MDD0000_UUID 00000020:00000080:3.0:1788460124.226657:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c4bc473b800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1788460124.226662:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:0.0:1788460124.226872:0:15222:0:(tgt_mount.c:201:server_put_mount()) put mount ffff8c4be2d81000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1788460124.226876:0:15222:0:(obd_mount.c:798:lustre_put_lsi()) put ffff8c4be2d81000 3 00000020:01000004:0.0:1788460124.226880:0:15222:0:(tgt_mount.c:134:server_deregister_mount()) deregister mount ffff8c4be2d81000 from lustre-MDT0000 00000020:00000080:0.0:1788460124.226908:0:15222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788460124.226919:0:15222:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1788460124.226922:0:15222:0:(genops.c:885:class_export_put()) final put ffff8c4bc473e000/lustre-MDT0000_UUID 00000020:00000080:0.0:1788460124.226924:0:15222:0:(genops.c:844:class_export_destroy()) destroying export ffff8c4bc473e000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1788460124.226932:0:15222:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1788460124.227035:0:15222:0:(obd_mount.c:666:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1788460124.227039:0:15222:0:(tgt_mount.c:284:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1788460124.227189:0:15222:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1788460124.227194:0:15222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788460124.227198:0:15222:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788460124.227204:0:15222:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8c4bced6f000 0cf73fe6-82e2-434e-b670-631647721b2c 0@lo 22 (0 0 17) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788460124.227209:0:15222:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff8c4bd0b8b310) has exports, disconnecting them 00000020:00080000:0.0:1788460124.227214:0:15222:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8c4bced6f000), last request at 1788459873 00000020:00000080:0.0:1788460124.227228:0:15222:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5dfa74784542a8da 00000020:00010000:0.0:1788460124.227233:0:15222:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8c4bced6f000: total 1 00000100:00080000:0.0:1788460124.227237:0:15222:0:(import.c:65:import_set_state_nolock()) ffff8c4bced6a800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788460124.227250:0:15222:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c4bced6f000): rc 0 00000020:00080000:0.0:1788460124.227254:0:15222:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff8c4bd0b8b310) has no exports 00000100:00100000:0.0:1788460124.228477:0:6525:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8c4bf35fda00:6525] 0 exiting: rc = 1 00000020:00010000:0.0:1788460124.228571:0:6522:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8c4bced6f000: total 1 00010000:00010000:0.0:1788460124.228575:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460124.228609:0:6522:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8c4bced6f000, canceled 0 locks, left on hash table 17. 00010000:00010000:0.0:1788460124.228638:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4ac3676400/0x5dfa74784542b11c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5dfa74784542b115 expref: 18 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460124.228653:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4bef209a00/0x5dfa74784542aead lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5dfa74784542aea6 expref: 17 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460124.229690:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4bc14f1c00/0x5dfa74784542a9e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5dfa74784542a9dd expref: 16 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460124.229735:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4bc14f0800/0x5dfa74784542b12a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5dfa74784542b123 expref: 15 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460124.229747:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4ac2840800/0x5dfa74784542ae9f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5dfa74784542ae98 expref: 14 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460124.229778:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4bc29d2c00/0x5dfa74784542a9d6 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5dfa74784542a9cf expref: 13 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460124.229790:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4bef209000/0x5dfa74784542ae59 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5dfa74784542ae52 expref: 12 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460124.229801:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4bef209600/0x5dfa74784542aebb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5dfa74784542aeb4 expref: 11 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460124.229811:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4ac2840e00/0x5dfa74784542ad5d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5dfa74784542ad56 expref: 10 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460124.229820:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4ac395ec00/0x5dfa74784542aec9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5dfa74784542aec2 expref: 9 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460124.229830:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4ac395e800/0x5dfa74784542ae67 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5dfa74784542ae60 expref: 8 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460124.229840:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4bfadc6600/0x5dfa74784542ad09 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5dfa74784542ad02 expref: 7 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460124.229849:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4bef209c00/0x5dfa74784542ae75 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5dfa74784542ae6e expref: 6 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460124.229859:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4ac395fe00/0x5dfa74784542ae83 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5dfa74784542ae7c expref: 5 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460124.229868:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4ac395f800/0x5dfa74784542ad25 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5dfa74784542ad1e expref: 4 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460124.229891:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4bfadc6000/0x5dfa74784542ae91 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5dfa74784542ae8a expref: 3 pid: 6526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460124.229903:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4ac2840a00/0x5dfa74784542b10e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5dfa74784542b107 expref: 2 pid: 6528 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460124.229914:0:6522:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8c4bced6f000, canceled 17 locks, left on hash table 0. 00000020:00000080:0.0:1788460124.229937:0:6522:0:(genops.c:885:class_export_put()) final put ffff8c4bced6f000/0cf73fe6-82e2-434e-b670-631647721b2c 00000020:00000080:3.0:1788460124.230574:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c4bc473a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:3.0:1788460124.230622:0:6526:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8c4bd26dd000:6526] 1 exiting: rc = 0 00000100:00100000:1.0:1788460124.230675:0:6528:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8c4bc65e9a00:6528] 2 exiting: rc = 0 00010000:00010000:0.0:1788460124.230820:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460124.230823:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460124.230825:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788460124.230859:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460124.230868:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460124.230873:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460124.230879:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460124.230885:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788460124.230915:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c4bced6f000/0cf73fe6-82e2-434e-b670-631647721b2c for MGS 00000020:00000080:3.0:1788460124.230958:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c4bced6a800 for MGS 00000100:00100000:0.0:1788460124.230997:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460124.231008:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460124.231014:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460124.231019:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460124.231028:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460124.231033:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460124.231285:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460124.231790:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460124.231802:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460124.231810:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460124.231818:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460124.231829:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460124.231835:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460124.231840:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460124.231845:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460124.231898:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460124.231903:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460124.231909:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460124.231914:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460124.231920:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460124.231925:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460124.231931:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460124.231937:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460124.232601:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460124.232613:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460124.232728:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460124.232734:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460124.232740:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460124.232745:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460124.232750:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460124.232874:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460124.232884:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460124.232893:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460124.232902:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460124.232915:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460124.232921:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460124.232926:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460124.232931:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460124.232936:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460124.232941:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460124.233178:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460124.233183:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460124.233188:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460124.233194:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460124.233199:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460124.233204:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460124.233210:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460124.233215:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460124.233222:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460124.233227:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460124.233242:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460124.233247:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460124.233252:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460124.233257:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460124.233262:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460124.233267:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460124.233272:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460124.233278:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460124.233283:0:15222:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:0.0:1788460124.236805:0:15222:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8c4ac2a222a0 - data ffff8c4ac20b5000/ffff8c4ac3691400 00000020:01000000:0.0:1788460124.236933:0:15222:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8c4bc734f300 - data ffff8c4beb4a4d80/ffff8c4bc7f5d400 00000020:00000080:0.0:1788460124.237780:0:15222:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5dfa74784542a8be 00000020:00000080:0.0:1788460124.237789:0:15222:0:(genops.c:885:class_export_put()) final put ffff8c4be0230000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788460124.237846:0:15222:0:(tgt_mount.c:201:server_put_mount()) put mount ffff8c4be2d81000 from MGS, refs=2 00000020:01000004:0.0:1788460124.237851:0:15222:0:(obd_mount.c:798:lustre_put_lsi()) put ffff8c4be2d81000 2 00000020:01000004:0.0:1788460124.237854:0:15222:0:(tgt_mount.c:134:server_deregister_mount()) deregister mount ffff8c4be2d81000 from MGS 00000020:00000080:0.0:1788460124.237875:0:15222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788460124.237881:0:15222:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1788460124.237972:0:15222:0:(genops.c:885:class_export_put()) final put ffff8c4be0235000/MGS 00000020:00000080:0.0:1788460124.237975:0:15222:0:(genops.c:844:class_export_destroy()) destroying export ffff8c4be0235000/MGS for MGS 00000020:01000000:0.0:1788460124.237981:0:15222:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1788460124.238051:0:15222:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1788460124.238056:0:15222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788460124.238066:0:15222:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788460124.238077:0:15222:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8c4bf6bc6000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788460124.238083:0:15222:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff8c4bd0b88000) has exports, disconnecting them 00000020:00080000:0.0:1788460124.238087:0:15222:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8c4bf6bc6000), last request at 1788459873 00000020:00000080:0.0:1788460124.238091:0:15222:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5dfa74784542a989 00000020:00080000:0.0:1788460124.238101:0:15222:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c4bf6bc6000): rc 0 00000020:00000080:0.0:1788460124.238105:0:15222:0:(genops.c:885:class_export_put()) final put ffff8c4bf6bc6000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788460124.238144:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c4be0230000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788460124.238316:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c4bf6bc6000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00000100:00100000:3.0:1788460124.244345:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3673480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022364672:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788460124.244657:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460124.244730:0:6538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022364672 00000100:00100000:3.0:1788460124.244736:0:6538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022364672 00000100:00100000:3.0:1788460124.244767:0:6538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1788460124.244774:0:6538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf2ea4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3661:x1875336022364672:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:3.0:1788460124.244781:0:6538:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788460124.244824:0:6538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf2ea4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3661:x1875336022364672:12345-0@lo:41:osp-pre-0-1.0 Request processed in 49us (166us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788460124.244838:0:6538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:02020000:3.0:1788460124.245203:0:3661:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:3.0:1788460124.256206:0:3661:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788460124.256214:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8c4bfa1bb800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788460124.256219:0:3661:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788460124.268788:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8c4bfa1bb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788460124.268801:0:3661:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 190 00000100:00080000:3.0:1788460124.268816:0:3661:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8c4bfa1bb800 using connection 192.168.206.105@tcp/0@lo 00000100:00100000:3.0:1788460124.269250:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3670a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022364800:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788460124.269313:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460124.269394:0:8452:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022364800 00000100:00100000:3.0:1788460124.269528:0:8452:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022364800 00000100:00100000:3.0:1788460124.269666:0:8452:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788460124.269675:0:8452:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3672680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022364800:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788460124.269703:0:8452:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788460124.269749:0:8452:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3672680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022364800:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460124.269756:0:8452:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:3.0:1788460124.269775:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788460124.269806:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3670a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022364800:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788460124.270069:0:3661:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4ac3670a80 x1875336022364928/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788460124.270349:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3670a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1875336022364928:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:2.0:1788460124.270633:0:3658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460124.270923:0:14842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022364928 00000100:00100000:3.0:1788460124.270935:0:14842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022364928 00000100:00100000:3.0:1788460124.270986:0:14842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1788460124.270992:0:14842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac42f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3658:x1875336022364928:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:3.0:1788460124.271011:0:14842:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788460124.271061:0:14842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac42f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3658:x1875336022364928:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 67us (427us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788460124.271067:0:14842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00080000:2.0:1788460124.271232:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c4bfa1bb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788460124.271238:0:3658:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788460124.271241:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3670a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1875336022364928:0@lo:38:ptlrpcd_00_02.0 00010000:01000000:3.0:1788460124.272000:0:15222:0:(obd_class.h:688:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1788460124.272005:0:15222:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788460124.272009:0:15222:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788460124.272015:0:15222:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788460124.272160:0:15222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788460124.272168:0:15222:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1788460124.272174:0:15222:0:(obd_mount.c:798:lustre_put_lsi()) put ffff8c4be2d81000 1 00000020:00000080:3.0:1788460124.272190:0:15222:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5dfa74784542a8b0 00000020:00000080:3.0:1788460124.272199:0:15222:0:(genops.c:885:class_export_put()) final put ffff8c4bd26e6000/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1788460124.272204:0:15222:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1788460124.272209:0:15222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788460124.272212:0:15222:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788460124.272215:0:15222:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8c4bcec53310) has no exports 00000020:00000080:1.0:1788460124.274821:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c4bfa02b000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788460124.274840:0:36:0:(genops.c:885:class_export_put()) final put ffff8c4bfa02e800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1788460124.274902:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c4bfa02e800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1788460124.274915:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1788460124.275015:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c4bd26e6000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788460124.339339:0:15222:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788460124.339350:0:15222:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1788460124.339355:0:15222:0:(genops.c:885:class_export_put()) final put ffff8c4bd1a82000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788460124.339360:0:15222:0:(genops.c:844:class_export_destroy()) destroying export ffff8c4bd1a82000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1788460124.339384:0:15222:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1788460124.339507:0:15222:0:(obd_mount.c:756:lustre_free_lsi()) Freeing lsi ffff8c4bc38f0000 00000020:02000400:3.0:1788460124.339769:0:15222:0:(tgt_mount.c:2315:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1788460124.947074:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788460125.780937:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788460125.780978:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac42f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022365056:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788460125.781035:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460125.781133:0:14841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022365056 00000100:00100000:2.0:1788460125.781140:0:14841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022365056 00000100:00100000:2.0:1788460125.781194:0:14841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788460125.781202:0:14841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac1e61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022365056:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788460125.781228:0:14841:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788460125.781266:0:14841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac1e61f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022365056:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460125.781273:0:14841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788460125.781312:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac42f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022365056:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788460125.781363:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788460125.781868:0:8:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788460125.781872:0:8:0:(pinger.c:244:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788460125.781880:0:8:0:(import.c:65:import_set_state_nolock()) ffff8c4bfa1bb800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788460125.781885:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 421 00000100:00080000:3.0:1788460125.781889:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788460125.781893:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8c4bfa1bb800 using connection 192.168.206.105@tcp/0@lo 00000100:00100000:3.0:1788460125.781912:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4ac3671880 x1875336022365312/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788460125.781990:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3671880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1875336022365312:0@lo:38:kworker.0 00000100:00100000:3.0:1788460125.782023:0:3658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460125.782050:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3670000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3662:1875336022365568:0@lo:400:kworker.0 00000100:00100000:3.0:1788460125.782071:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460125.782090:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3671c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1875336022366080:0@lo:400:kworker.0 00000100:00100000:3.0:1788460125.782105:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460125.782120:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788460125.782124:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3671500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3662:1875336022365440:0@lo:400:kworker.0 00000100:00100000:3.0:1788460125.782139:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460125.782152:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3672d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3662:1875336022365952:0@lo:400:kworker.0 00000100:00100000:3.0:1788460125.782167:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460125.782188:0:6539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022365312 00000100:00100000:3.0:1788460125.782191:0:6539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022365312 00000100:00100000:3.0:1788460125.782211:0:6539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1788460125.782216:0:6539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3671180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3658:x1875336022365312:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788460125.782232:0:6539:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788460125.782259:0:6539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3671180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3658:x1875336022365312:12345-0@lo:38:kworker.0 Request processed in 42us (236us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788460125.782265:0:6539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1788460125.782286:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022365568 00000100:00100000:3.0:1788460125.782290:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022365568 00000100:00100000:3.0:1788460125.782306:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022366080 00000100:00100000:3.0:1788460125.782308:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022366080 00000100:00100000:3.0:1788460125.782324:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022365440 00000100:00100000:3.0:1788460125.782326:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022365440 00000100:00100000:3.0:1788460125.782333:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022365952 00000100:00100000:3.0:1788460125.782334:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022365952 00000100:00100000:3.0:1788460125.782342:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:3.0:1788460125.782347:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3670e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875336022366080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460125.782380:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3670e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875336022366080:12345-0@lo:400:kworker.0 Request processed in 33us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460125.782385:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:3.0:1788460125.782395:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788460125.782399:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3670a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3662:x1875336022365568:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788460125.782403:0:13560:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788460125.782419:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3670a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3662:x1875336022365568:12345-0@lo:400:kworker.0 Request processed in 20us (347us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788460125.782424:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788460125.782431:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788460125.782448:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf75e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3662:x1875336022365440:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788460125.782452:0:13560:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788460125.782469:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf75e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3662:x1875336022365440:12345-0@lo:400:kworker.0 Request processed in 21us (329us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788460125.782474:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788460125.782483:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788460125.782578:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3673100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0cf73fe6-82e2-434e-b670-631647721b2c:3660:1875336022365184:0@lo:400:kworker.0 00000400:00000100:2.0:1788460125.782600:0:3660:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875336022365184 offset 0 length 224: 4 00000100:00100000:2.0:1788460125.782617:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3671f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022365824:0@lo:400:kworker.0 00000100:00100000:2.0:1788460125.782635:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460125.782653:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788460125.782659:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3673800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3660:1875336022365696:0@lo:400:kworker.0 00000100:00100000:2.0:1788460125.782690:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460125.782730:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022365696 00000100:00100000:2.0:1788460125.782735:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022365696 00000100:00100000:3.0:1788460125.782828:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4284380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3662:x1875336022365952:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788460125.782834:0:13560:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788460125.782866:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4284380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3662:x1875336022365952:12345-0@lo:400:kworker.0 Request processed in 38us (698us total) trans 0 rc -107/-107 00000100:00080000:1.0:1788460125.783015:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788460125.783037:0:3662:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788460125.783042:0:3662:0:(import.c:65:import_set_state_nolock()) ffff8c4bef21a000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788460125.783046:0:3662:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:2.0:1788460125.786858:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:2.0:1788460125.786879:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac42f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1875336022365696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460125.786981:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac42f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1875336022365696:12345-0@lo:400:kworker.0 Request processed in 112us (4289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460125.787000:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00080000:2.0:1788460125.787055:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c4bfa1bb800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788460125.787061:0:3658:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788460125.787065:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3671880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1875336022365312:0@lo:38:kworker.0 00010000:00080000:2.0:1788460125.787102:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8c4ac3673800 x1875336022365696/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460141 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460125.787114:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3673800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3660:1875336022365696:0@lo:400:kworker.0 00000100:00100000:2.0:1788460125.792860:0:8448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022365824 00000100:00100000:2.0:1788460125.792872:0:8448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022365824 00000100:00100000:2.0:1788460125.792923:0:8448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788460125.792933:0:8448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac42f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022365824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460125.793042:0:8448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac42f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022365824:12345-0@lo:400:kworker.0 Request processed in 111us (10405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460125.793049:0:8448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788460125.793089:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3671f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022365824:0@lo:400:kworker.0 00000100:00100000:3.0:1788460125.797775:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00080000:1.0:1788460125.815231:0:3662:0:(import.c:65:import_set_state_nolock()) ffff8c4bef21a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788460125.815244:0:3662:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 190 00000100:00080000:1.0:1788460125.815252:0:3662:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8c4bef21a000 using connection 192.168.206.105@tcp/0@lo 00000100:00100000:1.0:1788460125.815302:0:3662:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4ac1e60700 x1875336022366208/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788460125.815332:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3671500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3662:1875336022365440:0@lo:400:kworker.0 00000100:00100000:1.0:1788460125.815347:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1875336022366208:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1788460125.815407:0:3658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460125.815476:0:6535:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022366208 00000100:00100000:1.0:1788460125.815483:0:6535:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022366208 00000100:00100000:1.0:1788460125.815518:0:6535:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1788460125.815526:0:6535:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac1e63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3658:x1875336022366208:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:1.0:1788460125.815547:0:6535:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788460125.815586:0:6535:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac1e63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3658:x1875336022366208:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 60us (178us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788460125.815594:0:6535:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00080000:1.0:1788460125.815630:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c4bef21a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788460125.815635:0:3658:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788460125.815638:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1875336022366208:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:1.0:1788460125.815663:0:3662:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788460125.815678:0:3662:0:(import.c:65:import_set_state_nolock()) ffff8c4ac2be5800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788460125.815682:0:3662:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788460125.815685:0:3662:0:(import.c:65:import_set_state_nolock()) ffff8c4ac2be5800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788460125.815689:0:3662:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 228 00000100:00080000:1.0:1788460125.815693:0:3662:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8c4ac2be5800 using connection 192.168.206.105@tcp/0@lo 00000100:00100000:1.0:1788460125.815707:0:3662:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4ac1e60700 x1875336022366336/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788460125.815723:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3672d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3662:1875336022365952:0@lo:400:kworker.0 00000100:00100000:1.0:1788460125.815732:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1875336022366336:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1788460125.815755:0:3658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460125.815783:0:7760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022366336 00000100:00100000:1.0:1788460125.815787:0:7760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022366336 00000100:00100000:1.0:1788460125.815808:0:7760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788460125.815812:0:7760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac1e61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3658:x1875336022366336:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:1.0:1788460125.815823:0:7760:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788460125.815853:0:7760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac1e61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3658:x1875336022366336:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 39us (97us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788460125.815858:0:7760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00080000:1.0:1788460125.815880:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c4ac2be5800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788460125.815883:0:3658:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788460125.815886:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1875336022366336:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:1.0:1788460125.815911:0:3662:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788460125.815914:0:3662:0:(import.c:65:import_set_state_nolock()) ffff8c4bfc4c2000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788460125.815917:0:3662:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788460125.815927:0:3662:0:(import.c:65:import_set_state_nolock()) ffff8c4bfc4c2000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788460125.815930:0:3662:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 210 00000100:00080000:1.0:1788460125.815935:0:3662:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8c4bfc4c2000 using connection 192.168.206.105@tcp/0@lo 00000100:00100000:1.0:1788460125.816147:0:3662:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4ac1e60700 x1875336022366464/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788460125.816163:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3670000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3662:1875336022365568:0@lo:400:kworker.0 00000100:00100000:1.0:1788460125.816172:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1875336022366464:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1788460125.816195:0:3658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788460125.816240:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8c4ac3671c00 x1875336022366080/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460141 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460125.816251:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3671c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1875336022366080:0@lo:400:kworker.0 00000100:00100000:2.0:1788460125.816780:0:13560:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022366464 00000100:00100000:2.0:1788460125.816787:0:13560:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022366464 00000100:00100000:2.0:1788460125.816812:0:13560:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1788460125.816819:0:13560:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac1e61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3658:x1875336022366464:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:2.0:1788460125.816832:0:13560:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788460125.816869:0:13560:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac1e61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3658:x1875336022366464:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 49us (672us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788460125.816875:0:13560:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:1.0:1788460125.818615:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c4bfc4c2000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788460125.818625:0:3658:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788460125.818629:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1875336022366464:0@lo:38:ptlrpcd_00_03.0 00010000:00010000:2.0:1788460125.971126:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460126.993053:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460128.017165:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788460128.170614:0:15423:0:(tgt_mount.c:2326:server_umount_begin()) umount -f 00000020:01000004:1.0:1788460128.184493:0:15423:0:(tgt_mount.c:2182:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:1.0:1788460128.184547:0:15423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bef208000/0x5dfa74784542aea6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542aead expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460128.184562:0:15423:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bef208000/0x5dfa74784542aea6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542aead expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460128.184571:0:15423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bef208000/0x5dfa74784542aea6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x5dfa74784542aead expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460128.184594:0:15423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mgc192.168.206.105@tcp lock: ffff8c4bef208000/0x5dfa74784542aea6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x5dfa74784542aead expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460128.185436:0:15423:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788460128.185456:0:15423:0:(mgc_request_server.c:165:mgc_fs_clear()) mgc192.168.206.105@tcp: clear lustre-client 10000000:01000000:1.0:1788460128.185460:0:15423:0:(mgc_request.c:651:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788460128.185487:0:15423:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788460128.185492:0:15423:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788460128.185497:0:15423:0:(pinger.c:405:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788460128.185502:0:15423:0:(import.c:65:import_set_state_nolock()) ffff8c4bef21a000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1788460128.185507:0:15423:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788460128.185509:0:15423:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788460128.185511:0:15423:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788460128.186734:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788460128.186744:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: ffff8c4bef208000/0x5dfa74784542aea6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x5dfa74784542aead expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460128.186755:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bef208000 already unused, calling callback (ffffffffc125ae00) 10000000:00010000:2.0:1788460128.186759:0:6521:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: ffff8c4bef208000/0x5dfa74784542aea6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x5dfa74784542aead expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460128.186769:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: ffff8c4bef208000/0x5dfa74784542aea6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x5dfa74784542aead expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788460128.186776:0:6521:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: ffff8c4bef208000/0x5dfa74784542aea6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x5dfa74784542aead expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788460128.186782:0:6521:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788460128.186785:0:6521:0:(mgc_request.c:1242:mgc_blocking_ast()) log lustre-client: stale lock, won't requeue 10000000:01000000:2.0:1788460128.186788:0:6521:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788460128.186862:0:6521:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.206.105@tcp lock: ffff8c4bef208000/0x5dfa74784542aea6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x5dfa74784542aead expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460128.186869:0:6521:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788460128.186892:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: ffff8c4bef208000/0x5dfa74784542aea6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x5dfa74784542aead expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460128.186899:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: ffff8c4bef208000/0x5dfa74784542aea6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x5dfa74784542aead expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460128.186910:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460128.186912:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460128.186913:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788460128.186941:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac42f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0cf73fe6-82e2-434e-b670-631647721b2c:3659:1875336022366592:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788460128.187022:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460128.187088:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022366592 00000100:00100000:2.0:1788460128.187093:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022366592 00000100:00100000:2.0:1788460128.187127:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788460128.187133:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac42f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3659:x1875336022366592:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788460128.187139:0:6520:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788460128 with bad export cookie 6771853049611856090 00010000:00010000:1.0:1788460128.191539:0:15423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac395ea00/0x5dfa74784542aeb4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542aebb expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460128.191557:0:15423:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac395ea00/0x5dfa74784542aeb4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542aebb expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460128.191566:0:15423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac395ea00/0x5dfa74784542aeb4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x5dfa74784542aebb expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460128.191573:0:15423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mgc192.168.206.105@tcp lock: ffff8c4ac395ea00/0x5dfa74784542aeb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x5dfa74784542aebb expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460128.191598:0:15423:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788460128.191614:0:15423:0:(mgc_request_server.c:165:mgc_fs_clear()) mgc192.168.206.105@tcp: clear lustre-MDT0001 00010000:00010000:1.0:1788460128.191687:0:15423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac395ee00/0x5dfa74784542ad56 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ad5d expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460128.191709:0:15423:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac395ee00/0x5dfa74784542ad56 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542ad5d expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460128.191715:0:15423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac395ee00/0x5dfa74784542ad56 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5dfa74784542ad5d expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460128.191721:0:15423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mgc192.168.206.105@tcp lock: ffff8c4ac395ee00/0x5dfa74784542ad56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5dfa74784542ad5d expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460128.191738:0:15423:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788460128.191755:0:9536:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788460128.191761:0:9536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: ffff8c4ac395ea00/0x5dfa74784542aeb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x5dfa74784542aebb expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460128.191768:0:9536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac395ea00 already unused, calling callback (ffffffffc125ae00) 10000000:00010000:1.0:1788460128.191772:0:9536:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: ffff8c4ac395ea00/0x5dfa74784542aeb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x5dfa74784542aebb expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460128.191780:0:9536:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: ffff8c4ac395ea00/0x5dfa74784542aeb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x5dfa74784542aebb expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788460128.191788:0:9536:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: ffff8c4ac395ea00/0x5dfa74784542aeb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x5dfa74784542aebb expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788460128.191794:0:9536:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788460128.191796:0:9536:0:(mgc_request.c:1242:mgc_blocking_ast()) log lustre-MDT0001: stale lock, won't requeue 00010000:00010000:1.0:1788460128.191825:0:9536:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.206.105@tcp lock: ffff8c4ac395ea00/0x5dfa74784542aeb4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x5dfa74784542aebb expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460128.191841:0:9536:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788460128.191864:0:9536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: ffff8c4ac395ea00/0x5dfa74784542aeb4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x5dfa74784542aebb expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460128.191872:0:9536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: ffff8c4ac395ea00/0x5dfa74784542aeb4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x5dfa74784542aebb expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460128.191884:0:9536:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788460128.191888:0:9536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: ffff8c4ac395ee00/0x5dfa74784542ad56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5dfa74784542ad5d expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460128.191894:0:9536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac395ee00 already unused, calling callback (ffffffffc125ae00) 10000000:00010000:1.0:1788460128.191897:0:9536:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: ffff8c4ac395ee00/0x5dfa74784542ad56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5dfa74784542ad5d expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460128.191904:0:9536:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: ffff8c4ac395ee00/0x5dfa74784542ad56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5dfa74784542ad5d expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788460128.191910:0:9536:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: ffff8c4ac395ee00/0x5dfa74784542ad56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5dfa74784542ad5d expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788460128.191916:0:9536:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1788460128.191918:0:9536:0:(mgc_request.c:1242:mgc_blocking_ast()) log lustre-mdtir: stale lock, won't requeue 10000000:01000000:1.0:1788460128.191920:0:9536:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1788460128.191980:0:9536:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.206.105@tcp lock: ffff8c4ac395ee00/0x5dfa74784542ad56 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x5dfa74784542ad5d expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460128.191986:0:9536:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788460128.192000:0:9536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: ffff8c4ac395ee00/0x5dfa74784542ad56 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x5dfa74784542ad5d expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460128.192017:0:9536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: ffff8c4ac395ee00/0x5dfa74784542ad56 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x5dfa74784542ad5d expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460128.192026:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460128.192028:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460128.192029:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788460128.192050:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0cf73fe6-82e2-434e-b670-631647721b2c:3661:1875336022366848:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788460128.192109:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788460128.192169:0:15423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677200/0x5dfa74784542b123 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542b12a expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460128.192176:0:15423:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677200/0x5dfa74784542b123 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542b12a expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460128.192182:0:15423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677200/0x5dfa74784542b123 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5dfa74784542b12a expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460128.192188:0:15423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677200/0x5dfa74784542b123 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5dfa74784542b12a expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460128.192207:0:15423:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788460128.192217:0:15423:0:(mgc_request_server.c:165:mgc_fs_clear()) mgc192.168.206.105@tcp: clear params 00010000:00010000:1.0:1788460128.192222:0:15423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bc0031600/0x5dfa74784542a9dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542a9e4 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460128.192228:0:15423:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bc0031600/0x5dfa74784542a9dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542a9e4 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460128.192244:0:15423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bc0031600/0x5dfa74784542a9dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5dfa74784542a9e4 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460128.192249:0:15423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mgc192.168.206.105@tcp lock: ffff8c4bc0031600/0x5dfa74784542a9dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5dfa74784542a9e4 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460128.192260:0:15423:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788460128.192266:0:15423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6200/0x5dfa74784542aec2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542aec9 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460128.192271:0:15423:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6200/0x5dfa74784542aec2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542aec9 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460128.192277:0:15423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6200/0x5dfa74784542aec2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x5dfa74784542aec9 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460128.192282:0:15423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6200/0x5dfa74784542aec2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x5dfa74784542aec9 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460128.192291:0:15423:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788460128.192300:0:9536:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788460128.192304:0:9536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677200/0x5dfa74784542b123 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5dfa74784542b12a expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460128.192309:0:9536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac3677200 already unused, calling callback (ffffffffc125ae00) 10000000:00010000:1.0:1788460128.192311:0:9536:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677200/0x5dfa74784542b123 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5dfa74784542b12a expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460128.192318:0:9536:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677200/0x5dfa74784542b123 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5dfa74784542b12a expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788460128.192330:0:9536:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677200/0x5dfa74784542b123 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5dfa74784542b12a expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788460128.192334:0:9536:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788460128.192336:0:9536:0:(mgc_request.c:1242:mgc_blocking_ast()) log params: stale lock, won't requeue 10000000:01000000:1.0:1788460128.192338:0:9536:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788460128.192460:0:9537:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788460128.192466:0:9537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: ffff8c4bc0031600/0x5dfa74784542a9dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5dfa74784542a9e4 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460128.192473:0:9537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc0031600 already unused, calling callback (ffffffffc125ae00) 10000000:00010000:3.0:1788460128.192475:0:9537:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: ffff8c4bc0031600/0x5dfa74784542a9dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5dfa74784542a9e4 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460128.192482:0:9537:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: ffff8c4bc0031600/0x5dfa74784542a9dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x5dfa74784542a9e4 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788460128.192489:0:9537:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: ffff8c4bc0031600/0x5dfa74784542a9dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x5dfa74784542a9e4 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788460128.192493:0:9537:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788460128.192496:0:9537:0:(mgc_request.c:1242:mgc_blocking_ast()) log lustre-barrier: stale lock, won't requeue 10000000:01000000:3.0:1788460128.192497:0:9537:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1788460128.192526:0:9537:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.206.105@tcp lock: ffff8c4bc0031600/0x5dfa74784542a9dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5dfa74784542a9e4 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460128.192533:0:9537:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788460128.192547:0:9537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: ffff8c4bc0031600/0x5dfa74784542a9dd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5dfa74784542a9e4 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460128.192555:0:9537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: ffff8c4bc0031600/0x5dfa74784542a9dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5dfa74784542a9e4 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460128.192568:0:9537:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788460128.192577:0:9537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6200/0x5dfa74784542aec2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x5dfa74784542aec9 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460128.192583:0:9537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bfadc6200 already unused, calling callback (ffffffffc125ae00) 10000000:00010000:3.0:1788460128.192586:0:9537:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6200/0x5dfa74784542aec2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x5dfa74784542aec9 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460128.192592:0:9537:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6200/0x5dfa74784542aec2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x5dfa74784542aec9 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788460128.192598:0:9537:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6200/0x5dfa74784542aec2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x5dfa74784542aec9 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788460128.192603:0:9537:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788460128.192605:0:9537:0:(mgc_request.c:1242:mgc_blocking_ast()) log lustre-sptlrpc: stale lock, won't requeue 00010000:00010000:3.0:1788460128.192628:0:9537:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6200/0x5dfa74784542aec2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x5dfa74784542aec9 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460128.192643:0:9537:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788460128.192650:0:9537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6200/0x5dfa74784542aec2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x5dfa74784542aec9 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460128.192656:0:9537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6200/0x5dfa74784542aec2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x5dfa74784542aec9 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460128.192665:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460128.192666:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460128.192668:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460128.192678:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4287800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0cf73fe6-82e2-434e-b670-631647721b2c:3662:1875336022366976:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788460128.192706:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460128.192747:0:9538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022366848 00000100:00100000:3.0:1788460128.192758:0:9538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022366848 00000100:00100000:3.0:1788460128.192783:0:9538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022366976 00000100:00100000:3.0:1788460128.192785:0:9538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022366976 00000100:00100000:3.0:1788460128.192799:0:9538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788460128.192805:0:9538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac1e62680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3661:x1875336022366848:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788460128.192810:0:9538:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788460128 with bad export cookie 6771853049611856090 00000100:00100000:3.0:1788460128.192845:0:9538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac1e62680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3661:x1875336022366848:12345-0@lo:103:ldlm_bl.0 Request processed in 39us (736us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788460128.192852:0:9538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788460128.192865:0:9538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788460128.192869:0:9538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4287b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3662:x1875336022366976:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788460128.192873:0:9538:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788460128 with bad export cookie 6771853049611856090 00000100:00100000:3.0:1788460128.192896:0:9538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4287b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3662:x1875336022366976:12345-0@lo:103:ldlm_bl.0 Request processed in 25us (189us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788460128.192901:0:9538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1788460128.192931:0:3661:0:(recover.c:205:ptlrpc_request_handle_notconn()) import mgc192.168.206.105@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788460128.192935:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8c4bd1a85000 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1788460128.192939:0:3661:0:(import.c:186:ptlrpc_set_import_discon()) mgc192.168.206.105@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:0.0:1788460128.194764:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788460128.196174:0:15423:0:(mgc_request_server.c:165:mgc_fs_clear()) mgc192.168.206.105@tcp: clear lustre-sptlrpc 10000000:01000000:0.0:1788460128.196179:0:15423:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 10000000:01000000:0.0:1788460128.196202:0:15423:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:0.0:1788460128.196215:0:15423:0:(mgc_request.c:651:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:0.0:1788460128.196236:0:15423:0:(tgt_mount.c:2232:server_put_super()) stopping lustre-MDT0001 00000020:01000000:0.0:1788460128.196239:0:15423:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:0.0:1788460128.196243:0:15423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788460128.196248:0:15423:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1788460128.196255:0:15423:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8c4ac2bb4000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788460128.196262:0:15423:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8c4bfc4c3000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788460128.196267:0:15423:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff8c4bc4721988) has exports, disconnecting them 00000020:00080000:0.0:1788460128.196272:0:15423:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8c4ac2bb4000), last request at 1788460125 00000020:00000080:0.0:1788460128.196278:0:15423:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5dfa74784542acf4 00000100:00080000:0.0:1788460128.196293:0:15423:0:(import.c:65:import_set_state_nolock()) ffff8c4ac2bb1000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788460128.196339:0:15423:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c4ac2bb4000): rc 0 00000020:00000080:0.0:1788460128.196341:0:15423:0:(genops.c:885:class_export_put()) final put ffff8c4ac2bb4000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:0.0:1788460128.196352:0:15423:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8c4bfc4c3000), last request at 1788460125 00000020:00000080:0.0:1788460128.196355:0:15423:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5dfa74784542aba4 00000100:00080000:0.0:1788460128.196360:0:15423:0:(import.c:65:import_set_state_nolock()) ffff8c4bfc4c3800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1788460128.196372:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1788460128.196380:0:15423:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c4bfc4c3000): rc 0 00000020:00000080:0.0:1788460128.196382:0:15423:0:(genops.c:885:class_export_put()) final put ffff8c4bfc4c3000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:0.0:1788460128.196388:0:15423:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffba0a0182bae0 00000100:00080000:0.0:1788460128.196404:0:15423:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788460128.196412:0:15423:0:(client.c:3603:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff8c4ac3673480 x1875336022364672/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788460140 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460128.196434:0:15423:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000100:00080000:0.0:1788460128.200406:0:15423:0:(pinger.c:405:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788460128.200415:0:15423:0:(import.c:65:import_set_state_nolock()) ffff8c4bfa1bb800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000020:00000080:0.0:1788460128.200480:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c4ac2bb4000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:0.0:1788460128.200527:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c4bfc4c3000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:0.0:1788460128.200550:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c4ac2bb1000 for lustre-MDT0001 00000020:00000080:0.0:1788460128.200555:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c4bfc4c3800 for lustre-MDT0001 00000100:00080000:3.0:1788460128.210153:0:3661:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for mgc192.168.206.105@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1788460128.210158:0:3661:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788460128.210167:0:3661:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c4ac3673100 x1875336022365184/t0(0) o400->mgc192.168.206.105@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788460141 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460128.210182:0:3661:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c4ac42f1500 x1875336022366592/t0(0) o103->mgc192.168.206.105@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788460144 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460128.210192:0:3661:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c4ac1e60e00 x1875336022366848/t0(0) o103->mgc192.168.206.105@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788460144 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460128.210201:0:3661:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c4ac4287800 x1875336022366976/t0(0) o103->mgc192.168.206.105@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788460144 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788460128.210227:0:3661:0:(mgc_request.c:1476:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788460128.210230:0:3661:0:(pinger.c:200:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788460128.210231:0:3661:0:(mgc_request.c:1476:mgc_import_event()) import event 0x808002 00010000:00010000:0.0:1788460128.210625:0:9536:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677200/0x5dfa74784542b123 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x5dfa74784542b12a expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460128.210635:0:9536:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788460128.210650:0:9536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677200/0x5dfa74784542b123 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x5dfa74784542b12a expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460128.210658:0:9536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677200/0x5dfa74784542b123 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x5dfa74784542b12a expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460128.210674:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460128.210677:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460128.210678:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788460128.210752:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0cf73fe6-82e2-434e-b670-631647721b2c:0:1875336022366720:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788460128.210770:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3673100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0cf73fe6-82e2-434e-b670-631647721b2c:3660:1875336022365184:0@lo:400:kworker.0 00000100:00100000:2.0:1788460128.210796:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0cf73fe6-82e2-434e-b670-631647721b2c:0:1875336022367232:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788460128.210803:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788460128.210807:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4285500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0cf73fe6-82e2-434e-b670-631647721b2c:0:1875336022367104:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788460128.210933:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac42f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0cf73fe6-82e2-434e-b670-631647721b2c:3659:1875336022366592:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788460128.210977:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000100:2.0:1788460128.211022:0:6520:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 18 match 1875336022366592 offset 224 length 224: 4 00000100:00100000:2.0:1788460128.211041:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac42f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3659:x1875336022366592:12345-0@lo:103:ldlm_bl.0 Request processed in 23906us (24018us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788460128.211051:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788460128.211149:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4287800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0cf73fe6-82e2-434e-b670-631647721b2c:3662:1875336022366976:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788460128.211166:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788460128.211252:0:15423:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788460128.211255:0:15423:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:0.0:1788460128.211306:0:15423:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788460128.211433:0:15423:0:(pinger.c:405:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1788460128.211450:0:15423:0:(import.c:65:import_set_state_nolock()) ffff8c4bef685000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1788460128.211469:0:15423:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788460128.211471:0:15423:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:0.0:1788460128.211478:0:15423:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788460128.211532:0:15423:0:(pinger.c:405:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1788460128.211541:0:15423:0:(import.c:65:import_set_state_nolock()) ffff8c4bced6d000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1788460128.211563:0:15423:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8c4bc4721988) has no exports 00000100:00080000:3.0:1788460128.211688:0:3661:0:(import.c:65:import_set_state_nolock()) ffff8c4bd1a85000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788460128.211694:0:3661:0:(import.c:545:import_select_connection()) mgc192.168.206.105@tcp: connect to NID 0@lo last attempt 170 00000100:00080000:3.0:1788460128.211702:0:3661:0:(import.c:665:import_select_connection()) mgc192.168.206.105@tcp: import ffff8c4bd1a85000 using connection 192.168.206.105@tcp/0@lo 00000100:00100000:3.0:1788460128.211993:0:3661:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4ac4286300 x1875336022367616/t0(0) o250->mgc192.168.206.105@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788460128.212009:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3673480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022364672:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788460128.212025:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0cf73fe6-82e2-434e-b670-631647721b2c:3661:1875336022366848:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788460128.212143:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4395180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1875336022367360:0@lo:9:umount.0 00000100:00100000:2.0:1788460128.212189:0:3658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460128.212221:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4394380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1875336022367488:0@lo:9:umount.0 00000100:00100000:2.0:1788460128.212241:0:3658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460128.212264:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4286300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0cf73fe6-82e2-434e-b670-631647721b2c:3658:1875336022367616:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:2.0:1788460128.212281:0:3658:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875336022367616 offset 0 length 520: 4 00000100:00100000:0.0:1788460128.212435:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022367360 00000100:00100000:0.0:1788460128.212441:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022367360 00000100:00100000:0.0:1788460128.212491:0:8449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022367488 00000100:00100000:0.0:1788460128.212495:0:8449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022367488 00000100:00100000:0.0:1788460128.212515:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788460128.212524:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac42f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1875336022367360:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788460128.212551:0:8449:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5dfa74784542abff 00000100:00080000:0.0:1788460128.212559:0:8449:0:(import.c:65:import_set_state_nolock()) ffff8c4bef373000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788460128.212595:0:8449:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:0.0:1788460128.212795:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac42f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3658:x1875336022367360:12345-0@lo:9:umount.0 Request processed in 272us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460128.212802:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788460128.212816:0:8449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788460128.212822:0:8449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac42f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3658:x1875336022367488:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788460128.212833:0:8449:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5dfa74784542ad87 00000100:00080000:0.0:1788460128.212838:0:8449:0:(import.c:65:import_set_state_nolock()) ffff8c4ac2bb1800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788460128.212859:0:8449:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:0.0:1788460128.212927:0:8449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac42f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3658:x1875336022367488:12345-0@lo:9:umount.0 Request processed in 105us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460128.212933:0:8449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00010000:0.0:1788460128.213094:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460128.213100:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788460128.213285:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c4bef685000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1788460128.213484:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788460128.213488:0:6529:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1788460128.213751:0:3658:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788460128.213755:0:3658:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788460128.213759:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4395180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1875336022367360:0@lo:9:umount.0 00000100:00080000:2.0:1788460128.213776:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c4bced6d000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788460128.213789:0:3658:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788460128.213791:0:3658:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788460128.213793:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4394380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1875336022367488:0@lo:9:umount.0 00000020:00080000:3.0:1788460128.219503:0:15423:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8c4bc4721988) has no exports 00000020:01000000:2.0:1788460128.277917:0:15423:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8c4bcec3ea20 - data ffff8c4beb7576c0/ffff8c4ac37f4400 00000020:01000000:2.0:1788460128.278087:0:15423:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8c4bf740ad20 - data ffff8c4beb62fa20/ffff8c4bf75edc00 00000001:00000004:2.0:1788460128.290246:0:15423:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:3.0:1788460128.351464:0:15423:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788460128.351473:0:15423:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:3.0:1788460128.351481:0:15423:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1788460128.354485:0:15423:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788460128.354492:0:15423:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:3.0:1788460128.354516:0:15423:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788460128.354519:0:15423:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788460128.355711:0:8823:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788460128.355717:0:8823:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:1.0:1788460128.355727:0:8823:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1788460128.356241:0:15423:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788460128.356245:0:15423:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:3.0:1788460128.356259:0:15423:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788460128.356261:0:15423:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788460128.357059:0:10056:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788460128.357063:0:10056:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:0.0:1788460128.357073:0:10056:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1788460128.359554:0:15423:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5dfa74784542aa00 00000020:00000080:3.0:1788460128.359566:0:15423:0:(genops.c:885:class_export_put()) final put ffff8c4c01996800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788460128.359981:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c4c01996800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788460128.361396:0:15423:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5dfa74784542aa15 00000020:00000080:3.0:1788460128.361408:0:15423:0:(genops.c:885:class_export_put()) final put ffff8c4c01997000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1788460128.361431:0:15423:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:3.0:1788460128.361436:0:15423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788460128.361451:0:15423:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788460128.361455:0:15423:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff8c4bc4724c98) has no exports 00000020:00000080:0.0:1788460128.361539:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c4c01997000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000004:01000000:3.0:1788460128.361864:0:15423:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788460128.361873:0:15423:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5dfa74784542ad80 00000020:00000080:3.0:1788460128.361879:0:15423:0:(genops.c:885:class_export_put()) final put ffff8c4ac35cd000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1788460128.361919:0:15423:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:3.0:1788460128.361923:0:15423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788460128.361931:0:15423:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788460128.361934:0:15423:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff8c4c019a1988) has no exports 00000020:00000080:3.0:1788460128.361940:0:15423:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5dfa74784542ad79 00000020:00000080:3.0:1788460128.361970:0:15423:0:(genops.c:885:class_export_put()) final put ffff8c4bced6e000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788460128.369690:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c4ac35cd000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00010000:01000000:3.0:1788460128.370170:0:15423:0:(obd_class.h:688:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:3.0:1788460128.370175:0:15423:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788460128.370179:0:15423:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:3.0:1788460128.370185:0:15423:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788460128.370188:0:15423:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788460128.370221:0:15423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788460128.370233:0:15423:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788460128.370241:0:15423:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5dfa74784542abf8 00000020:00000080:3.0:1788460128.370249:0:15423:0:(genops.c:885:class_export_put()) final put ffff8c4bff80a800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1788460128.370255:0:15423:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:3.0:1788460128.370263:0:15423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788460128.370269:0:15423:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788460128.370273:0:15423:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff8c4bef213310) has no exports 00000020:00000080:3.0:1788460128.370279:0:15423:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5dfa74784542abf1 00000020:00000080:3.0:1788460128.370283:0:15423:0:(genops.c:885:class_export_put()) final put ffff8c4bf762a800/lustre-MDT0001-osd_UUID 00010000:01000000:3.0:1788460128.370831:0:15423:0:(obd_class.h:688:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:3.0:1788460128.370835:0:15423:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788460128.370838:0:15423:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:3.0:1788460128.370842:0:15423:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788460128.370843:0:15423:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788460128.370871:0:15423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788460128.370885:0:15423:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:3.0:1788460128.370897:0:15423:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1788460128.370902:0:15423:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5dfa74784542aa38 00000020:00000080:3.0:1788460128.370907:0:15423:0:(genops.c:885:class_export_put()) final put ffff8c4bef373800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1788460128.370911:0:15423:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:3.0:1788460128.370914:0:15423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788460128.370917:0:15423:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788460128.370920:0:15423:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8c4bcec56620) has no exports 00000020:00000080:3.0:1788460128.370924:0:15423:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5dfa74784542aa31 00000020:00000080:3.0:1788460128.370926:0:15423:0:(genops.c:885:class_export_put()) final put ffff8c4bf6bc1000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788460128.371481:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c4bced6e000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1788460128.371492:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c4bced6d000 for lustre-OST0001-osc-MDT0001 00000020:00000080:0.0:1788460128.371508:0:36:0:(genops.c:885:class_export_put()) final put ffff8c4ac2be1800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788460128.371511:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c4ac2be1800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:0.0:1788460128.371515:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788460128.371586:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c4bff80a800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1788460128.371592:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c4bf762a800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1788460128.371596:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c4bef685000 for lustre-OST0000-osc-MDT0001 00000020:00000080:0.0:1788460128.371600:0:36:0:(genops.c:885:class_export_put()) final put ffff8c4ac1ec9800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788460128.371601:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c4ac1ec9800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:0.0:1788460128.371604:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788460128.371629:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c4bef373800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1788460128.371634:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c4bf6bc1000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1788460128.372669:0:15423:0:(obd_class.h:688:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1788460128.372675:0:15423:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788460128.372678:0:15423:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1788460128.372684:0:15423:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788460128.372724:0:15423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788460128.372733:0:15423:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788460128.372765:0:15423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788460128.372769:0:15423:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788460128.372773:0:15423:0:(genops.c:885:class_export_put()) final put ffff8c4bced6c800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788460128.372775:0:15423:0:(genops.c:844:class_export_destroy()) destroying export ffff8c4bced6c800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1788460128.372779:0:15423:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788460128.372921:0:15423:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5dfa74784542aa1c 00000020:00000080:0.0:1788460128.372928:0:15423:0:(genops.c:885:class_export_put()) final put ffff8c4c01995800/lustre-MDD0001_UUID 00000020:01000000:0.0:1788460128.372932:0:15423:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1788460128.372936:0:15423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788460128.372940:0:15423:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788460128.372963:0:15423:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff8c4c019a3310) has no exports 00000020:00000080:0.0:1788460128.372989:0:15423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788460128.372993:0:15423:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1788460128.372997:0:15423:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5dfa74784542aa23 00000020:00000080:0.0:1788460128.373000:0:15423:0:(genops.c:885:class_export_put()) final put ffff8c4c01990000/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1788460128.373008:0:15423:0:(tgt_mount.c:201:server_put_mount()) put mount ffff8c4bc438f000 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1788460128.373011:0:15423:0:(obd_mount.c:798:lustre_put_lsi()) put ffff8c4bc438f000 2 00000020:01000004:0.0:1788460128.373014:0:15423:0:(tgt_mount.c:134:server_deregister_mount()) deregister mount ffff8c4bc438f000 from lustre-MDT0001 00000020:00000080:0.0:1788460128.373030:0:15423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788460128.373033:0:15423:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1788460128.373035:0:15423:0:(genops.c:885:class_export_put()) final put ffff8c4c01992000/lustre-MDT0001_UUID 00000020:00000080:0.0:1788460128.373036:0:15423:0:(genops.c:844:class_export_destroy()) destroying export ffff8c4c01992000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1788460128.373042:0:15423:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1788460128.373071:0:15423:0:(obd_mount.c:666:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1788460128.373074:0:15423:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1788460128.373077:0:15423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788460128.373080:0:15423:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788460128.373086:0:15423:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff8c4bef21d000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788460128.373091:0:15423:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff8c4bef214c98) has exports, disconnecting them 00000020:00080000:0.0:1788460128.373095:0:15423:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff8c4bef21d000), last request at 1788459893 00000020:00000080:0.0:1788460128.373099:0:15423:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5dfa74784542aa77 00000020:00080000:0.0:1788460128.373108:0:15423:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c4bef21d000): rc 0 00000020:00000080:0.0:1788460128.373112:0:15423:0:(genops.c:885:class_export_put()) final put ffff8c4bef21d000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1788460128.374138:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c4bfa1bb800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1788460128.374149:0:36:0:(genops.c:885:class_export_put()) final put ffff8c4bf6bc7800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788460128.374152:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c4bf6bc7800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:1.0:1788460128.374158:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788460128.374253:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c4c01995800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:1.0:1788460128.374257:0:36:0:(genops.c:885:class_export_put()) final put ffff8c4c01995000/lustre-MDD0001_UUID 00000020:00000080:1.0:1788460128.374259:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c4c01995000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:1.0:1788460128.374262:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:1.0:1788460128.374444:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c4c01990000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788460128.374449:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c4bef21d000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:1.0:1788460128.375108:0:15423:0:(obd_class.h:688:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:1.0:1788460128.375112:0:15423:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788460128.375115:0:15423:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788460128.375121:0:15423:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788460128.375150:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c4bef21a000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1788460128.375291:0:15423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788460128.375298:0:15423:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:1.0:1788460128.375303:0:15423:0:(genops.c:885:class_export_put()) final put ffff8c4bef365000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:1.0:1788460128.375305:0:15423:0:(genops.c:844:class_export_destroy()) destroying export ffff8c4bef365000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:1.0:1788460128.375310:0:15423:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:1.0:1788460128.375361:0:15423:0:(obd_mount.c:798:lustre_put_lsi()) put ffff8c4bc438f000 1 00000020:00000080:1.0:1788460128.375366:0:15423:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5dfa74784542a9b3 00000020:00000080:1.0:1788460128.375371:0:15423:0:(genops.c:885:class_export_put()) final put ffff8c4bc473f000/lustre-MDT0001-osd_UUID 00000020:01000000:1.0:1788460128.375380:0:15423:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:1.0:1788460128.375387:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c4bc473f000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788460128.375396:0:15423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788460128.375401:0:15423:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788460128.375404:0:15423:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff8c4bd0b8cc98) has no exports 00000020:00000080:3.0:1788460128.517182:0:15423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788460128.517197:0:15423:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:3.0:1788460128.517202:0:15423:0:(genops.c:885:class_export_put()) final put ffff8c4bc438a800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788460128.517207:0:15423:0:(genops.c:844:class_export_destroy()) destroying export ffff8c4bc438a800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:3.0:1788460128.517217:0:15423:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:3.0:1788460128.517322:0:15423:0:(obd_mount.c:756:lustre_free_lsi()) Freeing lsi ffff8c4bc438c000 00000020:01000000:3.0:1788460128.517408:0:15423:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1788460128.517414:0:15423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788460128.517429:0:15423:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788460128.517434:0:15423:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff8c4bcec54c98) has no exports 00000100:00100000:3.0:1788460128.517536:0:6535:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff8c4bc6833000:6535] 2 exiting: rc = 0 00000100:00100000:3.0:1788460128.517632:0:6534:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff8c4bf3705e00:6534] 1 exiting: rc = 0 00000100:00100000:3.0:1788460128.517694:0:7760:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff8c4bf750e400:7760] 3 exiting: rc = 0 00000100:00100000:2.0:1788460128.519682:0:6533:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff8c4bc66a4200:6533] 0 exiting: rc = 1 00000100:00100000:2.0:1788460128.519777:0:13560:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff8c4ac37f9400:13560] 4 exiting: rc = 0 00000100:00100000:3.0:1788460128.519981:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.519991:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.519996:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.520001:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.520006:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.520011:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.520017:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.520022:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.520027:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.520032:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.520050:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.520056:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.520062:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.520067:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.520074:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.520080:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.520085:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.520089:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.520094:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.520100:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.520105:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.520109:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.520114:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.520119:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.520124:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.520130:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.520135:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.520140:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.520144:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.520149:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.520154:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.520160:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.520166:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.520171:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.520176:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.520181:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.520187:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.520192:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.520197:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.520203:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.520209:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.520214:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.520219:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.520224:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.520229:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.520242:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.520248:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.520254:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.520259:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.520263:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.520268:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.520273:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.520277:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.520282:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.520286:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.520292:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.520297:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.520302:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.520308:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.520313:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.520318:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.520323:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.520329:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.520334:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460128.523555:0:6537:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8c4bc5d29200:6537] 1 exiting: rc = 0 00000100:00100000:2.0:1788460128.523683:0:6536:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8c4bf3705c00:6536] 0 exiting: rc = 1 00000100:00100000:3.0:1788460128.524209:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.524218:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.524224:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.524231:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.524238:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.524244:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.524250:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.524255:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.524261:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.524267:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.524272:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.524278:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.524284:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.524289:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.524294:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.524300:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.524318:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.524323:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.524328:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.524334:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.525599:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.525617:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.525623:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.525628:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.525633:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.525638:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.525644:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.525649:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.525654:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.525658:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.525664:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.525669:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.525674:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.525679:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.525683:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.525688:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.525693:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.525697:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.525702:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.525706:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.525712:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.525716:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.525721:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.525726:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.525731:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.525735:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.525739:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.525744:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.525749:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.525754:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.525759:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.525781:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.525786:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.525791:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.525796:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.525802:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.525807:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.525812:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.525817:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.525823:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.525828:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.525834:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.525839:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.525845:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460128.526710:0:6538:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff8c4bd0b35800:6538] 0 exiting: rc = 1 00000100:00100000:2.0:1788460128.526801:0:14842:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff8c4bfadb4400:14842] 2 exiting: rc = 0 00000100:00100000:1.0:1788460128.526924:0:6539:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff8c4bd0b35e00:6539] 1 exiting: rc = 0 00000100:00100000:3.0:1788460128.527089:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.527105:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.527114:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.527130:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.527137:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.527143:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.527149:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.527155:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.527162:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.527168:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.527174:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.527180:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.527185:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.527190:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.527195:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.527216:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.527222:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.527228:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.527233:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.527238:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.527244:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.527250:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.527266:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.527272:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.527277:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.527283:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.527289:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.527308:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.527316:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.527321:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.527327:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.527333:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.527338:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.527472:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.527480:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.527487:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.527492:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.527499:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.527505:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.527525:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.527532:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.527538:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.527544:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.527550:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.527557:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.527563:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.527569:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.527575:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.527580:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.527585:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.527591:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.527611:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.527619:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.527624:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.527630:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.527636:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.527641:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.527654:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.527660:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.527665:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.527671:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.527677:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.527682:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.527689:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.543335:0:6541:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8c4bd0b35400:6541] 1 exiting: rc = 0 00000100:00100000:1.0:1788460128.543517:0:6540:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8c4bc6833400:6540] 0 exiting: rc = 1 00000100:00100000:3.0:1788460128.543979:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.543985:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.543990:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.543995:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.543999:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.544004:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.544008:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.544013:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.544017:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.544022:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.544026:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.544031:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.544035:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.544039:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.544043:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.544048:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.544052:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.544056:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.544061:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.544066:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.544071:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.544075:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.544079:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.544084:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.544089:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.544094:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.544099:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.544115:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.544120:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.544125:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.544130:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.544135:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.544140:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.544145:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.544150:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.544154:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.544159:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.544163:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.544168:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.544172:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.544177:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.544181:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.544185:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.544190:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.544195:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.544199:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.544203:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.544207:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.544212:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.544216:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.544221:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.544226:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.544230:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.544233:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.544237:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.544241:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.544245:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.544250:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.544254:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.544258:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.544262:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.544266:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.544277:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.544281:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.544659:0:6543:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8c4bc6830e00:6543] 1 exiting: rc = 0 00000100:00100000:1.0:1788460128.544924:0:6542:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8c4bc6830c00:6542] 0 exiting: rc = 1 00000100:00100000:3.0:1788460128.545257:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.545264:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.545268:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.545273:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.545278:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.545284:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.545289:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.545296:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.545301:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.545306:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.545312:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.545317:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.545322:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.545326:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.545332:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.545337:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.545354:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.545359:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.545364:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.545369:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.545374:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.545378:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.545383:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.545388:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.545393:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.545398:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.545403:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.545408:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.545413:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.545428:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.545435:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.545439:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.545456:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.545461:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.545466:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.545609:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.545614:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.545618:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.545623:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.545628:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.545632:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.545636:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.545641:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.545645:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.545649:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.545654:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.545658:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.545662:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.545667:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.545671:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.545675:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.545679:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.545683:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.545687:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.545692:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.545696:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.545700:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.545704:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.545708:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.545712:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.545716:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.545720:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.545724:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.545729:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460128.546495:0:6544:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff8c4bc6831e00:6544] 0 exiting: rc = 1 00000100:00100000:1.0:1788460128.546743:0:6545:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff8c4bc6830600:6545] 1 exiting: rc = 0 00000100:00100000:3.0:1788460128.546901:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.546907:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.546911:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.546924:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.546929:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.546934:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.546939:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.547253:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.547260:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.547265:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.547270:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.547276:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.547281:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.547286:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.547291:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.547296:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.547300:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.547305:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.547311:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.547316:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.547320:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.547326:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.547331:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.547336:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.547550:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.547557:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.547563:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.547568:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.547573:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.547577:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.547583:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.547587:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.547592:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.547596:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.547600:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.547605:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.547609:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.547613:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.547626:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.547631:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.547635:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.547640:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.547645:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.547649:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.547654:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.547658:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.547662:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.547667:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.547671:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.547675:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.547680:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.547685:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.547689:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.547694:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.547699:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.547703:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.547707:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.547712:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.547717:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.547721:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.547725:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.547729:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.547734:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788460128.547738:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460128.548765:0:6547:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff8c4bc6831200:6547] 1 exiting: rc = 0 00000100:00100000:1.0:1788460128.548985:0:6546:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff8c4bced31800:6546] 0 exiting: rc = 1 00000100:00100000:1.0:1788460128.549134:0:6548:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff8c4bced30600:6548] 2 exiting: rc = 0 00000100:00100000:2.0:1788460128.549279:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460128.549286:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460128.549292:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460128.549298:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460128.549314:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460128.549322:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460128.549327:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460128.549333:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460128.549339:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460128.549498:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460128.549504:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460128.549510:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460128.549515:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460128.549533:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460128.549539:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460128.549545:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460128.549550:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460128.549555:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460128.549561:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460128.549566:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460128.549572:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460128.549577:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460128.549583:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460128.549589:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460128.549594:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460128.549600:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460128.549606:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460128.549611:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460128.549632:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460128.549638:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460128.549643:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460128.549648:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460128.549653:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460128.549659:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460128.549665:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460128.549670:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460128.549676:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460128.549682:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460128.549688:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460128.549694:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460128.549699:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460128.549704:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460128.549710:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460128.549715:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460128.549721:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460128.549726:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460128.549732:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460128.549737:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460128.549751:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460128.549756:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460128.549762:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460128.549768:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460128.549787:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460128.549794:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460128.549800:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460128.549805:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460128.549810:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460128.549816:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460128.549822:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460128.549828:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460128.549833:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460128.549839:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460128.549845:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460128.549858:0:15423:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788460128.555127:0:15423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788460128.555139:0:15423:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1788460128.555145:0:15423:0:(genops.c:885:class_export_put()) final put ffff8c4bd1a86800/MDS_uuid 00000020:00000080:0.0:1788460128.555149:0:15423:0:(genops.c:844:class_export_destroy()) destroying export ffff8c4bd1a86800/MDS_uuid for MDS 00000020:01000000:0.0:1788460128.555155:0:15423:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1788460128.555283:0:15423:0:(tgt_mount.c:2315:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:0.0:1788460129.044738:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460130.066006:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788460130.898759:0:8:0:(pinger.c:236:ptlrpc_pinger_process_import()) 0cf73fe6-82e2-434e-b670-631647721b2c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788460130.898769:0:8:0:(pinger.c:254:ptlrpc_pinger_process_import()) 0cf73fe6-82e2-434e-b670-631647721b2c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788460130.898772:0:8:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788460130.898775:0:8:0:(pinger.c:244:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788460130.898780:0:8:0:(import.c:65:import_set_state_nolock()) ffff8c4bfc4c2000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788460130.898788:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 422 00000100:00080000:3.0:1788460130.898810:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788460130.898816:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8c4bfc4c2000 using connection 192.168.206.105@tcp/0@lo 00000100:00100000:3.0:1788460130.898847:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4ac4285880 x1875336022367744/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788460130.898913:0:8:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788460130.898918:0:8:0:(pinger.c:244:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788460130.898919:0:8:0:(import.c:65:import_set_state_nolock()) ffff8c4ac2be5800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788460130.898923:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 422 00000100:00080000:3.0:1788460130.898926:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788460130.898929:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8c4ac2be5800 using connection 192.168.206.105@tcp/0@lo 00000100:00100000:3.0:1788460130.898961:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4ac4284000 x1875336022368000/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788460130.899098:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4285f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1875336022368128:0@lo:400:kworker.0 00000400:00000100:1.0:1788460130.899147:0:3662:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875336022368128 offset 0 length 224: 4 00000100:00100000:1.0:1788460130.899211:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788460130.899217:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4286d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3662:1875336022367872:0@lo:400:kworker.0 00000400:00000100:1.0:1788460130.899236:0:3662:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875336022367872 offset 0 length 224: 4 00000100:00100000:2.0:1788460130.899316:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4285880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1875336022367744:0@lo:38:kworker.0 00000400:00000100:2.0:1788460130.899341:0:3658:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875336022367744 offset 0 length 520: 4 00000100:00100000:2.0:1788460130.899514:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4284000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1875336022368000:0@lo:38:kworker.0 00000400:00000100:2.0:1788460130.899534:0:3658:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875336022368000 offset 0 length 520: 4 00010000:00010000:0.0:1788460131.089626:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460132.114385:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788460132.363870:0:15624:0:(tgt_mount.c:2326:server_umount_begin()) umount -f 00000020:01000004:3.0:1788460132.379981:0:15624:0:(tgt_mount.c:2182:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1788460132.380028:0:15624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7000/0x5dfa74784542ae7c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ae83 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460132.380042:0:15624:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7000/0x5dfa74784542ae7c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542ae83 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460132.380049:0:15624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7000/0x5dfa74784542ae7c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x5dfa74784542ae83 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460132.380057:0:15624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7000/0x5dfa74784542ae7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x5dfa74784542ae83 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460132.380070:0:15624:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788460132.380085:0:15624:0:(mgc_request_server.c:165:mgc_fs_clear()) mgc192.168.206.105@tcp: clear lustre-client 10000000:01000000:3.0:1788460132.380097:0:15624:0:(mgc_request.c:651:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788460132.380118:0:15624:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788460132.380129:0:15624:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c4ac4285880 x1875336022367744/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788460145 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460132.380147:0:15624:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788460132.380153:0:15624:0:(pinger.c:405:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788460132.380159:0:15624:0:(import.c:65:import_set_state_nolock()) ffff8c4bfc4c2000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1788460132.380163:0:15624:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788460132.380167:0:15624:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c4ac4285880 x1875336022367744/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788460145 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460132.380175:0:15624:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788460132.380178:0:15624:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 17s for inflight to error out 00000100:00100000:1.0:1788460132.380311:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4285880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1875336022367744:0@lo:38:kworker.0 00010000:00010000:0.0:1788460132.381543:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788460132.381552:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7000/0x5dfa74784542ae7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x5dfa74784542ae83 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460132.381562:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bfadc7000 already unused, calling callback (ffffffffc125ae00) 10000000:00010000:0.0:1788460132.381566:0:6521:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7000/0x5dfa74784542ae7c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x5dfa74784542ae83 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460132.381575:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7000/0x5dfa74784542ae7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x5dfa74784542ae83 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788460132.381582:0:6521:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7000/0x5dfa74784542ae7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x5dfa74784542ae83 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788460132.381587:0:6521:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788460132.381590:0:6521:0:(mgc_request.c:1242:mgc_blocking_ast()) log lustre-client: stale lock, won't requeue 10000000:01000000:0.0:1788460132.381602:0:6521:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788460132.381638:0:6521:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8c4bd1a85000 00010000:00010000:0.0:1788460132.381643:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7000/0x5dfa74784542ae7c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000000 nid: local remote: 0x5dfa74784542ae83 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460132.381651:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7000/0x5dfa74784542ae7c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000000 nid: local remote: 0x5dfa74784542ae83 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460132.381664:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460132.381665:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460132.381667:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788460132.382548:0:15624:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788460132.382560:0:15624:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c4ac4286d80 x1875336022367872/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460146 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460132.382669:0:15624:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788460132.382675:0:15624:0:(pinger.c:405:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788460132.382698:0:15624:0:(import.c:65:import_set_state_nolock()) ffff8c4bfc4c5000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788460132.382822:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3658:1875336022368256:0@lo:39:umount.0 00000400:00000100:3.0:1788460132.382868:0:3658:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875336022368256 offset 0 length 224: 4 00000100:00100000:2.0:1788460132.383184:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4286d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3662:1875336022367872:0@lo:400:kworker.0 00000100:00080000:0.0:1788460132.945179:0:36:0:(pinger.c:236:ptlrpc_pinger_process_import()) 0cf73fe6-82e2-434e-b670-631647721b2c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788460132.945188:0:36:0:(pinger.c:254:ptlrpc_pinger_process_import()) 0cf73fe6-82e2-434e-b670-631647721b2c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788460132.945191:0:36:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788460132.945210:0:36:0:(pinger.c:254:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788460132.945334:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4397100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1875336022368384:0@lo:400:kworker.0 00000400:00000100:2.0:1788460132.945384:0:3659:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875336022368384 offset 0 length 224: 4 00010000:00010000:1.0:1788460133.138204:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788460133.972230:0:9527:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788460133.972239:0:9527:0:(genops.c:885:class_export_put()) final put ffff8c4ac2bb6000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788460133.972457:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c4ac2bb6000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788460133.972507:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c4ac2bb1800 for lustre-OST0001 00000001:00100000:0.0:1788460133.974129:0:8443:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788460133.974136:0:8443:0:(genops.c:885:class_export_put()) final put ffff8c4bc4739800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788460133.974201:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c4bc4739800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788460133.974242:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c4bef373000 for lustre-OST0000 00010000:00010000:0.0:1788460134.161172:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460135.185440:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788460135.953072:0:36:0:(pinger.c:236:ptlrpc_pinger_process_import()) 0cf73fe6-82e2-434e-b670-631647721b2c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788460135.953083:0:36:0:(pinger.c:254:ptlrpc_pinger_process_import()) 0cf73fe6-82e2-434e-b670-631647721b2c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788460135.953086:0:36:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788460135.953089:0:36:0:(pinger.c:254:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788460135.953198:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4394700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3660:1875336022368512:0@lo:400:kworker.0 00000400:00000100:3.0:1788460135.953247:0:3660:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875336022368512 offset 0 length 224: 4 00010000:00010000:0.0:1788460136.209123:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460137.234021:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460138.258423:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460138.513076:0:3658:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788460128/real 1788460128] req@ffff8c4ac4286300 x1875336022367616/t0(0) o250->mgc192.168.206.105@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788460138 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460138.513183:0:3658:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c4ac4286300 x1875336022367616/t0(0) o250->mgc192.168.206.105@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788460138 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788460138.513203:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c4bd1a85000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788460138.513228:0:3658:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1788460138.513251:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4286300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0cf73fe6-82e2-434e-b670-631647721b2c:3658:1875336022367616:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:2.0:1788460138.513392:0:36:0:(pinger.c:236:ptlrpc_pinger_process_import()) 0cf73fe6-82e2-434e-b670-631647721b2c->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788460138.513398:0:36:0:(pinger.c:244:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788460138.513400:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c4bd1a85000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788460138.513404:0:36:0:(import.c:545:import_select_connection()) mgc192.168.206.105@tcp: connect to NID 0@lo last attempt 425 00000100:00080000:2.0:1788460138.513409:0:36:0:(import.c:630:import_select_connection()) mgc192.168.206.105@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788460138.513415:0:36:0:(import.c:665:import_select_connection()) mgc192.168.206.105@tcp: import ffff8c4bd1a85000 using connection 192.168.206.105@tcp/0@lo 00000100:00100000:2.0:1788460138.513450:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4ac42f3100 x1875336022368640/t0(0) o250->mgc192.168.206.105@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788460138.513479:0:36:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788460138.513483:0:36:0:(pinger.c:254:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788460138.513531:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788460138.513544:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac42f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1875336022368768:0@lo:400:kworker.0 00000100:00100000:1.0:1788460138.513557:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac42f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0cf73fe6-82e2-434e-b670-631647721b2c:3658:1875336022368640:0@lo:250:kworker.0 00000400:00000100:2.0:1788460138.513593:0:3662:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875336022368768 offset 0 length 224: 4 00000400:00000100:1.0:1788460138.513594:0:3658:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875336022368640 offset 0 length 520: 4 00010000:00010000:1.0:1788460139.281252:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460140.308792:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460141.329798:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460142.353616:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788460142.609143:0:3658:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788460132/real 1788460132] req@ffff8c4ac1e63800 x1875336022368256/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788460142 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460142.609181:0:3658:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c4ac1e63800 x1875336022368256/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788460142 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788460142.609203:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c4bfc4c5000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788460142.609237:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3658:1875336022368256:0@lo:39:umount.0 00000100:00080000:2.0:1788460142.609412:0:15624:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788460142.609421:0:15624:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788460142.609430:0:15624:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788460142.610410:0:15624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac395fc00/0x5dfa74784542ae8a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ae91 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460142.610429:0:15624:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac395fc00/0x5dfa74784542ae8a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542ae91 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460142.610437:0:15624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac395fc00/0x5dfa74784542ae8a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x5dfa74784542ae91 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460142.610444:0:15624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mgc192.168.206.105@tcp lock: ffff8c4ac395fc00/0x5dfa74784542ae8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x5dfa74784542ae91 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460142.610472:0:15624:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788460142.610496:0:15624:0:(mgc_request_server.c:165:mgc_fs_clear()) mgc192.168.206.105@tcp: clear lustre-OST0000 00010000:00010000:2.0:1788460142.610502:0:15624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bc0030400/0x5dfa74784542ad1e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ad25 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460142.610510:0:15624:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bc0030400/0x5dfa74784542ad1e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542ad25 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460142.610536:0:15624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bc0030400/0x5dfa74784542ad1e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5dfa74784542ad25 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460142.610543:0:15624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mgc192.168.206.105@tcp lock: ffff8c4bc0030400/0x5dfa74784542ad1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5dfa74784542ad25 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460142.610561:0:15624:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788460142.610569:0:15624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0400/0x5dfa74784542b115 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542b11c expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460142.610576:0:15624:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0400/0x5dfa74784542b115 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542b11c expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460142.610582:0:15624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0400/0x5dfa74784542b115 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5dfa74784542b11c expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460142.610588:0:15624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0400/0x5dfa74784542b115 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5dfa74784542b11c expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460142.610608:0:15624:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:2.0:1788460142.610616:0:15624:0:(mgc_request_server.c:165:mgc_fs_clear()) mgc192.168.206.105@tcp: clear params 00010000:00010000:2.0:1788460142.610622:0:15624:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6c00/0x5dfa74784542ae98 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ae9f expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460142.610629:0:15624:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6c00/0x5dfa74784542ae98 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542ae9f expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460142.610635:0:15624:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6c00/0x5dfa74784542ae98 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x5dfa74784542ae9f expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460142.610648:0:15624:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6c00/0x5dfa74784542ae98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x5dfa74784542ae9f expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460142.610670:0:15624:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:3.0:1788460142.610714:0:9537:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788460142.610726:0:9537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: ffff8c4ac395fc00/0x5dfa74784542ae8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x5dfa74784542ae91 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788460142.610733:0:15624:0:(mgc_request_server.c:165:mgc_fs_clear()) mgc192.168.206.105@tcp: clear lustre-sptlrpc 10000000:01000000:2.0:1788460142.610742:0:15624:0:(mgc_request.c:651:config_log_end()) end config log lustre-OST0000 (0) 00010000:00010000:3.0:1788460142.610744:0:9537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac395fc00 already unused, calling callback (ffffffffc125ae00) 10000000:00010000:3.0:1788460142.610760:0:9537:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: ffff8c4ac395fc00/0x5dfa74784542ae8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x5dfa74784542ae91 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460142.610772:0:9537:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: ffff8c4ac395fc00/0x5dfa74784542ae8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x5dfa74784542ae91 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788460142.610774:0:15624:0:(tgt_mount.c:2232:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1788460142.610783:0:15624:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 10000000:00010000:3.0:1788460142.610786:0:9537:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: ffff8c4ac395fc00/0x5dfa74784542ae8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x5dfa74784542ae91 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1788460142.610790:0:15624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 10000000:01000000:3.0:1788460142.610797:0:9537:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000020:00000080:2.0:1788460142.610800:0:15624:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 10000000:01000000:3.0:1788460142.610803:0:9537:0:(mgc_request.c:1242:mgc_blocking_ast()) log lustre-OST0000: stale lock, won't requeue 00000020:00080000:2.0:1788460142.610808:0:15624:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff8c4ac1ef6620) has no exports 10000000:01000000:3.0:1788460142.610809:0:9537:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00000020:00080000:2.0:1788460142.610851:0:15624:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff8c4ac1ef6620) has no exports 00010000:00010000:3.0:1788460142.610878:0:9537:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8c4bd1a85000 00010000:00010000:3.0:1788460142.610885:0:9537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: ffff8c4ac395fc00/0x5dfa74784542ae8a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x5dfa74784542ae91 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460142.610892:0:9537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: ffff8c4ac395fc00/0x5dfa74784542ae8a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x5dfa74784542ae91 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460142.610906:0:9537:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788460142.610910:0:9537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: ffff8c4bc0030400/0x5dfa74784542ad1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5dfa74784542ad25 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460142.610924:0:9537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc0030400 already unused, calling callback (ffffffffc125ae00) 10000000:00010000:3.0:1788460142.610993:0:9537:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: ffff8c4bc0030400/0x5dfa74784542ad1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5dfa74784542ad25 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460142.611003:0:9537:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: ffff8c4bc0030400/0x5dfa74784542ad1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5dfa74784542ad25 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788460142.611009:0:9537:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: ffff8c4bc0030400/0x5dfa74784542ad1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5dfa74784542ad25 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788460142.611014:0:9537:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788460142.611017:0:9537:0:(mgc_request.c:1242:mgc_blocking_ast()) log lustre-mdtir: stale lock, won't requeue 10000000:01000000:3.0:1788460142.611019:0:9537:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1788460142.611057:0:9537:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8c4bd1a85000 00010000:00010000:3.0:1788460142.611061:0:9537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: ffff8c4bc0030400/0x5dfa74784542ad1e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x5dfa74784542ad25 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460142.611068:0:9537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: ffff8c4bc0030400/0x5dfa74784542ad1e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x5dfa74784542ad25 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460142.611078:0:9537:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788460142.611082:0:9537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0400/0x5dfa74784542b115 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5dfa74784542b11c expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460142.611088:0:9537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc14f0400 already unused, calling callback (ffffffffc125ae00) 10000000:00010000:3.0:1788460142.611091:0:9537:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0400/0x5dfa74784542b115 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5dfa74784542b11c expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460142.611098:0:9537:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0400/0x5dfa74784542b115 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5dfa74784542b11c expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788460142.611105:0:9537:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0400/0x5dfa74784542b115 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5dfa74784542b11c expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788460142.611116:0:9537:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788460142.611119:0:9537:0:(mgc_request.c:1242:mgc_blocking_ast()) log params: stale lock, won't requeue 10000000:01000000:3.0:1788460142.611121:0:9537:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788460142.611150:0:9537:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8c4bd1a85000 00010000:00010000:3.0:1788460142.611153:0:9537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0400/0x5dfa74784542b115 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x5dfa74784542b11c expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460142.611159:0:9537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0400/0x5dfa74784542b115 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x5dfa74784542b11c expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460142.611170:0:9537:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788460142.611173:0:9537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6c00/0x5dfa74784542ae98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5dfa74784542ae9f expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460142.611179:0:9537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bfadc6c00 already unused, calling callback (ffffffffc125ae00) 10000000:00010000:3.0:1788460142.611181:0:9537:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6c00/0x5dfa74784542ae98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5dfa74784542ae9f expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460142.611187:0:9537:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6c00/0x5dfa74784542ae98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x5dfa74784542ae9f expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788460142.611194:0:9537:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6c00/0x5dfa74784542ae98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x5dfa74784542ae9f expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788460142.611199:0:9537:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788460142.611201:0:9537:0:(mgc_request.c:1242:mgc_blocking_ast()) log lustre-sptlrpc: stale lock, won't requeue 10000000:01000000:3.0:1788460142.611203:0:9537:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1788460142.611238:0:9537:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8c4bd1a85000 00010000:00010000:3.0:1788460142.611241:0:9537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6c00/0x5dfa74784542ae98 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x5dfa74784542ae9f expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460142.611253:0:9537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6c00/0x5dfa74784542ae98 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x5dfa74784542ae9f expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460142.611262:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460142.611272:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460142.611275:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460142.611326:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460142.611723:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460142.612448:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788460142.616292:0:15624:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8c4ac390a420 - data ffff8c4ac2027ca8/ffff8c4ac3982400 00000020:01000000:2.0:1788460142.616512:0:15624:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8c4bc5414f00 - data ffff8c4beb6851b0/ffff8c4bfc43f000 00100000:10000000:2.0:1788460142.627629:0:15624:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788460142.640654:0:15624:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5dfa74784542ab50 00000020:00000080:2.0:1788460142.640676:0:15624:0:(genops.c:885:class_export_put()) final put ffff8c4bfa3cc000/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1788460142.640703:0:15624:0:(tgt_mount.c:201:server_put_mount()) put mount ffff8c4bef21b800 from lustre-OST0000, refs=2 00000020:01000004:2.0:1788460142.640708:0:15624:0:(obd_mount.c:798:lustre_put_lsi()) put ffff8c4bef21b800 2 00000020:01000004:2.0:1788460142.640712:0:15624:0:(tgt_mount.c:134:server_deregister_mount()) deregister mount ffff8c4bef21b800 from lustre-OST0000 00000020:00000080:0.0:1788460142.640745:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c4bfa3cc000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1788460142.640753:0:15624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788460142.640765:0:15624:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1788460142.641052:0:15624:0:(genops.c:885:class_export_put()) final put ffff8c4bef374000/lustre-OST0000_UUID 00000020:00000080:2.0:1788460142.641057:0:15624:0:(genops.c:844:class_export_destroy()) destroying export ffff8c4bef374000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1788460142.641066:0:15624:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1788460142.641253:0:15624:0:(obd_mount.c:666:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1788460142.641284:0:15624:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788460142.641288:0:15624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788460142.641295:0:15624:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788460142.641307:0:15624:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8c4bfc4c1800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788460142.641314:0:15624:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff8c4ac1ef3310) has exports, disconnecting them 00000020:00080000:0.0:1788460142.641321:0:15624:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8c4bfc4c1800), last request at 1788459912 00000020:00000080:0.0:1788460142.641326:0:15624:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5dfa74784542ab88 00000020:00080000:0.0:1788460142.641337:0:15624:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c4bfc4c1800): rc 0 00000020:00000080:0.0:1788460142.641372:0:15624:0:(genops.c:885:class_export_put()) final put ffff8c4bfc4c1800/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788460142.641520:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c4bfc4c1800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1788460142.644119:0:15624:0:(obd_class.h:688:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1788460142.644134:0:15624:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788460142.644140:0:15624:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788460142.644149:0:15624:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788460142.644259:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c4bfc4c2000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788460142.662382:0:15624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788460142.662405:0:15624:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1788460142.662413:0:15624:0:(genops.c:885:class_export_put()) final put ffff8c4bfa3c8800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1788460142.662418:0:15624:0:(genops.c:844:class_export_destroy()) destroying export ffff8c4bfa3c8800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1788460142.662431:0:15624:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:3.0:1788460142.662510:0:15624:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1788460142.662514:0:15624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788460142.662519:0:15624:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788460142.662526:0:15624:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff8c4bfc4c7800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788460142.662532:0:15624:0:(genops.c:1553:class_disconnect_exports()) OBD device 20 (ffff8c4ac1ef0000) has exports, disconnecting them 00000020:00080000:3.0:1788460142.662539:0:15624:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff8c4bfc4c7800), last request at 1788459912 00000020:00000080:3.0:1788460142.662543:0:15624:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5dfa74784542ab9d 00000020:00080000:3.0:1788460142.662559:0:15624:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c4bfc4c7800): rc 0 00000020:00000080:3.0:1788460142.662564:0:15624:0:(genops.c:885:class_export_put()) final put ffff8c4bfc4c7800/lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1788460142.662580:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c4bfc4c7800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:3.0:1788460142.663447:0:15624:0:(obd_class.h:688:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:3.0:1788460142.663454:0:15624:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788460142.663459:0:15624:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788460142.663466:0:15624:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788460142.663495:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c4bfc4c5000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1788460142.664117:0:15624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788460142.664128:0:15624:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:1.0:1788460142.664133:0:15624:0:(genops.c:885:class_export_put()) final put ffff8c4bfc4c6000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:1.0:1788460142.664137:0:15624:0:(genops.c:844:class_export_destroy()) destroying export ffff8c4bfc4c6000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:1.0:1788460142.664147:0:15624:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:1.0:1788460142.664214:0:15624:0:(obd_mount.c:798:lustre_put_lsi()) put ffff8c4bef21b800 1 00000020:00000080:1.0:1788460142.664221:0:15624:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5dfa74784542ab18 00000020:00000080:1.0:1788460142.664227:0:15624:0:(genops.c:885:class_export_put()) final put ffff8c4bef362000/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1788460142.664241:0:15624:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1788460142.664244:0:15624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788460142.664247:0:15624:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788460142.664251:0:15624:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff8c4bef211988) has no exports 00000020:00000080:2.0:1788460142.664731:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c4bef362000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1788460142.700515:0:15624:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788460142.700534:0:15624:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1788460142.700542:0:15624:0:(genops.c:885:class_export_put()) final put ffff8c4bef21b000/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1788460142.700548:0:15624:0:(genops.c:844:class_export_destroy()) destroying export ffff8c4bef21b000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1788460142.700564:0:15624:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1788460142.700716:0:15624:0:(obd_mount.c:756:lustre_free_lsi()) Freeing lsi ffff8c4bef21c800 00000020:02000400:0.0:1788460142.701205:0:15624:0:(tgt_mount.c:2315:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1788460143.377584:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788460143.699745:0:8:0:(pinger.c:236:ptlrpc_pinger_process_import()) 0cf73fe6-82e2-434e-b670-631647721b2c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788460143.699751:0:8:0:(pinger.c:254:ptlrpc_pinger_process_import()) 0cf73fe6-82e2-434e-b670-631647721b2c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788460143.699753:0:8:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788460143.699755:0:8:0:(pinger.c:254:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788460143.701772:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4396680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1875336022368896:0@lo:400:kworker.0 00000400:00000100:3.0:1788460143.701835:0:3662:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875336022368896 offset 0 length 224: 4 00010000:00010000:0.0:1788460144.402091:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460145.428356:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788460145.686029:0:3658:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788460130/real 1788460130] req@ffff8c4ac4284000 x1875336022368000/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788460145 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460145.686059:0:3658:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c4ac4284000 x1875336022368000/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788460145 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788460145.686083:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c4ac2be5800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788460145.686106:0:3658:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788460145.686110:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4284000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1875336022368000:0@lo:38:kworker.0 00000100:00080000:3.0:1788460145.686136:0:8:0:(pinger.c:236:ptlrpc_pinger_process_import()) 0cf73fe6-82e2-434e-b670-631647721b2c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788460145.686141:0:8:0:(pinger.c:254:ptlrpc_pinger_process_import()) 0cf73fe6-82e2-434e-b670-631647721b2c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788460145.686144:0:8:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788460145.686147:0:8:0:(pinger.c:244:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788460145.686150:0:8:0:(import.c:65:import_set_state_nolock()) ffff8c4ac2be5800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788460145.686156:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 428 00000100:00080000:3.0:1788460145.686161:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788460145.686167:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8c4ac2be5800 using connection 192.168.206.105@tcp/0@lo 00000100:00100000:3.0:1788460145.686197:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4ac4286300 x1875336022369024/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788460145.686279:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4286a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1875336022369152:0@lo:400:kworker.0 00000400:00000100:3.0:1788460145.686322:0:3659:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875336022369152 offset 0 length 224: 4 00000100:00100000:1.0:1788460145.686426:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4286300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1875336022369024:0@lo:38:kworker.0 00000400:00000100:1.0:1788460145.686449:0:3658:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875336022369024 offset 0 length 520: 4 00000020:01000004:0.0:1788460146.379599:0:15826:0:(tgt_mount.c:2326:server_umount_begin()) umount -f 00000020:01000004:0.0:1788460146.406067:0:15826:0:(tgt_mount.c:2182:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1788460146.406150:0:15826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac395e600/0x5dfa74784542ae52 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ae59 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460146.406165:0:15826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac395e600/0x5dfa74784542ae52 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542ae59 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460146.406172:0:15826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac395e600/0x5dfa74784542ae52 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5dfa74784542ae59 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460146.406179:0:15826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mgc192.168.206.105@tcp lock: ffff8c4ac395e600/0x5dfa74784542ae52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5dfa74784542ae59 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460146.406202:0:15826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788460146.406220:0:15826:0:(mgc_request_server.c:165:mgc_fs_clear()) mgc192.168.206.105@tcp: clear lustre-client 10000000:01000000:0.0:1788460146.406237:0:15826:0:(mgc_request.c:651:config_log_end()) end config log lustre-client (0) 00010000:00010000:1.0:1788460146.406405:0:9536:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788460146.406414:0:9536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: ffff8c4ac395e600/0x5dfa74784542ae52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5dfa74784542ae59 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460146.406421:0:9536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac395e600 already unused, calling callback (ffffffffc125ae00) 10000000:00010000:1.0:1788460146.406432:0:9536:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: ffff8c4ac395e600/0x5dfa74784542ae52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5dfa74784542ae59 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460146.406440:0:9536:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: ffff8c4ac395e600/0x5dfa74784542ae52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5dfa74784542ae59 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788460146.406448:0:9536:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: ffff8c4ac395e600/0x5dfa74784542ae52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5dfa74784542ae59 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788460146.406453:0:9536:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788460146.406456:0:9536:0:(mgc_request.c:1242:mgc_blocking_ast()) log lustre-client: stale lock, won't requeue 10000000:01000000:1.0:1788460146.406458:0:9536:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788460146.406510:0:9536:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8c4bd1a85000 00010000:00010000:1.0:1788460146.406514:0:9536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: ffff8c4ac395e600/0x5dfa74784542ae52 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5dfa74784542ae59 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460146.406523:0:9536:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: ffff8c4ac395e600/0x5dfa74784542ae52 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5dfa74784542ae59 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460146.406535:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460146.406536:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460146.406538:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788460146.406586:0:15826:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788460146.406598:0:15826:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c4ac4286300 x1875336022369024/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788460165 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460146.406620:0:15826:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788460146.406753:0:15826:0:(pinger.c:405:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788460146.406759:0:15826:0:(import.c:65:import_set_state_nolock()) ffff8c4ac2be5800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1788460146.406764:0:15826:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788460146.406769:0:15826:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c4ac4286300 x1875336022369024/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788460165 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460146.406776:0:15826:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788460146.406779:0:15826:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 25s for inflight to error out 00000100:00100000:1.0:1788460146.406846:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4286300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1875336022369024:0@lo:38:kworker.0 00000100:00080000:0.0:1788460146.408205:0:15826:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788460146.408216:0:15826:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c4ac4285f80 x1875336022368128/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460146 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460146.408296:0:15826:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c4bc4397100 x1875336022368384/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460148 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460146.408318:0:15826:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c4bc4394700 x1875336022368512/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460151 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460146.408344:0:15826:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c4ac42f3800 x1875336022368768/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460154 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460146.408353:0:15826:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c4bc4396680 x1875336022368896/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460159 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460146.408361:0:15826:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c4ac4286a00 x1875336022369152/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460161 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460146.408367:0:15826:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788460146.408371:0:15826:0:(pinger.c:405:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1788460146.408401:0:15826:0:(import.c:65:import_set_state_nolock()) ffff8c4ac3845000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788460146.409432:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4286a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1875336022369152:0@lo:400:kworker.0 00000100:00100000:1.0:1788460146.409443:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4397100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3659:1875336022368384:0@lo:400:kworker.0 00000100:00100000:1.0:1788460146.409480:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4395f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3658:1875336022369280:0@lo:39:umount.0 00000400:00000100:1.0:1788460146.409524:0:3658:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875336022369280 offset 0 length 224: 4 00000100:00100000:2.0:1788460146.409638:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4394700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3660:1875336022368512:0@lo:400:kworker.0 00000100:00100000:3.0:1788460146.411857:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4285f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1875336022368128:0@lo:400:kworker.0 00000100:00100000:3.0:1788460146.412336:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4396680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1875336022368896:0@lo:400:kworker.0 00000100:00100000:3.0:1788460146.412346:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac42f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1875336022368768:0@lo:400:kworker.0 00010000:00010000:1.0:1788460146.449167:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460147.473432:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460148.504421:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460149.521150:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460150.549123:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788460150.866318:0:8:0:(pinger.c:236:ptlrpc_pinger_process_import()) 0cf73fe6-82e2-434e-b670-631647721b2c->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788460150.866327:0:8:0:(pinger.c:254:ptlrpc_pinger_process_import()) 0cf73fe6-82e2-434e-b670-631647721b2c->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1788460151.569246:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460152.593916:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788460153.553904:0:3658:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788460138/real 1788460138] req@ffff8c4ac42f3100 x1875336022368640/t0(0) o250->mgc192.168.206.105@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788460153 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460153.553936:0:3658:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c4ac42f3100 x1875336022368640/t0(0) o250->mgc192.168.206.105@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788460153 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788460153.553971:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c4bd1a85000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788460153.553996:0:3658:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1788460153.554000:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac42f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0cf73fe6-82e2-434e-b670-631647721b2c:3658:1875336022368640:0@lo:250:kworker.0 00000100:00080000:2.0:1788460153.554232:0:36:0:(pinger.c:236:ptlrpc_pinger_process_import()) 0cf73fe6-82e2-434e-b670-631647721b2c->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788460153.554237:0:36:0:(pinger.c:244:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788460153.554240:0:36:0:(import.c:65:import_set_state_nolock()) ffff8c4bd1a85000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788460153.554245:0:36:0:(import.c:545:import_select_connection()) mgc192.168.206.105@tcp: connect to NID 0@lo last attempt 435 00000100:00080000:2.0:1788460153.554250:0:36:0:(import.c:630:import_select_connection()) mgc192.168.206.105@tcp: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788460153.554256:0:36:0:(import.c:665:import_select_connection()) mgc192.168.206.105@tcp: import ffff8c4bd1a85000 using connection 192.168.206.105@tcp/0@lo 00000100:00100000:2.0:1788460153.554302:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4ac42f1180 x1875336022369408/t0(0) o250->mgc192.168.206.105@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788460153.554377:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac42f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0cf73fe6-82e2-434e-b670-631647721b2c:3658:1875336022369408:0@lo:250:kworker.0 00000400:00000100:1.0:1788460153.554417:0:3658:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875336022369408 offset 0 length 520: 4 00010000:00010000:1.0:1788460153.617432:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460154.641224:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460155.666521:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788460156.625147:0:3658:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788460146/real 1788460146] req@ffff8c4bc4395f80 x1875336022369280/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788460156 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460156.625189:0:3658:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c4bc4395f80 x1875336022369280/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788460156 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788460156.625212:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c4ac3845000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788460156.625239:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4395f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3658:1875336022369280:0@lo:39:umount.0 00000100:00080000:0.0:1788460156.625366:0:15826:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788460156.625372:0:15826:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788460156.625379:0:15826:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788460156.626455:0:15826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bef208800/0x5dfa74784542ae60 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ae67 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460156.626474:0:15826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bef208800/0x5dfa74784542ae60 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542ae67 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460156.626483:0:15826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bef208800/0x5dfa74784542ae60 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5dfa74784542ae67 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460156.626490:0:15826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mgc192.168.206.105@tcp lock: ffff8c4bef208800/0x5dfa74784542ae60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5dfa74784542ae67 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460156.628409:0:15826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788460156.628448:0:15826:0:(mgc_request_server.c:165:mgc_fs_clear()) mgc192.168.206.105@tcp: clear lustre-OST0001 00010000:00010000:0.0:1788460156.628461:0:15826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bef209200/0x5dfa74784542ad02 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ad09 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460156.628475:0:15826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bef209200/0x5dfa74784542ad02 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542ad09 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460156.628504:0:15826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bef209200/0x5dfa74784542ad02 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5dfa74784542ad09 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460156.628510:0:15826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mgc192.168.206.105@tcp lock: ffff8c4bef209200/0x5dfa74784542ad02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5dfa74784542ad09 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460156.630164:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788460156.630180:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: ffff8c4bef208800/0x5dfa74784542ae60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5dfa74784542ae67 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460156.630193:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bef208800 already unused, calling callback (ffffffffc125ae00) 10000000:00010000:2.0:1788460156.630198:0:6521:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: ffff8c4bef208800/0x5dfa74784542ae60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5dfa74784542ae67 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460156.630210:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: ffff8c4bef208800/0x5dfa74784542ae60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5dfa74784542ae67 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788460156.630218:0:6521:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: ffff8c4bef208800/0x5dfa74784542ae60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5dfa74784542ae67 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788460156.630225:0:6521:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788460156.630229:0:6521:0:(mgc_request.c:1242:mgc_blocking_ast()) log lustre-OST0001: stale lock, won't requeue 00010000:00010000:2.0:1788460156.630247:0:6521:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8c4bd1a85000 00010000:00010000:2.0:1788460156.630252:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: ffff8c4bef208800/0x5dfa74784542ae60 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x5dfa74784542ae67 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460156.630260:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: ffff8c4bef208800/0x5dfa74784542ae60 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x5dfa74784542ae67 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460156.630379:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788460156.630384:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: ffff8c4bef209200/0x5dfa74784542ad02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5dfa74784542ad09 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460156.630390:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bef209200 already unused, calling callback (ffffffffc125ae00) 10000000:00010000:2.0:1788460156.630394:0:6521:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: ffff8c4bef209200/0x5dfa74784542ad02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5dfa74784542ad09 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460156.630402:0:6521:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: ffff8c4bef209200/0x5dfa74784542ad02 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x5dfa74784542ad09 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788460156.630409:0:6521:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: ffff8c4bef209200/0x5dfa74784542ad02 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x5dfa74784542ad09 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788460156.630415:0:6521:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1788460156.630418:0:6521:0:(mgc_request.c:1249:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:2.0:1788460156.630424:0:6521:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8c4bd1a85000 00010000:00010000:2.0:1788460156.630427:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: ffff8c4bef209200/0x5dfa74784542ad02 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x5dfa74784542ad09 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460156.630433:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460156.630435:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460156.630437:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460156.631457:0:15826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788460156.631472:0:15826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: ffff8c4bef209200/0x5dfa74784542ad02 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x5dfa74784542ad09 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788460156.631495:0:15826:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1788460156.631548:0:15826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0200/0x5dfa74784542b107 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542b10e expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460156.631558:0:15826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0200/0x5dfa74784542b107 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542b10e expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460156.631567:0:15826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0200/0x5dfa74784542b107 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5dfa74784542b10e expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460156.631575:0:15826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0200/0x5dfa74784542b107 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5dfa74784542b10e expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460156.634371:0:9536:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788460156.634391:0:9536:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0200/0x5dfa74784542b107 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5dfa74784542b10e expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460156.634405:0:9536:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc14f0200 already unused, calling callback (ffffffffc125ae00) 10000000:00010000:1.0:1788460156.634410:0:9536:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0200/0x5dfa74784542b107 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5dfa74784542b10e expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460156.634447:0:9536:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0200/0x5dfa74784542b107 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x5dfa74784542b10e expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788460156.634455:0:9536:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0200/0x5dfa74784542b107 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x5dfa74784542b10e expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788460156.634462:0:9536:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788460156.634465:0:9536:0:(mgc_request.c:1249:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1788460156.634484:0:9536:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8c4bd1a85000 00010000:00010000:1.0:1788460156.634488:0:9536:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0200/0x5dfa74784542b107 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x5dfa74784542b10e expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460156.634502:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460156.634504:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460156.634506:0:9536:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460156.634887:0:15826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788460156.634898:0:15826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0200/0x5dfa74784542b107 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x5dfa74784542b10e expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788460156.634939:0:15826:0:(mgc_request_server.c:165:mgc_fs_clear()) mgc192.168.206.105@tcp: clear params 10000000:01000000:0.0:1788460156.634981:0:15826:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788460156.635451:0:15826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac395fa00/0x5dfa74784542ae6e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542ae75 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460156.635463:0:15826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac395fa00/0x5dfa74784542ae6e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542ae75 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460156.635472:0:15826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac395fa00/0x5dfa74784542ae6e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5dfa74784542ae75 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460156.635480:0:15826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mgc192.168.206.105@tcp lock: ffff8c4ac395fa00/0x5dfa74784542ae6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5dfa74784542ae75 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460156.635538:0:9537:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788460156.635545:0:9537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: ffff8c4ac395fa00/0x5dfa74784542ae6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5dfa74784542ae75 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460156.635553:0:9537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac395fa00 already unused, calling callback (ffffffffc125ae00) 10000000:00010000:1.0:1788460156.635557:0:9537:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: ffff8c4ac395fa00/0x5dfa74784542ae6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5dfa74784542ae75 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460156.635566:0:9537:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: ffff8c4ac395fa00/0x5dfa74784542ae6e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x5dfa74784542ae75 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788460156.635573:0:9537:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: ffff8c4ac395fa00/0x5dfa74784542ae6e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x5dfa74784542ae75 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788460156.635578:0:9537:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788460156.635589:0:9537:0:(mgc_request.c:1249:mgc_blocking_ast()) log lustre-sptlrpc: stopping, won't requeue 00010000:00010000:1.0:1788460156.635598:0:9537:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8c4bd1a85000 00010000:00010000:1.0:1788460156.635602:0:9537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: ffff8c4ac395fa00/0x5dfa74784542ae6e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x5dfa74784542ae75 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460156.635610:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460156.635612:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460156.635614:0:9537:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460156.635748:0:15826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788460156.635753:0:15826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: ffff8c4ac395fa00/0x5dfa74784542ae6e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x5dfa74784542ae75 expref: -99 pid: 6530 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788460156.635816:0:15826:0:(mgc_request_server.c:165:mgc_fs_clear()) mgc192.168.206.105@tcp: clear lustre-sptlrpc 10000000:01000000:0.0:1788460156.635820:0:15826:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 10000000:01000000:0.0:1788460156.635849:0:15826:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:0.0:1788460156.635869:0:15826:0:(mgc_request.c:651:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1788460156.635895:0:15826:0:(tgt_mount.c:2232:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1788460156.635900:0:15826:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1788460156.635907:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788460156.635914:0:15826:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788460156.635919:0:15826:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff8c4c019a0000) has no exports 00000020:00080000:0.0:1788460156.636022:0:15826:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff8c4c019a0000) has no exports 00010000:00010000:3.0:1788460156.636811:0:6522:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788460156.647820:0:15826:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8c4bcec3e780 - data ffff8c4ac2026870/ffff8c4ac2bd9c00 00000020:01000000:0.0:1788460156.650292:0:15826:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8c4bf76b0960 - data ffff8c4ac20e0d80/ffff8c4ac2bba800 00100000:10000000:2.0:1788460156.671629:0:15826:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1788460156.682329:0:15826:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5dfa74784542aca0 00000020:00000080:1.0:1788460156.682345:0:15826:0:(genops.c:885:class_export_put()) final put ffff8c4ac2be2800/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1788460156.682368:0:15826:0:(tgt_mount.c:201:server_put_mount()) put mount ffff8c4bfc4e5800 from lustre-OST0001, refs=2 00000020:01000004:1.0:1788460156.682373:0:15826:0:(obd_mount.c:798:lustre_put_lsi()) put ffff8c4bfc4e5800 2 00000020:01000004:1.0:1788460156.682377:0:15826:0:(tgt_mount.c:134:server_deregister_mount()) deregister mount ffff8c4bfc4e5800 from lustre-OST0001 00000020:00000080:1.0:1788460156.682422:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788460156.682435:0:15826:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1788460156.682439:0:15826:0:(genops.c:885:class_export_put()) final put ffff8c4c01991000/lustre-OST0001_UUID 00000020:00000080:1.0:1788460156.682443:0:15826:0:(genops.c:844:class_export_destroy()) destroying export ffff8c4c01991000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1788460156.682455:0:15826:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:1.0:1788460156.682597:0:15826:0:(pinger.c:405:ptlrpc_pinger_del_import()) removing pingable import 0cf73fe6-82e2-434e-b670-631647721b2c->MGS 00010000:00010000:1.0:1788460156.682616:0:15826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: ffff8c4bc0031400/0x5dfa74784542a9cf lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5dfa74784542a9d6 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788460156.682630:0:15826:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: ffff8c4bc0031400/0x5dfa74784542a9cf lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5dfa74784542a9d6 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788460156.682637:0:15826:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1788460156.682640:0:15826:0:(mgc_request.c:1259:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1788460156.682644:0:15826:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1788460156.682706:0:15826:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8c4bd1a85000 00010000:00010000:1.0:1788460156.682711:0:15826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: ffff8c4bc0031400/0x5dfa74784542a9cf lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5dfa74784542a9d6 expref: -99 pid: 7463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788460156.682753:0:15826:0:(import.c:65:import_set_state_nolock()) ffff8c4bd1a85000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1788460156.682758:0:15826:0:(mgc_request.c:1476:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788460156.682761:0:15826:0:(pinger.c:200:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788460156.682763:0:15826:0:(mgc_request.c:1476:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788460156.682773:0:15826:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788460156.682787:0:15826:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8c4ac42f1180 x1875336022369408/t0(0) o250->mgc192.168.206.105@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788460173 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788460156.682813:0:15826:0:(mgc_request.c:1476:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788460156.682817:0:15826:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 22s for inflight to error out 00000100:00100000:0.0:1788460156.682967:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac42f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0cf73fe6-82e2-434e-b670-631647721b2c:3658:1875336022369408:0@lo:250:kworker.0 00000020:00000080:2.0:1788460156.683138:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c4ac2be2800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 10000000:01000000:1.0:1788460156.683186:0:15826:0:(mgc_request.c:1476:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788460156.683194:0:15826:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5dfa74784542a8cc 00000020:00000080:1.0:1788460156.683200:0:15826:0:(genops.c:885:class_export_put()) final put ffff8c4bd1a87800/0cf73fe6-82e2-434e-b670-631647721b2c 00000020:01000000:1.0:1788460156.683215:0:15826:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of mgc192.168.206.105@tcp (flags='') 00000020:00000080:1.0:1788460156.683220:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788460156.683227:0:15826:0:(obd_config.c:956:class_cleanup()) mgc192.168.206.105@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788460156.683232:0:15826:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff8c4bcec50000) has no exports 00000020:00000080:2.0:1788460156.684280:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c4bd1a87800/0cf73fe6-82e2-434e-b670-631647721b2c for mgc192.168.206.105@tcp 00010000:00010000:2.0:1788460156.689095:0:6521:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788460156.689328:0:6530:0:(mgc_request.c:989:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1788460156.689517:0:15826:0:(obd_class.h:688:obd_cleanup_client_import()) mgc192.168.206.105@tcp: client import never connected 00000100:00080000:1.0:1788460156.689523:0:15826:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1788460156.689528:0:15826:0:(mgc_request.c:1476:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788460156.689533:0:15826:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1788460156.689536:0:15826:0:(mgc_request.c:1476:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788460156.689621:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788460156.689633:0:15826:0:(obd_config.c:883:class_detach()) detach on obd mgc192.168.206.105@tcp (uuid 0cf73fe6-82e2-434e-b670-631647721b2c) 00000020:01000000:1.0:1788460156.689645:0:15826:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1788460156.689651:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788460156.689658:0:15826:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788460156.689668:0:15826:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8c4ac2be4000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788460156.689686:0:15826:0:(genops.c:1553:class_disconnect_exports()) OBD device 25 (ffff8c4c019a4c98) has exports, disconnecting them 00000020:00080000:1.0:1788460156.689691:0:15826:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8c4ac2be4000), last request at 1788459931 00000020:00000080:1.0:1788460156.689698:0:15826:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5dfa74784542acd8 00000020:00080000:1.0:1788460156.689727:0:15826:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c4ac2be4000): rc 0 00000020:00000080:1.0:1788460156.689734:0:15826:0:(genops.c:885:class_export_put()) final put ffff8c4ac2be4000/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1788460156.690737:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c4bd1a85000 for mgc192.168.206.105@tcp 00000020:00000080:2.0:1788460156.690762:0:36:0:(genops.c:885:class_export_put()) final put ffff8c4bd1a83800/0cf73fe6-82e2-434e-b670-631647721b2c 00000020:00000080:2.0:1788460156.690766:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c4bd1a83800/0cf73fe6-82e2-434e-b670-631647721b2c for mgc192.168.206.105@tcp 00000020:01000000:2.0:1788460156.690776:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd mgc192.168.206.105@tcp (0cf73fe6-82e2-434e-b670-631647721b2c) 00010000:01000000:0.0:1788460156.691532:0:15826:0:(obd_class.h:688:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1788460156.691539:0:15826:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788460156.691543:0:15826:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788460156.691552:0:15826:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788460156.691984:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c4ac2be4000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1788460156.692001:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c4ac2be5800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1788460156.692730:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788460156.692743:0:15826:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1788460156.692751:0:15826:0:(genops.c:885:class_export_put()) final put ffff8c4ac2be4800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1788460156.692756:0:15826:0:(genops.c:844:class_export_destroy()) destroying export ffff8c4ac2be4800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1788460156.692770:0:15826:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:0.0:1788460156.692845:0:15826:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1788460156.692850:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788460156.692855:0:15826:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788460156.692864:0:15826:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff8c4ac3847800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788460156.692871:0:15826:0:(genops.c:1553:class_disconnect_exports()) OBD device 26 (ffff8c4ac1ef4c98) has exports, disconnecting them 00000020:00080000:0.0:1788460156.692876:0:15826:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff8c4ac3847800), last request at 1788459931 00000020:00000080:0.0:1788460156.692881:0:15826:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5dfa74784542aced 00000020:00080000:0.0:1788460156.692898:0:15826:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8c4ac3847800): rc 0 00000020:00000080:0.0:1788460156.692913:0:15826:0:(genops.c:885:class_export_put()) final put ffff8c4ac3847800/lustre-MDT0001-lwp-OST0001 00000020:00000080:2.0:1788460156.694984:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8c4ac3847800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:2.0:1788460156.710068:0:15826:0:(obd_class.h:688:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:2.0:1788460156.710088:0:15826:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788460156.710093:0:15826:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788460156.710100:0:15826:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788460156.710135:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8c4ac3845000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:1.0:1788460156.711285:0:9536:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1788460156.711465:0:9537:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1788460156.714036:0:6522:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:2.0:1788460156.714290:0:6521:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:0.0:1788460156.715403:0:10353:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff8c4bfac57400:10353] 2 exiting: rc = 0 00000100:00100000:0.0:1788460156.715546:0:6517:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8c4bc3884e00:6517] 1 exiting: rc = 0 00000100:00100000:2.0:1788460156.716346:0:6516:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8c4bc3885800:6516] 0 exiting: rc = 1 00000100:00100000:2.0:1788460156.716442:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.716690:0:6518:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8c4bc3885000:6518] 0 exiting: rc = 1 00000100:00100000:2.0:1788460156.716759:0:6520:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8c4be0b2c600:6520] 2 exiting: rc = 0 00000100:00100000:2.0:1788460156.719485:0:6519:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8c4be0b2da00:6519] 1 exiting: rc = 0 00000100:00100000:2.0:1788460156.719648:0:9549:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff8c4ac35e9600:9549] 4 exiting: rc = 0 00000100:00100000:3.0:1788460156.719753:0:9538:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8c4bfadb8a00:9538] 3 exiting: rc = 0 00000100:00100000:2.0:1788460156.722229:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.722240:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.722246:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.722252:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.722258:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.722265:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.722281:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.722287:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.722292:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.722298:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.722303:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.722321:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.722327:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.722333:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.722338:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.722349:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.722356:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.722362:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.722368:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.722374:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.722380:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.722387:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.722394:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.722400:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.722405:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.722410:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.722414:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.722419:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.722424:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.722429:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.722434:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.722439:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.722443:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.722448:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.722453:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.722458:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.722463:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.722467:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.722472:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.722477:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.722482:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.722487:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.722492:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.722497:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.722502:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.722507:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.722517:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.722522:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.722527:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.722532:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.722537:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.722542:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.722546:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.722551:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.722556:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.722561:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.722566:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.722570:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.722575:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.722579:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.722584:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.722588:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.722593:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.722598:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788460156.727205:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788460156.727219:0:15826:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:2.0:1788460156.727224:0:15826:0:(genops.c:885:class_export_put()) final put ffff8c4ac3841000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:2.0:1788460156.727229:0:15826:0:(genops.c:844:class_export_destroy()) destroying export ffff8c4ac3841000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:2.0:1788460156.727234:0:15826:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:2.0:1788460156.730591:0:15826:0:(obd_mount.c:798:lustre_put_lsi()) put ffff8c4bfc4e5800 1 00000020:00000080:2.0:1788460156.730605:0:15826:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x5dfa74784542ac6f 00000020:00000080:2.0:1788460156.730614:0:15826:0:(genops.c:885:class_export_put()) final put ffff8c4ac2a1d000/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1788460156.730632:0:15826:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1788460156.730650:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8c4ac2a1d000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1788460156.730669:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788460156.730676:0:15826:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788460156.730860:0:15826:0:(genops.c:1558:class_disconnect_exports()) OBD device 23 (ffff8c4bd0b8e620) has no exports 00000020:00000080:2.0:1788460156.796566:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788460156.796580:0:15826:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1788460156.796598:0:15826:0:(genops.c:885:class_export_put()) final put ffff8c4bfc4e6800/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1788460156.796603:0:15826:0:(genops.c:844:class_export_destroy()) destroying export ffff8c4bfc4e6800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1788460156.796609:0:15826:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1788460156.797135:0:15826:0:(obd_mount.c:756:lustre_free_lsi()) Freeing lsi ffff8c4bfc4e0800 00000020:01000000:2.0:1788460156.797167:0:15826:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1788460156.797172:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788460156.797176:0:15826:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788460156.797180:0:15826:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff8c4bef216620) has no exports 00000020:00000080:2.0:1788460156.797399:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788460156.797408:0:15826:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1788460156.797411:0:15826:0:(genops.c:885:class_export_put()) final put ffff8c4bef364800/OSS_uuid 00000020:00000080:2.0:1788460156.797414:0:15826:0:(genops.c:844:class_export_destroy()) destroying export ffff8c4bef364800/OSS_uuid for OSS 00000020:01000000:2.0:1788460156.797418:0:15826:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:2.0:1788460156.797500:0:8448:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff8c4bfa300e00:8448] 0 exiting: rc = 1 00000100:00100000:2.0:1788460156.798155:0:8832:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff8c4ac1eddc00:8832] 3 exiting: rc = 0 00000100:00080000:1.0:1788460156.799011:0:6529:0:(pinger.c:555:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1788460156.799452:0:8449:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff8c4bfa301200:8449] 1 exiting: rc = 0 00000100:00100000:3.0:1788460156.799606:0:8450:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff8c4bfa301c00:8450] 2 exiting: rc = 0 00000100:00100000:2.0:1788460156.799843:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.799853:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.799877:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.799885:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.799890:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.799895:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.799899:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.799905:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.799910:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.799914:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.799919:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.799925:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.799930:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.799936:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.799941:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.800555:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.800561:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.800567:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.800572:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.800591:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.800597:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.800604:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.800610:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.800615:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.800630:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.800637:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.800643:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.800648:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.800658:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.800664:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.800670:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.800675:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.800680:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.800748:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.800756:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.800767:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.800774:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.800779:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.800784:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.800788:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.800793:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.800798:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.800804:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.800809:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.800814:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.800820:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.800826:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.800831:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.800836:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.800841:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.800855:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.800861:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.800867:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.800872:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.800884:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.800889:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.800895:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.800900:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.800905:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.800910:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.800915:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.800920:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.800927:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.800932:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788460156.804827:0:14841:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff8c4bfadb4600:14841] 2 exiting: rc = 0 00000100:00100000:2.0:1788460156.804934:0:8452:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8c4bf7539c00:8452] 1 exiting: rc = 0 00000100:00100000:2.0:1788460156.805338:0:8451:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8c4bf7538200:8451] 0 exiting: rc = 1 00000100:00100000:1.0:1788460156.805649:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.805662:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.805670:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.805678:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.805685:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.805693:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.805701:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.805711:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.805717:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.805729:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.805736:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.805742:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.805747:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.805754:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.805760:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.805766:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.805771:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.805778:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.805784:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.805789:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.805795:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.805801:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.805806:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.805812:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.805818:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.805824:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.805830:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.805835:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.805841:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.805862:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.806358:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.806365:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.806371:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.806377:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.806423:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.806430:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.806437:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.806442:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.806449:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.806455:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.806462:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.806468:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.806474:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.806479:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.806486:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.806492:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.806498:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.806503:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.806509:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.806515:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.806521:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.806527:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.806533:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.806539:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.806545:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.806551:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.806557:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.806563:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.806569:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.806574:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.806580:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.806586:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.806592:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.806598:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.809459:0:8453:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8c4bf7538600:8453] 0 exiting: rc = 1 00000100:00100000:2.0:1788460156.809490:0:8455:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8c4bf74fd800:8455] 2 exiting: rc = 0 00000100:00100000:2.0:1788460156.810005:0:8454:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8c4bfa1aac00:8454] 1 exiting: rc = 0 00000100:00100000:1.0:1788460156.810483:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.810496:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.810504:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.810511:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.810530:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.810538:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.810546:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.810555:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.810563:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.810573:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.810582:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.810592:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.810599:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.810606:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.810612:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.810618:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.810625:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.810638:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.810644:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.810650:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.810658:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.810666:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.810676:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.810686:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.810695:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.810701:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.810707:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.810715:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.810743:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.810752:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.810759:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.810766:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.810775:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.810782:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.810802:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.810809:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.810816:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.810822:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.810829:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.810837:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.810843:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.810850:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.810857:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.810864:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.810871:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.810876:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.810883:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.810889:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.810895:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.810901:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.810907:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.810914:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.810935:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.810941:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.811050:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.811056:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.811062:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.811068:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.811075:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.811087:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.811098:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.811107:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.811115:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.811126:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460156.819059:0:8457:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8c4bf753f400:8457] 1 exiting: rc = 0 00000100:00100000:0.0:1788460156.819201:0:8456:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8c4bf753ea00:8456] 0 exiting: rc = 1 00000100:00100000:1.0:1788460156.819295:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.819305:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.819369:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.819574:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.819582:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.819605:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.819611:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.819618:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.819623:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.819629:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.819635:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.819641:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.819647:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.819653:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.819659:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.819666:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.819672:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.819679:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.819685:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.819691:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.819696:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.819701:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.819708:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.819714:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.819720:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.819726:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.819732:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.819739:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.819745:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.819751:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.819757:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.819764:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.819771:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.819778:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.819784:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.819790:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.819796:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.819802:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.819809:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.819815:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.819828:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.819835:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.819840:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.819846:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.819852:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.819858:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.819981:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.819990:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.819996:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.820004:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.820010:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.820016:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.820032:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.820042:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.820048:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.820054:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.820059:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.820065:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.820071:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.820077:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.820083:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.820089:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.820095:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.820102:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788460156.822238:0:8458:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8c4bfadab600:8458] 0 exiting: rc = 1 00000100:00100000:3.0:1788460156.824620:0:8459:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8c4bcec5fc00:8459] 1 exiting: rc = 0 00000100:00100000:1.0:1788460156.825096:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.825121:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.825131:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.825137:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.825144:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.825151:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.825532:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.825544:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.825552:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.825562:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.825570:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.825594:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.825601:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.825608:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.825615:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.825622:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.825628:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.825635:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.825660:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.825668:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.825675:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.825682:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.825689:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.825696:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.825702:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.825709:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.825718:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.825726:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.825733:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.825740:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.825770:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.825782:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.825789:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.825797:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.825807:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.825816:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.825826:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.825836:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.825845:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.825856:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.825983:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.825993:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.826041:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.826055:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.826064:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.826071:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.826087:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.826094:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.826102:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.826112:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.826121:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.826131:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.826138:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.826146:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.826487:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.826500:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.826506:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.826513:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.826519:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.826525:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.826531:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.826537:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.826545:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788460156.826559:0:15826:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1788460156.842637:0:15826:0:(tgt_mount.c:2315:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1788460175.813470:0:16591:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg605-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788460185.339277:0:17191:0:(obd_mount.c:1011:lmd_print()) mount data: 00000020:01000004:3.0:1788460185.339282:0:17191:0:(obd_mount.c:1014:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1788460185.339291:0:17191:0:(obd_mount.c:1017:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1788460185.339399:0:17191:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8c4ac428f800 00000020:01000004:3.0:1788460185.339414:0:17191:0:(tgt_mount.c:2642:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1788460185.339422:0:17191:0:(obd_mount.c:308:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788460185.339435:0:17191:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8c4bef210000) 00000020:00000080:3.0:1788460185.339448:0:17191:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788460185.439263:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788460185.440390:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1788460185.445649:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1788460185.446164:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:3.0:1788460185.446439:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1788460185.446999:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:3.0:1788460185.447335:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:3.0:1788460185.447780:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:0.0:1788460185.452632:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1788460185.453624:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1788460185.454843:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:0.0:1788460185.455322:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1788460185.455791:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1788460185.456611:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:0.0:1788460185.456834:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1788460185.457147:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1788460185.457462:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:1.0:1788460185.460319:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1788460185.460798:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1788460185.461205:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1788460185.461457:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:1.0:1788460185.461990:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:1.0:1788460185.462285:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1788460185.462597:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1788460185.462965:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:1.0:1788460185.463249:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:1.0:1788460185.463590:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1788460185.464062:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:1.0:1788460185.464510:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1788460185.464848:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:1.0:1788460185.465173:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1788460185.465370:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:1.0:1788460185.465665:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:1.0:1788460185.466705:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:1.0:1788460185.467504:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1788460185.468166:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:1.0:1788460185.468426:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:1.0:1788460185.468771:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1788460185.469074:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:1.0:1788460185.469351:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:1.0:1788460185.469601:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1788460185.470106:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1788460185.470605:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1788460185.471649:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:1.0:1788460185.472212:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:1.0:1788460185.472407:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1788460185.479683:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:1.0:1788460185.483811:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:1.0:1788460185.485075:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:1.0:1788460185.485400:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:1.0:1788460185.486936:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:1.0:1788460185.487607:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:1.0:1788460185.488217:0:17191:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:01000000:1.0:1788460185.488708:0:17191:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788460185.488923:0:17191:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1788460185.488931:0:17191:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788460185.488998:0:17191:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5dfa74784542bf2a 00000020:01000004:1.0:1788460185.489004:0:17191:0:(tgt_mount.c:2727:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1788460185.489010:0:17191:0:(tgt_mount.c:234:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1788460185.489015:0:17191:0:(tgt_mount.c:115:server_register_mount()) register mount ffff8c4ac428f800 from MGS 00000020:01000004:1.0:1788460185.489019:0:17191:0:(obd_mount.c:308:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1788460185.489029:0:17191:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8c4ac1ef0000) 00000020:00000080:1.0:1788460185.489236:0:17191:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1788460185.489296:0:17191:0:(tgt_mount.c:167:server_get_mount()) get mount ffff8c4ac428f800 from MGS, refs=2 00080000:01000000:1.0:1788460185.489301:0:17191:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788460185.489306:0:17191:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5dfa74784542bf38 00000100:00100000:1.0:1788460185.489397:0:17191:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1788460185.489523:0:17191:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1788460185.489529:0:17191:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1788460185.494808:0:17191:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1788460185.494823:0:17191:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788460185.495843:0:17191:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788460185.496166:0:17191:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788460185.496171:0:17191:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788460185.498306:0:17191:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788460185.498319:0:17191:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1788460185.499267:0:17191:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1788460185.499276:0:17191:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1788460185.500651:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460185.500656:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460185.500658:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460185.501331:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460185.501334:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460185.501336:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460185.502614:0:17191:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1788460185.503105:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1788460185.507177:0:17191:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:0.0:1788460185.508001:0:17203:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788460185.508066:0:17191:0:(mgs_nids.c:693:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788460185.508102:0:17191:0:(mgs_llog.c:690:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788460185.508737:0:17191:0:(mgs_llog.c:690:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788460185.509238:0:17191:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788460185.509389:0:17191:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788460185.509396:0:17191:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1788460185.510051:0:17191:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1788460185.510059:0:17191:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788460185.510478:0:17191:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788460185.510485:0:17191:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1788460185.511311:0:17191:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1788460185.511331:0:17191:0:(obd_mount.c:496:lustre_start_mgc()) Start MGC 'mgc192.168.206.105@tcp' 00000020:01000004:1.0:1788460185.511333:0:17191:0:(obd_mount.c:505:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1788460185.511361:0:17191:0:(obd_mount.c:308:lustre_start_simple()) Starting OBD mgc192.168.206.105@tcp (typ=mgc) 00000020:00000080:1.0:1788460185.511373:0:17191:0:(genops.c:413:class_newdev()) Allocate new device mgc192.168.206.105@tcp (ffff8c4ac1ef1988) 00000020:00000080:1.0:1788460185.511387:0:17191:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1788460185.511461:0:17191:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c4ac4843000@mgc192.168.206.105@tcp: add connection 192.168.206.105@tcp at head 00000100:00080000:0.0:1788460185.511619:0:17207:0:(pinger.c:473:ping_evictor_main()) Starting Ping Evictor 00010000:00010000:1.0:1788460185.512223:0:17191:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mgc192.168.206.105@tcp-0 is initialized 00000040:01000000:1.0:1788460185.512231:0:17191:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.206.105@tcp ctxt 1 is initialized 10000000:01000000:1.0:1788460185.513180:0:17208:0:(mgc_request.c:900:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1788460185.516648:0:17191:0:(obd_config.c:826:class_setup()) finished setup of obd mgc192.168.206.105@tcp (uuid c482be18-c056-4068-8a37-ed5038fc364a) 00000020:00000080:0.0:1788460185.516674:0:17191:0:(genops.c:1385:class_connect()) connect: client c482be18-c056-4068-8a37-ed5038fc364a, cookie 0x5dfa74784542bf46 00000100:00080000:0.0:1788460185.516686:0:17191:0:(import.c:545:import_select_connection()) mgc192.168.206.105@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788460185.516693:0:17191:0:(import.c:665:import_select_connection()) mgc192.168.206.105@tcp: import ffff8c4ac4843000 using connection 192.168.206.105@tcp/0@lo 00000100:00100000:0.0:1788460185.516728:0:17191:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4bc4395500 x1875336022369536/t0(0) o250->mgc192.168.206.105@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788460185.516759:0:17191:0:(pinger.c:380:ptlrpc_pinger_add_import()) adding pingable import c482be18-c056-4068-8a37-ed5038fc364a->MGS 00000020:01000004:0.0:1788460185.516786:0:17191:0:(tgt_mount.c:1939:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788460185.516792:0:17191:0:(obd_mount.c:308:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1788460185.516807:0:17191:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8c4c019a4c98) 00000020:00000080:0.0:1788460185.516819:0:17191:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1788460185.516984:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4395500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c482be18-c056-4068-8a37-ed5038fc364a:3658:1875336022369536:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788460185.517061:0:3658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460185.517145:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022369536 00000100:00100000:1.0:1788460185.517153:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022369536 00000100:00100000:1.0:1788460185.517188:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788460185.517194:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4133450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3658:x1875336022369536:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1788460185.517215:0:17204:0:(ldlm_lib.c:1461:target_handle_connect()) MGS: connection from c482be18-c056-4068-8a37-ed5038fc364a@0@lo t0 exp 0000000000000000 cur 482 last 0 00000020:00000080:1.0:1788460185.517235:0:17204:0:(genops.c:1385:class_connect()) connect: client c482be18-c056-4068-8a37-ed5038fc364a, cookie 0x5dfa74784542bf54 00000100:00080000:1.0:1788460185.517353:0:17204:0:(import.c:65:import_set_state_nolock()) ffff8c4ac4841000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788460185.517400:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4133450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+5:3658:x1875336022369536:12345-0@lo:250:mount.lustre.0 Request processed in 204us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460185.517408:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788460185.517445:0:3658:0:(client.c:3126:ptlrpc_free_committed()) mgc192.168.206.105@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1788460185.517452:0:3658:0:(import.c:1176:ptlrpc_connect_interpret()) mgc192.168.206.105@tcp: connect to target with instance 0 00000100:00080000:1.0:1788460185.517458:0:3658:0:(import.c:1000:ptlrpc_connect_set_flags()) mgc192.168.206.105@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1788460185.517462:0:3658:0:(mgc_request.c:1476:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1788460185.517465:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c4ac4843000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1788460185.517467:0:3658:0:(mgc_request.c:1476:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1788460185.517474:0:3658:0:(pinger.c:193:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1788460185.517479:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4395500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c482be18-c056-4068-8a37-ed5038fc364a:3658:1875336022369536:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788460185.530603:0:17191:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788460185.530793:0:17191:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788460185.530799:0:17191:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1788460185.538730:0:17191:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1788460185.538747:0:17191:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1788460185.539304:0:17191:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1788460185.539311:0:17191:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1788460185.540033:0:17191:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788460185.540237:0:17191:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1788460185.540243:0:17191:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1788460185.541727:0:17191:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788460185.541807:0:17191:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1788460185.577292:0:17191:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788460185.577483:0:17191:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1788460185.577489:0:17191:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1788460185.579141:0:17191:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1788460185.579170:0:17191:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1788460185.579839:0:17191:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788460185.580266:0:17191:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788460185.580271:0:17191:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1788460185.580732:0:17191:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788460185.580739:0:17191:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1788460185.581599:0:17191:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788460185.581735:0:17191:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788460185.581740:0:17191:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1788460185.582573:0:17191:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788460185.582582:0:17191:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1788460185.583350:0:17191:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788460185.583507:0:17191:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788460185.583583:0:17191:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1788460185.584247:0:17191:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788460185.584254:0:17191:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1788460185.603222:0:17191:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788460185.603419:0:17191:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788460185.603427:0:17191:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1788460185.605173:0:17191:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788460185.605186:0:17191:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1788460185.606196:0:17191:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788460185.606295:0:17191:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1788460185.607345:0:17191:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1788460185.607390:0:17191:0:(tgt_mount.c:1519:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.105@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1788460185.607394:0:17191:0:(tgt_mount.c:1239:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788460185.607396:0:17191:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788460185.607397:0:17191:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788460185.607398:0:17191:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:2.0:1788460185.607399:0:17191:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788460185.607401:0:17191:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788460185.607402:0:17191:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788460185.607404:0:17191:0:(tgt_mount.c:1250:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788460185.607405:0:17191:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788460185.607410:0:17191:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788460185.607414:0:17191:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1788460185.607416:0:17191:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788460185.607418:0:17191:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788460185.607419:0:17191:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788460185.607420:0:17191:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:2.0:1788460185.607420:0:17191:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788460185.607421:0:17191:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788460185.607422:0:17191:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788460185.607423:0:17191:0:(tgt_mount.c:1250:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788460185.607424:0:17191:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788460185.607425:0:17191:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788460185.607452:0:17191:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788460185.607469:0:17191:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac42f0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:17191:1875336022369664:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788460185.607621:0:17191:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460185.607705:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bd18086c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788460185.607753:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022369664 00000100:00100000:1.0:1788460185.607761:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022369664 00000100:00100000:1.0:1788460185.607850:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788460185.607860:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4131c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+5:17191:x1875336022369664:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788460185.607916:0:17206:0:(mgs_llog.c:690:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788460185.607919:0:17206:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788460185.607922:0:17206:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1788460185.608369:0:17227:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788460185.608907:0:17206:0:(mgs_nids.c:693:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:0.0:1788460185.610587:0:17228:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1788460185.610593:0:17228:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:0.0:1788460185.610596:0:17228:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1788460185.610599:0:17228:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1788460185.610807:0:17228:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:0.0:1788460185.611027:0:17206:0:(mgs_llog.c:690:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788460185.611092:0:17206:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788460185.612844:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4131c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+5:17191:x1875336022369664:12345-0@lo:253:mount.lustre.0 Request processed in 4980us (5218us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460185.612857:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788460185.613096:0:17191:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac42f0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:17191:1875336022369664:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788460185.613122:0:17191:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788460185.613126:0:17191:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788460185.613127:0:17191:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788460185.613129:0:17191:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788460185.613130:0:17191:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:2.0:1788460185.613131:0:17191:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788460185.613132:0:17191:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788460185.613133:0:17191:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788460185.613135:0:17191:0:(tgt_mount.c:1250:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788460185.613136:0:17191:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788460185.613137:0:17191:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788460185.613154:0:17191:0:(tgt_mount.c:115:server_register_mount()) register mount ffff8c4ac428f800 from lustre-MDT0000 10000000:01000000:2.0:1788460185.613182:0:17191:0:(mgc_request.c:2423:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788460185.613185:0:17191:0:(mgc_request.c:424:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788460185.613188:0:17191:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8c4ac428f800 10000000:01000000:2.0:1788460185.613193:0:17191:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788460185.613217:0:17191:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-sptlrpc-ffff8c4ac428f800 from 1 10000000:01000000:2.0:1788460185.613220:0:17191:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788460185.613255:0:17191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6200/0x5dfa74784542bf5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460185.613275:0:17191:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6200/0x5dfa74784542bf5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460185.613285:0:17191:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6200/0x5dfa74784542bf5b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460185.613305:0:17191:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac42f0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:17191:1875336022369792:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788460185.613343:0:17191:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460185.613372:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bd1808300 going to sleep for 11 seconds 00000100:00100000:3.0:1788460185.613625:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022369792 00000100:00100000:3.0:1788460185.613631:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022369792 00000100:00100000:3.0:1788460185.613671:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788460185.613679:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4131850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+5:17191:x1875336022369792:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788460185.613691:0:17206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460185.613704:0:17206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4bc29d3a00/0x5dfa74784542bf62 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542bf5b expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460185.613725:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bc29d3a00/0x5dfa74784542bf62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542bf5b expref: 6 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460185.613736:0:17206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4bc29d3a00/0x5dfa74784542bf62 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542bf5b expref: 6 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460185.613744:0:17206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc29d3a00, rc 0) 00000100:00100000:3.0:1788460185.613785:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4131850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+6:17191:x1875336022369792:12345-0@lo:101:mount.lustre.0 Request processed in 106us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460185.613792:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788460185.613903:0:17191:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac42f0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:17191:1875336022369792:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788460185.613916:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6200/0x5dfa74784542bf5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542bf62 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460185.613924:0:17191:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6200/0x5dfa74784542bf5b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542bf62 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460185.613977:0:17191:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e60a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:17191:1875336022369920:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788460185.614003:0:17191:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460185.614017:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc389de40 going to sleep for 11 seconds 00000100:00100000:3.0:1788460185.614077:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022369920 00000100:00100000:3.0:1788460185.614081:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022369920 00000100:00100000:3.0:1788460185.614098:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788460185.614103:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4130c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+6:17191:x1875336022369920:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788460185.614186:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4130c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+6:17191:x1875336022369920:12345-0@lo:501:mount.lustre.0 Request processed in 82us (181us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788460185.614193:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788460185.614288:0:17191:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e60a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:17191:1875336022369920:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788460185.614301:0:17191:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788460185.614310:0:17191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6200/0x5dfa74784542bf5b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542bf62 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460185.614318:0:17191:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6200/0x5dfa74784542bf5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542bf62 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788460185.614324:0:17191:0:(mgc_request.c:206:do_config_log_add()) do adding config log params-ffff8c4ac428f800 10000000:01000000:1.0:1788460185.614348:0:17191:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788460185.614367:0:17191:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-barrier-ffff8c4ac428f800 10000000:01000000:1.0:1788460185.614370:0:17191:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788460185.614395:0:17191:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-barrier-ffff8c4ac428f800 from 1 10000000:01000000:1.0:1788460185.614398:0:17191:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788460185.614415:0:17191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac3676000/0x5dfa74784542bf69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460185.614423:0:17191:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4ac3676000/0x5dfa74784542bf69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460185.614430:0:17191:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4ac3676000/0x5dfa74784542bf69 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460185.614443:0:17191:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e60a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:17191:1875336022370048:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788460185.614468:0:17191:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460185.614499:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc389de40 going to sleep for 11 seconds 00000100:00100000:3.0:1788460185.614693:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022370048 00000100:00100000:3.0:1788460185.614698:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022370048 00000100:00100000:3.0:1788460185.614727:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788460185.614733:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4130050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+6:17191:x1875336022370048:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788460185.614741:0:17206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460185.614755:0:17206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4bc29d2400/0x5dfa74784542bf70 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542bf69 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460185.614771:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bc29d2400/0x5dfa74784542bf70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542bf69 expref: 7 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460185.614780:0:17206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4bc29d2400/0x5dfa74784542bf70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542bf69 expref: 7 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460185.614787:0:17206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc29d2400, rc 0) 00000100:00100000:3.0:1788460185.614823:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4130050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+7:17191:x1875336022370048:12345-0@lo:101:mount.lustre.0 Request processed in 90us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460185.614829:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788460185.614994:0:17191:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e60a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:17191:1875336022370048:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788460185.615004:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4ac3676000/0x5dfa74784542bf69 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542bf70 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460185.615011:0:17191:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4ac3676000/0x5dfa74784542bf69 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542bf70 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788460185.615023:0:17191:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788460185.615040:0:17191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac3676000/0x5dfa74784542bf69 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542bf70 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460185.615048:0:17191:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4ac3676000/0x5dfa74784542bf69 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542bf70 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788460185.615061:0:17191:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788460185.615075:0:17191:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788460185.615098:0:17191:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-mdtir-ffff8c4ac428f800 10000000:01000000:1.0:1788460185.615101:0:17191:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788460185.615134:0:17191:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788460185.615137:0:17191:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788460185.615152:0:17191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac3676e00/0x5dfa74784542bf77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460185.615159:0:17191:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4ac3676e00/0x5dfa74784542bf77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460185.615166:0:17191:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4ac3676e00/0x5dfa74784542bf77 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460185.615178:0:17191:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e60a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:17191:1875336022370176:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788460185.615205:0:17191:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460185.615222:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc389de40 going to sleep for 11 seconds 00000100:00100000:3.0:1788460185.615321:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022370176 00000100:00100000:3.0:1788460185.615326:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022370176 00000100:00100000:3.0:1788460185.615347:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788460185.615353:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4133850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+7:17191:x1875336022370176:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788460185.615360:0:17206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460185.615368:0:17206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4bc29d3400/0x5dfa74784542bf7e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542bf77 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460185.615382:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bc29d3400/0x5dfa74784542bf7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542bf77 expref: 8 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460185.615390:0:17206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4bc29d3400/0x5dfa74784542bf7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542bf77 expref: 8 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460185.615397:0:17206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc29d3400, rc 0) 00000100:00100000:3.0:1788460185.615433:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4133850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+8:17191:x1875336022370176:12345-0@lo:101:mount.lustre.0 Request processed in 80us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460185.615449:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788460185.615627:0:17191:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e60a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:17191:1875336022370176:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788460185.615639:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4ac3676e00/0x5dfa74784542bf77 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542bf7e expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460185.615645:0:17191:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4ac3676e00/0x5dfa74784542bf77 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542bf7e expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460185.615675:0:17191:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e60a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:17191:1875336022370304:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788460185.615698:0:17191:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460185.615732:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc389de40 going to sleep for 11 seconds 00000100:00100000:3.0:1788460185.615775:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022370304 00000100:00100000:3.0:1788460185.615779:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022370304 00000100:00100000:3.0:1788460185.615842:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788460185.615848:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4132450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+8:17191:x1875336022370304:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788460185.615984:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4132450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+9:17191:x1875336022370304:12345-0@lo:501:mount.lustre.0 Request processed in 136us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460185.615990:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788460185.616059:0:17191:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e60a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:17191:1875336022370304:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788460185.616081:0:17191:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e60a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:17191:1875336022370432:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788460185.616128:0:17191:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460185.616379:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc389de40 going to sleep for 11 seconds 00000100:00100000:2.0:1788460185.616423:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022370432 00000100:00100000:2.0:1788460185.616428:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022370432 00000100:00100000:2.0:1788460185.616450:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788460185.616456:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4132850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+9:17191:x1875336022370432:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788460185.617298:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4132850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+9:17191:x1875336022370432:12345-0@lo:503:mount.lustre.0 Request processed in 838us (1166us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460185.617307:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788460185.617397:0:17191:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e60a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:17191:1875336022370432:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788460185.617793:0:17229:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac42f1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c482be18-c056-4068-8a37-ed5038fc364a:17229:1875336022370560:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788460185.617833:0:17229:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460185.617877:0:17229:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bd1808f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788460185.618010:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022370560 00000100:00100000:1.0:1788460185.618015:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022370560 00000100:00100000:1.0:1788460185.618155:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788460185.618164:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4130850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+9:17229:x1875336022370560:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788460185.618688:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4130850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+9:17229:x1875336022370560:12345-0@lo:502:llog_process_th.0 Request processed in 525us (853us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460185.618697:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788460185.618836:0:17229:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac42f1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c482be18-c056-4068-8a37-ed5038fc364a:17229:1875336022370560:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788460185.618862:0:17229:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788460185.618885:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788460185.618888:0:17229:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788460185.618894:0:17229:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1788460185.618897:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788460185.618911:0:17229:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8c4bd0b8e620) 00000020:00000080:2.0:1788460185.618931:0:17229:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1788460185.618937:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788460185.619067:0:17229:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788460185.619074:0:17229:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5dfa74784542bf8c 00000020:00000080:2.0:1788460185.619274:0:17229:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788460185.619278:0:17229:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788460185.619282:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788460185.619283:0:17229:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788460185.619286:0:17229:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788460185.619290:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788460185.619291:0:17229:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1788460185.619294:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788460185.619302:0:17229:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8c4bd0b8cc98) 00000020:00000080:2.0:1788460185.619311:0:17229:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1788460185.619315:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788460185.619317:0:17229:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1788460185.619319:0:17229:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1788460185.619325:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788460185.619365:0:17229:0:(tgt_mount.c:167:server_get_mount()) get mount ffff8c4ac428f800 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1788460185.619377:0:17229:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8c4bd0b88000) 00000020:00000080:2.0:1788460185.619385:0:17229:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1788460185.619445:0:17229:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788460185.619451:0:17229:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5dfa74784542bfa1 00000020:00000080:2.0:1788460185.619723:0:17229:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1788460185.619730:0:17229:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788460185.619735:0:17229:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x5dfa74784542bfa8 00080000:01000000:2.0:1788460185.619740:0:17229:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788460185.619743:0:17229:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5dfa74784542bfaf 00010000:00010000:3.0:1788460185.718200:0:17229:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1788460185.718650:0:17229:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:3.0:1788460185.719188:0:17229:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788460185.719674:0:17229:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8c4bef216620) 00000020:00000080:3.0:1788460185.719746:0:17229:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788460185.719805:0:17229:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788460185.719812:0:17229:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5dfa74784542bfbd 00000020:00000080:3.0:1788460185.723409:0:17229:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788460185.731295:0:17229:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x5dfa74784542bfc4 00000020:00000080:3.0:1788460185.731714:0:17229:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788460185.731725:0:17229:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788460185.731731:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788460185.731733:0:17229:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788460185.731737:0:17229:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788460185.731739:0:17229:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:3.0:1788460185.731741:0:17229:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788460185.731742:0:17229:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788460185.731744:0:17229:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788460185.731746:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788460185.731748:0:17229:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788460185.731750:0:17229:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788460185.731762:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788460185.731764:0:17229:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788460185.731769:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788460185.731807:0:17229:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788460185.731820:0:17229:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788460185.731823:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788460185.731824:0:17229:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1788460185.731826:0:17229:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788460185.731829:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788460185.731831:0:17229:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1788460185.731834:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788460185.731839:0:17229:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.105@tcp to nid 0x20000c0a8ce69 (192.168.206.105@tcp) 00000020:00000080:3.0:1788460185.731864:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788460185.731878:0:17229:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8c4bef211988) 00000020:00000080:3.0:1788460185.731891:0:17229:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1788460185.731896:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788460185.731979:0:17229:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1788460185.731984:0:17229:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788460185.731990:0:17229:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5dfa74784542bfd2 00010000:00080000:3.0:1788460185.732019:0:17229:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c4bfa02b800@lustre-MDT0001-osp-MDT0000: add connection 192.168.206.105@tcp at head 00010000:00010000:3.0:1788460185.733712:0:17229:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:1.0:1788460185.738421:0:17229:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788460185.738435:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1788460185.738470:0:17229:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788460185.738490:0:17229:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5dfa74784542bfd9 00000100:00080000:1.0:1788460185.738499:0:17229:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788460185.738506:0:17229:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8c4bfa02b800 using connection 192.168.206.105@tcp/0@lo 00000100:00100000:1.0:1788460185.738540:0:17229:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4ac1e60a80 x1875336022370688/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788460185.738570:0:17229:0:(pinger.c:380:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:1.0:1788460185.738625:0:17229:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788460185.738628:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788460185.738630:0:17229:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1788460185.738633:0:17229:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788460185.738636:0:17229:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:1.0:1788460185.738644:0:17229:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788460185.738646:0:17229:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788460185.738647:0:17229:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788460185.738650:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788460185.738651:0:17229:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788460185.738654:0:17229:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788460185.738658:0:17229:0:(obd_mount.c:1049:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1788460185.738661:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788460185.738662:0:17229:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788460185.738664:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788460185.738668:0:17229:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.105@tcp to nid 0x20000c0a8ce69 (192.168.206.105@tcp) 00000020:01000000:1.0:1788460185.738749:0:17229:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788460185.738753:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788460185.738765:0:17229:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8c4ac1ef4c98) 00000020:00000080:1.0:1788460185.738775:0:17229:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1788460185.738780:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788460185.738841:0:17229:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1788460185.738846:0:17229:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788460185.738852:0:17229:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5dfa74784542bfe7 00010000:00080000:1.0:1788460185.738879:0:17229:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c4bc6b3a800@lustre-OST0000-osc-MDT0000: add connection 192.168.206.105@tcp at head 00000100:00100000:2.0:1788460185.739200:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1875336022370688:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788460185.739262:0:3658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460185.739330:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022370688 00000100:00100000:2.0:1788460185.739336:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022370688 00000100:00100000:2.0:1788460185.739363:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788460185.739378:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac42f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3658:x1875336022370688:12345-0@lo:38:llog_process_th.0 00010000:00020000:2.0:1788460185.739392:0:17216:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00010000:1.0:1788460185.739812:0:17229:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1788460185.741470:0:17229:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788460185.741774:0:17229:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788460185.750511:0:17229:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788460185.751249:0:17229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1788460185.765674:0:17229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1788460185.771867:0:17235:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788460185.771873:0:17235:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788460185.772707:0:17229:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788460185.772719:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788460185.772752:0:17229:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788460185.772770:0:17229:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5dfa74784542bfee 00000100:00080000:1.0:1788460185.772780:0:17229:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788460185.772786:0:17229:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8c4bc6b3a800 using connection 192.168.206.105@tcp/0@lo 00000100:00100000:1.0:1788460185.772819:0:17229:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4ac1e61f80 x1875336022370816/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788460185.772856:0:17229:0:(pinger.c:380:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788460185.772968:0:17229:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788460185.772973:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788460185.772976:0:17229:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788460185.772979:0:17229:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788460185.772981:0:17229:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:1.0:1788460185.772983:0:17229:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788460185.772985:0:17229:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788460185.772986:0:17229:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788460185.772989:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788460185.772990:0:17229:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788460185.772993:0:17229:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788460185.772996:0:17229:0:(obd_mount.c:1049:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1788460185.772999:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788460185.773000:0:17229:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788460185.773003:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788460185.773006:0:17229:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.105@tcp to nid 0x20000c0a8ce69 (192.168.206.105@tcp) 00000020:01000000:1.0:1788460185.773029:0:17229:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788460185.773031:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000100:00100000:3.0:1788460185.773190:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1875336022370816:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788460185.773239:0:3658:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875336022370816 offset 0 length 520: 4 00000020:00000080:1.0:1788460185.773309:0:17229:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8c4ac1ef3310) 00000020:00000080:1.0:1788460185.773321:0:17229:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:1.0:1788460185.773328:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788460185.773395:0:17229:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788460185.773400:0:17229:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:1.0:1788460185.773407:0:17229:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5dfa74784542bffc 00010000:00080000:1.0:1788460185.773433:0:17229:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c4ac3abd000@lustre-OST0001-osc-MDT0000: add connection 192.168.206.105@tcp at head 00010000:00010000:1.0:1788460185.773625:0:17229:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1788460185.773681:0:17229:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788460185.773693:0:17229:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:2.0:1788460185.787228:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac42f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3658:x1875336022370688:12345-0@lo:38:llog_process_th.0 Request processed in 47840us (47956us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788460185.787244:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1788460185.787430:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c4bfa02b800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788460185.787435:0:3658:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788460185.787440:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1875336022370688:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1788460185.789692:0:17229:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788460185.790182:0:17229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1788460185.790319:0:17229:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1788460185.790678:0:17237:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788460185.790683:0:17237:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788460185.797562:0:17229:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788460185.797574:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788460185.797625:0:17229:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788460185.797643:0:17229:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5dfa74784542c003 00000100:00080000:1.0:1788460185.797653:0:17229:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788460185.797658:0:17229:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8c4ac3abd000 using connection 192.168.206.105@tcp/0@lo 00000100:00100000:1.0:1788460185.797690:0:17229:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4ac1e63800 x1875336022370944/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788460185.797718:0:17229:0:(pinger.c:380:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788460185.797771:0:17229:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788460185.797775:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788460185.797778:0:17229:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788460185.797781:0:17229:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788460185.797784:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788460185.797785:0:17229:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788460185.797788:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788460185.797790:0:17229:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788460185.797792:0:17229:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788460185.797796:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788460185.797797:0:17229:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788460185.797798:0:17229:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788460185.797800:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788460185.797801:0:17229:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788460185.797804:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788460185.797834:0:17229:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e62a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c482be18-c056-4068-8a37-ed5038fc364a:17229:1875336022371072:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788460185.797904:0:17229:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460185.797940:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022371072 00000100:00100000:1.0:1788460185.797962:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022371072 00000100:00100000:1.0:1788460185.797995:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788460185.798004:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4132050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+9:17229:x1875336022371072:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788460185.798199:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1875336022370944:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788460185.798229:0:3658:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875336022370944 offset 0 length 520: 4 00000100:00100000:1.0:1788460185.799307:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4132050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+9:17229:x1875336022371072:12345-0@lo:502:llog_process_th.0 Request processed in 1298us (1398us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460185.799329:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788460185.799386:0:17229:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc525e3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788460185.799407:0:17229:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e62a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c482be18-c056-4068-8a37-ed5038fc364a:17229:1875336022371072:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788460185.799434:0:17229:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788460185.799440:0:17229:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788460185.799442:0:17229:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788460185.799447:0:17229:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:2.0:1788460185.799932:0:17191:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:2.0:1788460185.799973:0:17191:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788460185.799991:0:17191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac3676e00/0x5dfa74784542bf77 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542bf7e expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460185.800003:0:17191:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4ac3676e00/0x5dfa74784542bf77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542bf7e expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788460185.800011:0:17191:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-mdtir-ffff8c4ac428f800 from 1 10000000:01000000:2.0:1788460185.800013:0:17191:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788460185.800055:0:17191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7a00/0x5dfa74784542c00a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460185.800063:0:17191:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7a00/0x5dfa74784542c00a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460185.800073:0:17191:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7a00/0x5dfa74784542c00a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460185.800092:0:17191:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac42f0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:17191:1875336022371200:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788460185.800142:0:17191:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460185.800176:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bd1c900c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788460185.800266:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022371200 00000100:00100000:3.0:1788460185.800273:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022371200 00000100:00100000:3.0:1788460185.800318:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788460185.800327:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4132c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+9:17191:x1875336022371200:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788460185.800346:0:17206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460185.800358:0:17206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4bc29d3200/0x5dfa74784542c011 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542c00a expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460185.800380:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bc29d3200/0x5dfa74784542c011 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542c00a expref: 10 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460185.800391:0:17206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4bc29d3200/0x5dfa74784542c011 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542c00a expref: 10 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460185.800399:0:17206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc29d3200, rc 0) 00000100:00100000:3.0:1788460185.800440:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4132c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+10:17191:x1875336022371200:12345-0@lo:101:mount.lustre.0 Request processed in 114us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460185.800446:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788460185.800534:0:17191:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac42f0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:17191:1875336022371200:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788460185.800547:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7a00/0x5dfa74784542c00a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c011 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460185.800555:0:17191:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7a00/0x5dfa74784542c00a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542c011 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460185.801126:0:17191:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac42f0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:17191:1875336022371328:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788460185.801166:0:17191:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460185.801199:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bd1c900c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788460185.801259:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022371328 00000100:00100000:0.0:1788460185.801265:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022371328 00000100:00100000:0.0:1788460185.801300:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788460185.801308:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4131050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+10:17191:x1875336022371328:12345-0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788460185.801374:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4131050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+10:17191:x1875336022371328:12345-0@lo:256:mount.lustre.0 Request processed in 67us (206us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788460185.801381:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788460185.801400:0:17191:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac42f0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:17191:1875336022371328:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788460185.801919:0:17191:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'lustre-mdtir' failed (-11). 00010000:00010000:2.0:1788460185.801927:0:17191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7a00/0x5dfa74784542c00a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c011 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460185.801936:0:17191:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7a00/0x5dfa74784542c00a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c011 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788460185.802031:0:17191:0:(mgc_request.c:2375:mgc_process_log()) mgc192.168.206.105@tcp: IR log lustre-mdtir not ready yet: rc = -11 00010000:00010000:2.0:1788460185.802176:0:17191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7a00/0x5dfa74784542c00a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c011 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460185.802187:0:17191:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7a00/0x5dfa74784542c00a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542c011 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460185.802194:0:17191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7a00/0x5dfa74784542c00a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5dfa74784542c011 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460185.802213:0:17191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7a00/0x5dfa74784542c00a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5dfa74784542c011 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460185.802340:0:17191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788460185.802358:0:17191:0:(mgc_request.c:2266:mgc_process_log()) Process log params-ffff8c4ac428f800 from 1 10000000:01000000:3.0:1788460185.802361:0:17191:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788460185.802391:0:17191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2c00/0x5dfa74784542c018 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460185.802399:0:17191:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2c00/0x5dfa74784542c018 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460185.802408:0:17191:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2c00/0x5dfa74784542c018 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460185.802425:0:17191:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4285f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:17191:1875336022371456:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788460185.802462:0:17191:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460185.802497:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bf2fc5cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788460185.803164:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022371456 00000100:00100000:0.0:1788460185.803172:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022371456 00000100:00100000:0.0:1788460185.803221:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788460185.803229:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4131450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+10:17191:x1875336022371456:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788460185.803241:0:17206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460185.803255:0:17206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4bc2bd4200/0x5dfa74784542c01f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542c018 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460185.803276:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bc2bd4200/0x5dfa74784542c01f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542c018 expref: 11 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460185.803285:0:17206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4bc2bd4200/0x5dfa74784542c01f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542c018 expref: 11 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460185.803293:0:17206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc2bd4200, rc 0) 00000100:00100000:0.0:1788460185.803335:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4131450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+11:17191:x1875336022371456:12345-0@lo:101:mount.lustre.0 Request processed in 106us (872us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460185.803341:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788460185.803429:0:17191:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4285f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:17191:1875336022371456:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788460185.803443:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2c00/0x5dfa74784542c018 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c01f expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460185.803452:0:17191:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2c00/0x5dfa74784542c018 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542c01f expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460185.803488:0:17191:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4285f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:17191:1875336022371584:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788460185.803515:0:17191:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460185.803548:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bf2fc5cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788460185.803836:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022371584 00000100:00100000:0.0:1788460185.803842:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022371584 00000100:00100000:0.0:1788460185.803872:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788460185.803880:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4133050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+11:17191:x1875336022371584:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788460185.804045:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4133050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+11:17191:x1875336022371584:12345-0@lo:501:mount.lustre.0 Request processed in 158us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460185.804067:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788460185.804184:0:17191:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4285f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:17191:1875336022371584:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788460185.804217:0:17191:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e62a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:17191:1875336022371712:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788460185.804257:0:17191:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460185.804288:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc525e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788460185.805640:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022371712 00000100:00100000:3.0:1788460185.805650:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022371712 00000100:00100000:3.0:1788460185.805707:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788460185.805716:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4130450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+11:17191:x1875336022371712:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788460185.805854:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4130450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+11:17191:x1875336022371712:12345-0@lo:503:mount.lustre.0 Request processed in 138us (1595us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460185.805862:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788460185.805924:0:17191:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e62a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:17191:1875336022371712:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788460185.806205:0:17239:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4285c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c482be18-c056-4068-8a37-ed5038fc364a:17239:1875336022371840:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788460185.806245:0:17239:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460185.806270:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022371840 00000100:00100000:3.0:1788460185.806274:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022371840 00000100:00100000:3.0:1788460185.806291:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788460185.806296:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac2b3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+11:17239:x1875336022371840:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788460185.806425:0:17239:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bf2fc5d80 going to sleep for 11 seconds 00010000:00010000:2.0:1788460185.807682:0:17201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788460185.807693:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7a00/0x5dfa74784542c00a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5dfa74784542c011 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460185.807704:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bfadc7a00 already unused, calling callback (ffffffffc125ae00) 10000000:00010000:2.0:1788460185.807708:0:17201:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7a00/0x5dfa74784542c00a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5dfa74784542c011 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460185.807719:0:17201:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7a00/0x5dfa74784542c00a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x5dfa74784542c011 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788460185.807727:0:17201:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7a00/0x5dfa74784542c00a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x5dfa74784542c011 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788460185.807732:0:17201:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:3.0:1788460185.807795:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac2b3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+11:17239:x1875336022371840:12345-0@lo:502:llog_process_th.0 Request processed in 1496us (1547us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460185.807814:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:3.0:1788460185.807891:0:17201:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7a00/0x5dfa74784542c00a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5dfa74784542c011 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460185.807899:0:17201:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788460185.807927:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7a00/0x5dfa74784542c00a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5dfa74784542c011 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460185.807933:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7a00/0x5dfa74784542c00a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5dfa74784542c011 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460185.807976:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460185.807978:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460185.807980:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460185.808021:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788460185.808032:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4287480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c482be18-c056-4068-8a37-ed5038fc364a:3659:1875336022371968:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788460185.808075:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460185.808277:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022371968 00000100:00100000:1.0:1788460185.808283:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022371968 00000100:00100000:1.0:1788460185.808327:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788460185.808335:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4285180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c482be18-c056-4068-8a37-ed5038fc364a+11:3659:x1875336022371968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788460185.808345:0:17197:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788460185.808358:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4bc29d3200/0x5dfa74784542c011 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5dfa74784542c00a expref: 11 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460185.808373:0:17197:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788460185.808415:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4285180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c482be18-c056-4068-8a37-ed5038fc364a+10:3659:x1875336022371968:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460185.808422:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788460185.808499:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4287480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c482be18-c056-4068-8a37-ed5038fc364a:3659:1875336022371968:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788460185.810006:0:17239:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4285c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c482be18-c056-4068-8a37-ed5038fc364a:17239:1875336022371840:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788460185.810164:0:17239:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788460185.810176:0:17239:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788460185.810178:0:17239:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788460185.810186:0:17239:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c4ac428f800 00000020:00000080:0.0:1788460185.810189:0:17239:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788460185.810197:0:17239:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788460185.810199:0:17239:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788460185.810200:0:17239:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788460185.810203:0:17239:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788460185.810205:0:17239:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788460185.810206:0:17239:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788460185.810209:0:17239:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c4ac428f800 00000020:00000080:0.0:1788460185.810211:0:17239:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788460185.810271:0:17239:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788460185.810274:0:17239:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788460185.810276:0:17239:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788460185.810278:0:17239:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788460185.810281:0:17239:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788460185.810282:0:17239:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788460185.810286:0:17239:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8c4ac428f800 00000020:00000080:0.0:1788460185.810288:0:17239:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788460185.810305:0:17239:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788460185.810308:0:17239:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788460185.810310:0:17239:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788460185.810312:0:17239:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788460185.810314:0:17239:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788460185.810316:0:17239:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788460185.810318:0:17239:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8c4ac428f800 00000020:00000080:0.0:1788460185.810320:0:17239:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788460185.810480:0:17239:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4397480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c482be18-c056-4068-8a37-ed5038fc364a:17239:1875336022372096:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788460185.810541:0:17239:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460185.810580:0:17239:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac2869780 going to sleep for 11 seconds 00000100:00100000:1.0:1788460185.813638:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022372096 00000100:00100000:1.0:1788460185.813651:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022372096 00000100:00100000:1.0:1788460185.813696:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788460185.813705:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac2b3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+10:17239:x1875336022372096:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788460185.813865:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac2b3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+10:17239:x1875336022372096:12345-0@lo:502:llog_process_th.0 Request processed in 160us (3322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460185.813873:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788460185.813933:0:17239:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4397480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c482be18-c056-4068-8a37-ed5038fc364a:17239:1875336022372096:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788460185.813980:0:17239:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788460185.813987:0:17239:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788460185.813989:0:17239:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788460185.813993:0:17239:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1788460185.815367:0:17191:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788460185.815380:0:17191:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788460185.815401:0:17191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2c00/0x5dfa74784542c018 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c01f expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460185.815580:0:17191:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2c00/0x5dfa74784542c018 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c01f expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788460185.815712:0:17191:0:(mgc_request.c:2423:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788460185.815715:0:17191:0:(mgc_request.c:424:config_log_add()) add config log lustre-client-ffff8c4ac428f800 10000000:01000000:3.0:1788460185.815719:0:17191:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-client-ffff8c4ac428f800 10000000:01000000:3.0:1788460185.815834:0:17191:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788460185.815932:0:17191:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-client-ffff8c4ac428f800 from 1 10000000:01000000:3.0:1788460185.815936:0:17191:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788460185.815990:0:17191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d3000/0x5dfa74784542c026 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460185.816068:0:17191:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d3000/0x5dfa74784542c026 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460185.816079:0:17191:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d3000/0x5dfa74784542c026 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460185.816101:0:17191:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4284380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:17191:1875336022372224:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788460185.816248:0:17191:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460185.816288:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bf2fc50c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788460185.816310:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022372224 00000100:00100000:3.0:1788460185.816382:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022372224 00000100:00100000:3.0:1788460185.816492:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788460185.816570:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac2b39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+10:17191:x1875336022372224:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788460185.816583:0:17206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460185.816597:0:17206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4bc29d2e00/0x5dfa74784542c02d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542c026 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460185.816620:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bc29d2e00/0x5dfa74784542c02d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542c026 expref: 11 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460185.816721:0:17206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4bc29d2e00/0x5dfa74784542c02d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542c026 expref: 11 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460185.816828:0:17206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc29d2e00, rc 0) 00000100:00100000:3.0:1788460185.817063:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac2b39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+11:17191:x1875336022372224:12345-0@lo:101:mount.lustre.0 Request processed in 562us (814us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460185.817077:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788460185.823418:0:17191:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4284380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:17191:1875336022372224:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788460185.823445:0:17191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d3000/0x5dfa74784542c026 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c02d expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460185.823459:0:17191:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d3000/0x5dfa74784542c026 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542c02d expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460185.823512:0:17191:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac42f0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:17191:1875336022372352:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788460185.823574:0:17191:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460185.823614:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022372352 00000100:00100000:2.0:1788460185.823619:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bf2fc50c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788460185.823622:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022372352 00000100:00100000:3.0:1788460185.823692:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788460185.823702:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac2b38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+11:17191:x1875336022372352:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788460185.824135:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac2b38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+11:17191:x1875336022372352:12345-0@lo:501:mount.lustre.0 Request processed in 433us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460185.824144:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788460185.825178:0:17191:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac42f0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:17191:1875336022372352:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788460185.825243:0:17191:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac42f0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:17191:1875336022372480:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788460185.825298:0:17191:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460185.826165:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bf2fc50c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788460185.828977:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022372480 00000100:00100000:0.0:1788460185.828991:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022372480 00000100:00100000:0.0:1788460185.829037:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788460185.829047:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac2b3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+11:17191:x1875336022372480:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788460185.829237:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac2b3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+11:17191:x1875336022372480:12345-0@lo:503:mount.lustre.0 Request processed in 190us (3939us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460185.829245:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788460185.829375:0:17191:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac42f0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:17191:1875336022372480:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788460185.830537:0:17244:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac42f1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c482be18-c056-4068-8a37-ed5038fc364a:17244:1875336022372608:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788460185.830596:0:17244:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460185.830637:0:17244:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bd0b689c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788460185.830693:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022372608 00000100:00100000:0.0:1788460185.830700:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022372608 00000100:00100000:0.0:1788460185.830740:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788460185.830747:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac2b39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+11:17244:x1875336022372608:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788460185.830839:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac2b39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+11:17244:x1875336022372608:12345-0@lo:502:llog_process_th.0 Request processed in 92us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460185.830846:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788460185.830939:0:17244:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac42f1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c482be18-c056-4068-8a37-ed5038fc364a:17244:1875336022372608:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1788460185.831017:0:17244:0:(obd_mount.c:308:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1788460185.831031:0:17244:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8c4bd0b8b310) 00000020:00000080:2.0:1788460185.831181:0:17244:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:2.0:1788460185.831268:0:17244:0:(tgt_mount.c:167:server_get_mount()) get mount ffff8c4ac428f800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788460185.831272:0:17244:0:(tgt_mount.c:201:server_put_mount()) put mount ffff8c4ac428f800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788460185.831275:0:17244:0:(obd_mount.c:798:lustre_put_lsi()) put ffff8c4ac428f800 4 00010000:00080000:2.0:1788460185.831303:0:17244:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c4bfc4e5800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.105@tcp at head 00010000:00010000:2.0:1788460185.837612:0:17244:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:2.0:1788460185.843563:0:17244:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1788460185.843607:0:17244:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788460185.843619:0:17244:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x5dfa74784542c03b 00000100:00080000:2.0:1788460185.843629:0:17244:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788460185.843635:0:17244:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8c4bfc4e5800 using connection 192.168.206.105@tcp/0@lo 00000100:00100000:2.0:1788460185.843666:0:17244:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4ac42f1f80 x1875336022372736/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788460185.843704:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac42f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3658:1875336022372736:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788460185.843773:0:3658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788460185.843831:0:17244:0:(pinger.c:380:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788460185.845604:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022372736 00000100:00100000:0.0:1788460185.845616:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022372736 00000100:00100000:0.0:1788460185.845663:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788460185.845671:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac42f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3658:x1875336022372736:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788460185.845750:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac42f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3658:x1875336022372736:12345-0@lo:38:llog_process_th.0 Request processed in 77us (1976us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788460185.845758:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788460185.847218:0:3658:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788460185.847229:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c4bfc4e5800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788460185.847235:0:3658:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788460185.847240:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac42f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3658:1875336022372736:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788460185.847379:0:17244:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac42f1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c482be18-c056-4068-8a37-ed5038fc364a:17244:1875336022372864:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788460185.847447:0:17244:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460185.847484:0:17244:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc6b9b180 going to sleep for 11 seconds 00000100:00100000:0.0:1788460185.851230:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022372864 00000100:00100000:0.0:1788460185.851246:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022372864 00000100:00100000:0.0:1788460185.851308:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788460185.851318:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac2b3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+11:17244:x1875336022372864:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788460185.851491:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac2b3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+11:17244:x1875336022372864:12345-0@lo:502:llog_process_th.0 Request processed in 173us (4042us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460185.851499:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788460185.852726:0:17244:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac42f1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c482be18-c056-4068-8a37-ed5038fc364a:17244:1875336022372864:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788460185.852790:0:17244:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac42f1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c482be18-c056-4068-8a37-ed5038fc364a:17244:1875336022372992:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788460185.852843:0:17244:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460185.852872:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022372992 00000100:00100000:2.0:1788460185.852876:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022372992 00000100:00100000:2.0:1788460185.852911:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788460185.852919:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac2b3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+11:17244:x1875336022372992:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788460185.853202:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac2b3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+11:17244:x1875336022372992:12345-0@lo:502:llog_process_th.0 Request processed in 282us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460185.853210:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788460185.853254:0:17244:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc6b9b180 going to sleep for 11 seconds 00000100:00100000:2.0:1788460185.853268:0:17244:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac42f1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c482be18-c056-4068-8a37-ed5038fc364a:17244:1875336022372992:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788460185.853288:0:17244:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1788460185.863487:0:17191:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788460185.863506:0:17191:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788460185.863520:0:17191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d3000/0x5dfa74784542c026 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c02d expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460185.863533:0:17191:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d3000/0x5dfa74784542c026 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c02d expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788460185.864023:0:17191:0:(tgt_mount.c:1239:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788460185.864026:0:17191:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788460185.864027:0:17191:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788460185.864028:0:17191:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:0.0:1788460185.864029:0:17191:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:0.0:1788460185.864031:0:17191:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:0.0:1788460185.864099:0:17191:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788460185.864101:0:17191:0:(tgt_mount.c:1250:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788460185.864103:0:17191:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788460185.864104:0:17191:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788460185.864108:0:17191:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1788460185.864121:0:17191:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788460185.864123:0:17191:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788460185.864124:0:17191:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788460185.864125:0:17191:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:0.0:1788460185.864126:0:17191:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:0.0:1788460185.864127:0:17191:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:0.0:1788460185.864128:0:17191:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788460185.864129:0:17191:0:(tgt_mount.c:1250:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788460185.864130:0:17191:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788460185.864131:0:17191:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788460185.864156:0:17191:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788460185.864174:0:17191:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4396d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:17191:1875336022373120:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788460185.865282:0:17191:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460185.865327:0:17191:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac2869cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788460185.865452:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022373120 00000100:00100000:1.0:1788460185.865461:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022373120 00000100:00100000:1.0:1788460185.865513:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788460185.865522:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac2b39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+11:17191:x1875336022373120:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788460185.865548:0:17206:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788460185.865560:0:17206:0:(mgs_nids.c:475:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788460185.877459:0:17206:0:(mgs_nids.c:842:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788460185.877481:0:17206:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788460185.877777:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac2b39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+11:17191:x1875336022373120:12345-0@lo:253:mount.lustre.0 Request processed in 12252us (12495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460185.877790:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788460185.878018:0:17191:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4396d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:17191:1875336022373120:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788460185.878046:0:17191:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788460185.878050:0:17191:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788460185.878052:0:17191:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788460185.878053:0:17191:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788460185.878054:0:17191:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:3.0:1788460185.878055:0:17191:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:3.0:1788460185.878057:0:17191:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:3.0:1788460185.878058:0:17191:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788460185.878059:0:17191:0:(tgt_mount.c:1250:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788460185.878061:0:17191:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788460185.878062:0:17191:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788460185.878075:0:17191:0:(tgt_mount.c:2880:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1788460185.882102:0:17227:0:(mgs_nids.c:739:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788460185.882120:0:17227:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788460185.882148:0:17227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c4bc2bd5a00/0x5dfa74784542c042 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460185.882165:0:17227:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bc2bd5a00/0x5dfa74784542c042 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788460185.882174:0:17227:0:(mgs_nids.c:715:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000055479s 00010000:00010000:0.0:1788460185.882179:0:17227:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c4bc2bd5a00/0x5dfa74784542c042 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460185.882186:0:17227:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c4bc2bd5a00/0x5dfa74784542c042 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460185.882192:0:17227:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c4bc2bd5a00/0x5dfa74784542c042 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460185.882199:0:17227:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c4bc2bd5a00/0x5dfa74784542c042 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460185.882205:0:17227:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc2bd5a00 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:0.0:1788460185.882209:0:17227:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c4bc2bd5a00/0x5dfa74784542c042 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460185.882230:0:17227:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c4bc2bd5a00/0x5dfa74784542c042 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460185.882250:0:17227:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c4bc2bd5a00/0x5dfa74784542c042 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460185.882258:0:17227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c4bc2bd5a00/0x5dfa74784542c042 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460185.882278:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4bc2bd5a00/0x5dfa74784542c042 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788460185.894196:0:17191:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:1.0:1788460185.894980:0:17191:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1788460185.895131:0:17251:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1788460185.895135:0:17251:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:3.0:1788460185.898396:0:17252:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788460185.898453:0:17191:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:0.0:1788460185.899183:0:17252:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:3.0:1788460185.900594:0:17253:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff8c4ac4284380 x1875336022373248/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460185.900616:0:17253:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc65d7e40 going to sleep for 0 seconds 00000040:01000000:2.0:1788460185.901849:0:17191:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1788460185.901907:0:17191:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788460185.902724:0:17252:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00000080:2.0:1788460185.902810:0:17191:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788460185.902821:0:17191:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788460185.902867:0:17191:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:0.0:1788460185.902927:0:17252:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:2.0:1788460185.904091:0:17191:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788460185.904754:0:17191:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788460185.904804:0:17191:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:2.0:1788460185.908123:0:17191:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:2.0:1788460185.911791:0:17191:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1788460185.914252:0:17191:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788460185.914288:0:17191:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffba0a015ff9b8 00100000:10000000:2.0:1788460185.914296:0:17191:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1788460185.915290:0:17191:0:(tgt_mount.c:2600:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1788460185.915318:0:17191:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1788460185.916153:0:17191:0:(tgt_mount.c:2486:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788460185.916354:0:17191:0:(tgt_mount.c:2501:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788460186.516161:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788460186.897661:0:17247:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788460186.964420:0:17253:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc65d7e40 going to sleep for 0 seconds 10000000:01000000:3.0:1788460187.285378:0:17208:0:(mgc_request.c:715:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788460187.285385:0:17208:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-mdtir-ffff8c4ac428f800 from 1 10000000:01000000:3.0:1788460187.285391:0:17208:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788460187.285478:0:17208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2600/0x5dfa74784542c049 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460187.285491:0:17208:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2600/0x5dfa74784542c049 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460187.285502:0:17208:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2600/0x5dfa74784542c049 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460187.285525:0:17208:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4285c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022373376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788460187.285583:0:17208:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460187.285629:0:17208:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc65d7f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788460187.285688:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022373376 00000100:00100000:2.0:1788460187.285694:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022373376 00000100:00100000:2.0:1788460187.285760:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788460187.285769:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac2b38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+11:17208:x1875336022373376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788460187.285782:0:17204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460187.285805:0:17204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4bfadc7200/0x5dfa74784542c050 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542c049 expref: -99 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460187.285826:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bfadc7200/0x5dfa74784542c050 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542c049 expref: 12 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460187.285836:0:17204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4bfadc7200/0x5dfa74784542c050 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542c049 expref: 12 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460187.285844:0:17204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bfadc7200, rc 0) 00000100:00100000:2.0:1788460187.285890:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac2b38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+12:17208:x1875336022373376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460187.285908:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788460187.286078:0:17208:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4285c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022373376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788460187.286093:0:17208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2600/0x5dfa74784542c049 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c050 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460187.286113:0:17208:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2600/0x5dfa74784542c049 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542c050 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460187.286673:0:17208:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4396a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022373504:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788460187.286734:0:17208:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460187.286771:0:17208:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bced74240 going to sleep for 11 seconds 00000100:00100000:3.0:1788460187.287195:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022373504 00000100:00100000:3.0:1788460187.287202:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022373504 00000100:00100000:3.0:1788460187.287237:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788460187.287244:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac2b3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+12:17208:x1875336022373504:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788460187.287261:0:17205:0:(mgs_nids.c:1209:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788460187.287276:0:17205:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788460187.287279:0:17205:0:(mgs_nids.c:325:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1788460187.287359:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac2b3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+12:17208:x1875336022373504:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 115us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460187.287367:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788460187.287468:0:17208:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4396a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022373504:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788460187.288099:0:17208:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788460187.288119:0:17208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2600/0x5dfa74784542c049 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c050 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460187.288130:0:17208:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2600/0x5dfa74784542c049 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c050 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460187.541854:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788460187.921643:0:17247:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788460187.985394:0:17253:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc65d7e40 going to sleep for 0 seconds 00010000:00010000:2.0:1788460188.561883:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788460189.012058:0:17253:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc65d7e40 going to sleep for 0 seconds 00010000:00010000:2.0:1788460189.585111:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788460189.960821:0:17496:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1788460190.034514:0:17253:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc65d7e40 going to sleep for 0 seconds 00010000:00010000:2.0:1788460190.610313:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788460190.903778:0:17548:0:(tgt_mount.c:2486:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788460190.904343:0:17548:0:(tgt_mount.c:2501:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788460191.058068:0:17253:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc65d7e40 going to sleep for 0 seconds 00000100:00100000:2.0:1788460191.313825:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4287480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c482be18-c056-4068-8a37-ed5038fc364a:3661:1875336022373632:0@lo:400:kworker.0 00000100:00100000:2.0:1788460191.313893:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460191.314669:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022373632 00000100:00100000:0.0:1788460191.314678:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022373632 00000100:00100000:0.0:1788460191.314730:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788460191.314739:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac2b39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+12:3661:x1875336022373632:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788460191.314800:0:37:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788460191.314805:0:37:0:(pinger.c:244:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788460191.314808:0:37:0:(import.c:65:import_set_state_nolock()) ffff8c4bfa02b800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788460191.314813:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 482 00000100:00080000:3.0:1788460191.314817:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788460191.314823:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8c4bfa02b800 using connection 192.168.206.105@tcp/0@lo 00000100:00100000:1.0:1788460191.314914:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4ac1e60380 x1875336022373760/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788460191.314941:0:37:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788460191.314973:0:37:0:(pinger.c:254:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788460191.314976:0:37:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788460191.314979:0:37:0:(pinger.c:254:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788460191.314981:0:37:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788460191.314984:0:37:0:(pinger.c:244:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788460191.314987:0:37:0:(import.c:65:import_set_state_nolock()) ffff8c4bfc4e5800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788460191.314992:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8c4bfc4e5800 using connection 192.168.206.105@tcp/0@lo 00000100:00100000:1.0:1788460191.315016:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4ac1e61500 x1875336022373888/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788460191.315872:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1875336022373760:0@lo:38:kworker.0 00000100:00100000:3.0:1788460191.315986:0:3658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460191.316041:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3658:1875336022373888:0@lo:38:kworker.0 00000100:00100000:3.0:1788460191.316070:0:3658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460191.316425:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022373760 00000100:00100000:1.0:1788460191.316433:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022373760 00000100:00100000:1.0:1788460191.316469:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788460191.316484:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4285f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3658:x1875336022373760:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788460191.316502:0:17217:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788460191.324414:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac2b39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+12:3661:x1875336022373632:12345-0@lo:400:kworker.0 Request processed in 9667us (10512us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460191.324430:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788460191.324533:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022373888 00000100:00100000:0.0:1788460191.324541:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022373888 00000100:00100000:0.0:1788460191.324734:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788460191.324741:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4284e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3658:x1875336022373888:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788460191.324768:0:17213:0:(ldlm_lib.c:1461:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 488 last 0 00000020:00000080:0.0:1788460191.324801:0:17213:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x5dfa74784542c057 00000004:00100000:0.0:1788460191.324815:0:17213:0:(mdt_handler.c:7310:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788460191.324936:0:17213:0:(import.c:65:import_set_state_nolock()) ffff8c4bfa1bf800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788460191.325036:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4284e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3658:x1875336022373888:12345-0@lo:38:kworker.0 Request processed in 294us (8965us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460191.325044:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788460191.330784:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4287480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c482be18-c056-4068-8a37-ed5038fc364a:3661:1875336022373632:0@lo:400:kworker.0 00010000:00080000:2.0:1788460191.331677:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8c4ac1e61500 x1875336022373888/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788460201 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788460191.331695:0:3658:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788460191.331703:0:3658:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788460191.331708:0:3658:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788460191.331712:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c4bfc4e5800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788460191.331718:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3658:1875336022373888:0@lo:38:kworker.0 00000100:00100000:1.0:1788460191.341671:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4285f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3658:x1875336022373760:12345-0@lo:38:kworker.0 Request processed in 25187us (25677us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788460191.341685:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1788460191.342365:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c4bfa02b800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788460191.342371:0:3658:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788460191.342375:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1875336022373760:0@lo:38:kworker.0 00010000:00010000:3.0:1788460191.636160:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788460191.889598:0:17598:0:(tgt_mount.c:2486:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788460191.889875:0:17598:0:(tgt_mount.c:2501:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788460192.082711:0:17253:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc65d7e40 going to sleep for 0 seconds 00010000:00010000:2.0:1788460192.657406:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788460193.106406:0:17253:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc65d7e40 going to sleep for 0 seconds 00010000:00010000:2.0:1788460193.681228:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788460194.131242:0:17253:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc65d7e40 going to sleep for 0 seconds 00010000:00010000:2.0:1788460194.705193:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460195.157148:0:17253:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc65d7e40 going to sleep for 0 seconds 00000100:00100000:2.0:1788460195.409238:0:3658:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788460185/real 1788460185] req@ffff8c4ac1e63800 x1875336022370944/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788460195 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460195.409269:0:3658:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c4ac1e63800 x1875336022370944/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788460195 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460195.409294:0:3658:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788460185/real 1788460185] req@ffff8c4ac1e61f80 x1875336022370816/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788460195 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460195.409307:0:3658:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c4ac1e61f80 x1875336022370816/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788460195 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788460195.409324:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c4ac3abd000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788460195.409346:0:3658:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788460195.409350:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1875336022370944:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788460195.409356:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c4bc6b3a800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788460195.409361:0:3658:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788460195.409364:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1875336022370816:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788460195.411718:0:37:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788460195.411724:0:37:0:(pinger.c:244:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788460195.411728:0:37:0:(import.c:65:import_set_state_nolock()) ffff8c4bfa02b800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788460195.411735:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 488 00000100:00080000:3.0:1788460195.411741:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788460195.411748:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8c4bfa02b800 using connection 192.168.206.105@tcp/0@lo 00000100:00100000:3.0:1788460195.411781:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4ac4286680 x1875336022374144/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788460195.411801:0:37:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788460195.411805:0:37:0:(pinger.c:244:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788460195.411807:0:37:0:(import.c:65:import_set_state_nolock()) ffff8c4bc6b3a800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788460195.411810:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 482 00000100:00080000:3.0:1788460195.411825:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788460195.411830:0:37:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8c4bc6b3a800 using connection 192.168.206.105@tcp/0@lo 00000100:00100000:3.0:1788460195.411843:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4ac4284700 x1875336022374272/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788460195.411852:0:37:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788460195.411855:0:37:0:(pinger.c:244:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788460195.411857:0:37:0:(import.c:65:import_set_state_nolock()) ffff8c4ac3abd000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788460195.411860:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 482 00000100:00080000:3.0:1788460195.411862:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788460195.411865:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8c4ac3abd000 using connection 192.168.206.105@tcp/0@lo 00000100:00100000:3.0:1788460195.411874:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4ac4287100 x1875336022374400/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788460195.411915:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4287b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1875336022374528:0@lo:400:kworker.0 00000100:00100000:3.0:1788460195.411994:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460195.412089:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022374528 00000100:00100000:3.0:1788460195.412096:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022374528 00000100:00100000:3.0:1788460195.412148:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788460195.412156:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4286a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1875336022374528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460195.412202:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4286a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1875336022374528:12345-0@lo:400:kworker.0 Request processed in 47us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460195.412216:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788460195.412254:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8c4ac4287b80 x1875336022374528/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460211 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460195.412267:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4287b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1875336022374528:0@lo:400:kworker.0 00000100:00100000:3.0:1788460195.412287:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4286680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1875336022374144:0@lo:38:kworker.0 00000100:00100000:3.0:1788460195.412314:0:3658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460195.412337:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4284700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1875336022374272:0@lo:8:kworker.0 00000400:00000100:3.0:1788460195.412353:0:3658:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875336022374272 offset 0 length 520: 4 00000100:00100000:3.0:1788460195.412367:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4287100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1875336022374400:0@lo:8:kworker.0 00000400:00000100:3.0:1788460195.412382:0:3658:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875336022374400 offset 0 length 520: 4 00000100:00100000:3.0:1788460195.412408:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022374144 00000100:00100000:3.0:1788460195.412412:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022374144 00000100:00100000:3.0:1788460195.412430:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788460195.412434:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4287b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3658:x1875336022374144:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788460195.412449:0:17216:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788460195.413124:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788460195.413137:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4284a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c482be18-c056-4068-8a37-ed5038fc364a:3661:1875336022374016:0@lo:400:kworker.0 00000100:00100000:2.0:1788460195.413178:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460195.413213:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022374016 00000100:00100000:2.0:1788460195.413218:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022374016 00000100:00100000:2.0:1788460195.413249:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788460195.413257:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4c02042450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+12:3661:x1875336022374016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460195.413295:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4c02042450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+12:3661:x1875336022374016:12345-0@lo:400:kworker.0 Request processed in 40us (116us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460195.413302:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788460195.413337:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4284a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c482be18-c056-4068-8a37-ed5038fc364a:3661:1875336022374016:0@lo:400:kworker.0 00000100:00100000:3.0:1788460195.442700:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4287b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3658:x1875336022374144:12345-0@lo:38:kworker.0 Request processed in 30255us (30377us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788460195.442715:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1788460195.442859:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c4bfa02b800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788460195.442865:0:3658:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788460195.442881:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4286680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1875336022374144:0@lo:38:kworker.0 00010000:00010000:3.0:1788460195.729882:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460196.177091:0:17253:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc65d7e40 going to sleep for 0 seconds 00010000:00010000:2.0:1788460196.754534:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788460197.139595:0:17247:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788460197.201009:0:17253:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc65d7e40 going to sleep for 0 seconds 00010000:00010000:2.0:1788460197.781080:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788460198.228789:0:17253:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc65d7e40 going to sleep for 0 seconds 00000020:01000004:3.0:1788460198.702761:0:17943:0:(obd_mount.c:1011:lmd_print()) mount data: 00000020:01000004:3.0:1788460198.702765:0:17943:0:(obd_mount.c:1014:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:3.0:1788460198.702766:0:17943:0:(obd_mount.c:1017:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1788460198.702910:0:17943:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8c4be0237800 00000020:01000004:3.0:1788460198.702930:0:17943:0:(tgt_mount.c:2642:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:3.0:1788460198.703166:0:17943:0:(obd_mount.c:308:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788460198.703182:0:17943:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff8c4bef214c98) 00000020:00000080:3.0:1788460198.703201:0:17943:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788460198.778315:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788460198.778832:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:2.0:1788460198.782781:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1788460198.783404:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:2.0:1788460198.783857:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:2.0:1788460198.784436:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:2.0:1788460198.784828:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:2.0:1788460198.785136:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1788460198.785858:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1788460198.786328:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:2.0:1788460198.786716:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1788460198.786910:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1788460198.787398:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1788460198.787802:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1788460198.788065:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1788460198.788379:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1788460198.788672:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1788460198.789478:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1788460198.790180:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1788460198.791706:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1788460198.792321:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:2.0:1788460198.792555:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1788460198.793126:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:2.0:1788460198.793417:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:2.0:1788460198.793790:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1788460198.794157:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:2.0:1788460198.794440:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1788460198.794806:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1788460198.795208:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:2.0:1788460198.795845:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:2.0:1788460198.796290:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1788460198.796601:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1788460198.796794:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1788460198.797527:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1788460198.798164:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788460198.798583:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788460198.798872:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:2.0:1788460198.799327:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1788460198.799809:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1788460198.800300:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1788460198.800602:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1788460198.800835:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00010000:00010000:0.0:1788460198.801513:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1788460198.801582:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:2.0:1788460198.801908:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788460198.802225:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1788460198.802504:0:17943:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:01000000:2.0:1788460198.803883:0:17943:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788460198.804411:0:17943:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1788460198.804431:0:17943:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788460198.804442:0:17943:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5dfa74784542c065 00000020:01000004:2.0:1788460198.804449:0:17943:0:(tgt_mount.c:2727:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788460198.804470:0:17943:0:(obd_mount.c:488:lustre_start_mgc()) mgc192.168.206.105@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788460198.804474:0:17943:0:(mgc_request.c:1379:mgc_set_info_async()) InitRecov mgc192.168.206.105@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788460198.804479:0:17943:0:(tgt_mount.c:1939:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1788460198.804509:0:17943:0:(tgt_mount.c:1519:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.206.105@tcp, index=0001, flags=0x20001 00000020:01000004:2.0:1788460198.804513:0:17943:0:(tgt_mount.c:1239:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788460198.804515:0:17943:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788460198.804516:0:17943:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788460198.804517:0:17943:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:2.0:1788460198.804519:0:17943:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788460198.804520:0:17943:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788460198.804521:0:17943:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788460198.804523:0:17943:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788460198.804524:0:17943:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788460198.804528:0:17943:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:2.0:1788460198.804541:0:17943:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788460198.804543:0:17943:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788460198.804544:0:17943:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788460198.804545:0:17943:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:2.0:1788460198.804546:0:17943:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788460198.804547:0:17943:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788460198.804548:0:17943:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788460198.804549:0:17943:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788460198.804550:0:17943:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788460198.804574:0:17943:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1788460198.804592:0:17943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac42f1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:17943:1875336022374656:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788460198.804668:0:17943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460198.804809:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022374656 00000100:00100000:0.0:1788460198.804817:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022374656 00000100:00100000:0.0:1788460198.804862:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788460198.804872:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4c02041450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+12:17943:x1875336022374656:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788460198.804898:0:17205:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788460198.804902:0:17205:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:0.0:1788460198.804909:0:17205:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1788460198.805377:0:17943:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc4e73000 going to sleep for 11 seconds 00000100:00100000:1.0:1788460198.805805:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4c02041450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+12:17943:x1875336022374656:12345-0@lo:253:mount.lustre.0 Request processed in 933us (1135us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460198.805815:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788460198.805900:0:17943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac42f1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:17943:1875336022374656:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788460198.805911:0:17943:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1788460198.805914:0:17943:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788460198.805915:0:17943:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788460198.805916:0:17943:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788460198.805917:0:17943:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:0.0:1788460198.805918:0:17943:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:0.0:1788460198.805920:0:17943:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:0.0:1788460198.805921:0:17943:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788460198.805923:0:17943:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788460198.805924:0:17943:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788460198.805973:0:17943:0:(tgt_mount.c:115:server_register_mount()) register mount ffff8c4be0237800 from lustre-MDT0001 10000000:01000000:0.0:1788460198.806008:0:17943:0:(mgc_request.c:2423:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1788460198.806011:0:17943:0:(mgc_request.c:424:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1788460198.806016:0:17943:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8c4be0237800 10000000:01000000:0.0:1788460198.806021:0:17943:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788460198.806038:0:17943:0:(mgc_request_server.c:106:mgc_fs_setup()) mgc192.168.206.105@tcp: setup lustre-MDT0001-osd 00000040:01000000:0.0:1788460198.808467:0:17943:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.206.105@tcp ctxt 1 is initialized 00000040:01000000:0.0:1788460198.811917:0:17943:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.206.105@tcp ctxt 0 is initialized 10000000:01000000:0.0:1788460198.811934:0:17943:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-sptlrpc-ffff8c4be0237800 from 1 10000000:01000000:0.0:1788460198.811937:0:17943:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788460198.812323:0:17943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bc2bd4e00/0x5dfa74784542c06c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460198.812335:0:17943:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4bc2bd4e00/0x5dfa74784542c06c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460198.812347:0:17943:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4bc2bd4e00/0x5dfa74784542c06c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460198.812371:0:17943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4396a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:17943:1875336022374784:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788460198.812430:0:17943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460198.812527:0:17943:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bf2fc5480 going to sleep for 11 seconds 00000100:00100000:1.0:1788460198.812632:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022374784 00000100:00100000:1.0:1788460198.812640:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022374784 00000100:00100000:1.0:1788460198.812723:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788460198.812732:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4c02042850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+12:17943:x1875336022374784:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788460198.812744:0:17204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460198.812762:0:17204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4ac3676800/0x5dfa74784542c073 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542c06c expref: -99 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460198.812784:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4ac3676800/0x5dfa74784542c073 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542c06c expref: 13 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460198.812796:0:17204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4ac3676800/0x5dfa74784542c073 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542c06c expref: 13 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460198.812805:0:17204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ac3676800, rc 0) 00000100:00100000:1.0:1788460198.812855:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4c02042850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+13:17943:x1875336022374784:12345-0@lo:101:mount.lustre.0 Request processed in 124us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460198.812862:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788460198.812940:0:17943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4396a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:17943:1875336022374784:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788460198.812986:0:17943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4bc2bd4e00/0x5dfa74784542c06c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c073 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460198.812994:0:17943:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4bc2bd4e00/0x5dfa74784542c06c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542c073 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460198.813093:0:17943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac42f0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:17943:1875336022374912:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788460198.813120:0:17943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460198.813449:0:17943:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc4e73d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788460198.813488:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022374912 00000100:00100000:0.0:1788460198.813493:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022374912 00000100:00100000:0.0:1788460198.813517:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788460198.813524:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfc2e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+13:17943:x1875336022374912:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788460198.813610:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfc2e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+13:17943:x1875336022374912:12345-0@lo:501:mount.lustre.0 Request processed in 85us (488us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788460198.813617:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788460198.813691:0:17943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac42f0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:17943:1875336022374912:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788460198.813707:0:17943:0:(mgc_request_server.c:748:mgc_llog_local_copy()) mgc192.168.206.105@tcp: no remote llog for lustre-sptlrpc, check MGS config 00000100:00100000:2.0:1788460198.813740:0:17943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac42f0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:17943:1875336022375040:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788460198.813765:0:17943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460198.813788:0:17943:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc4e73d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788460198.813894:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022375040 00000100:00100000:0.0:1788460198.813899:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022375040 00000100:00100000:0.0:1788460198.813916:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788460198.813922:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfc2e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+13:17943:x1875336022375040:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788460198.814153:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfc2e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+13:17943:x1875336022375040:12345-0@lo:501:mount.lustre.0 Request processed in 230us (386us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788460198.814161:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788460198.814228:0:17943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac42f0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:17943:1875336022375040:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788460198.814258:0:17943:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788460198.814276:0:17943:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bc2bd4e00/0x5dfa74784542c06c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c073 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460198.814284:0:17943:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4bc2bd4e00/0x5dfa74784542c06c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c073 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788460198.814294:0:17943:0:(mgc_request.c:206:do_config_log_add()) do adding config log params-ffff8c4be0237800 10000000:01000000:2.0:1788460198.814299:0:17943:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788460198.814323:0:17943:0:(mgc_request_server.c:106:mgc_fs_setup()) mgc192.168.206.105@tcp: setup lustre-MDT0001-osd 00000040:01000000:2.0:1788460198.814396:0:17943:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.206.105@tcp ctxt 1 is initialized 00000040:01000000:2.0:1788460198.814403:0:17943:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.206.105@tcp ctxt 0 is initialized 10000000:01000000:2.0:1788460198.814410:0:17943:0:(mgc_request.c:206:do_config_log_add()) do adding config log nodemap-ffff8c4ac1ef1988 10000000:01000000:2.0:1788460198.814413:0:17943:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1788460198.814430:0:17943:0:(mgc_request.c:2266:mgc_process_log()) Process log nodemap-ffff8c4ac1ef1988 from 1 10000000:01000000:2.0:1788460198.814433:0:17943:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788460198.814455:0:17943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6a00/0x5dfa74784542c07a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460198.814472:0:17943:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6a00/0x5dfa74784542c07a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460198.814481:0:17943:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6a00/0x5dfa74784542c07a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460198.814495:0:17943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac42f0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:17943:1875336022375168:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788460198.814520:0:17943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460198.814558:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022375168 00000100:00100000:2.0:1788460198.814563:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022375168 00000100:00100000:2.0:1788460198.814583:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788460198.814589:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfc2e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+13:17943:x1875336022375168:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788460198.814597:0:17205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460198.814606:0:17205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4bfadc6800/0x5dfa74784542c081 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542c07a expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460198.814625:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bfadc6800/0x5dfa74784542c081 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542c07a expref: 14 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460198.814635:0:17205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4bfadc6800/0x5dfa74784542c081 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542c07a expref: 14 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460198.814643:0:17205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bfadc6800, rc 0) 00000100:00100000:2.0:1788460198.814667:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfc2e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+14:17943:x1875336022375168:12345-0@lo:101:mount.lustre.0 Request processed in 78us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460198.814673:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788460198.814705:0:17943:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc4e73b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788460198.814723:0:17943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac42f0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:17943:1875336022375168:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788460198.814734:0:17943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6a00/0x5dfa74784542c07a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c081 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460198.814742:0:17943:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6a00/0x5dfa74784542c07a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542c081 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788460198.814756:0:17943:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788460198.814761:0:17943:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6a00/0x5dfa74784542c07a lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c081 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460198.814767:0:17943:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6a00/0x5dfa74784542c07a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c081 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788460198.814774:0:17943:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-barrier-ffff8c4be0237800 10000000:01000000:2.0:1788460198.814778:0:17943:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788460198.814810:0:17943:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-barrier-ffff8c4be0237800 from 1 10000000:01000000:2.0:1788460198.814813:0:17943:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788460198.814827:0:17943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6000/0x5dfa74784542c088 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460198.814834:0:17943:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6000/0x5dfa74784542c088 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460198.814841:0:17943:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6000/0x5dfa74784542c088 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460198.814854:0:17943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac42f0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:17943:1875336022375296:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788460198.814879:0:17943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460198.814908:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022375296 00000100:00100000:2.0:1788460198.814912:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022375296 00000100:00100000:2.0:1788460198.814929:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788460198.814935:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfc2e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+14:17943:x1875336022375296:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788460198.814980:0:17205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460198.814989:0:17205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4bfadc6600/0x5dfa74784542c08f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542c088 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460198.815296:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bfadc6600/0x5dfa74784542c08f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542c088 expref: 15 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460198.815306:0:17205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4bfadc6600/0x5dfa74784542c08f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542c088 expref: 15 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460198.815314:0:17205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bfadc6600, rc 0) 00000100:00100000:2.0:1788460198.815342:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfc2e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+15:17943:x1875336022375296:12345-0@lo:101:mount.lustre.0 Request processed in 406us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460198.815348:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788460198.815375:0:17943:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc4e73b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788460198.815388:0:17943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac42f0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:17943:1875336022375296:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788460198.815399:0:17943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6000/0x5dfa74784542c088 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c08f expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460198.815406:0:17943:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6000/0x5dfa74784542c088 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542c08f expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788460198.815417:0:17943:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788460198.815421:0:17943:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6000/0x5dfa74784542c088 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c08f expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460198.815438:0:17943:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6000/0x5dfa74784542c088 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c08f expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788460198.815444:0:17943:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1788460198.815448:0:17943:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788460198.815466:0:17943:0:(mgc_request_server.c:106:mgc_fs_setup()) mgc192.168.206.105@tcp: setup lustre-MDT0001-osd 00000040:01000000:2.0:1788460198.815519:0:17943:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.206.105@tcp ctxt 1 is initialized 00000040:01000000:2.0:1788460198.815525:0:17943:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.206.105@tcp ctxt 0 is initialized 10000000:01000000:2.0:1788460198.815531:0:17943:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-mdtir-ffff8c4be0237800 10000000:01000000:2.0:1788460198.815655:0:17943:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788460198.815684:0:17943:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1788460198.815687:0:17943:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1788460198.815703:0:17943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7000/0x5dfa74784542c096 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460198.815711:0:17943:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7000/0x5dfa74784542c096 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460198.815718:0:17943:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7000/0x5dfa74784542c096 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460198.815731:0:17943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac42f0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:17943:1875336022375424:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788460198.815756:0:17943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460198.815819:0:17943:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc3f66e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788460198.815925:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022375424 00000100:00100000:1.0:1788460198.815930:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022375424 00000100:00100000:0.0:1788460198.816143:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788460198.816153:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfc2e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+15:17943:x1875336022375424:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788460198.816163:0:17205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460198.816172:0:17205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4bc2bd4c00/0x5dfa74784542c09d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542c096 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460198.816189:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bc2bd4c00/0x5dfa74784542c09d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542c096 expref: 16 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460198.816197:0:17205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4bc2bd4c00/0x5dfa74784542c09d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542c096 expref: 16 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460198.816203:0:17205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc2bd4c00, rc 0) 00000100:00100000:0.0:1788460198.816257:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfc2e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+16:17943:x1875336022375424:12345-0@lo:101:mount.lustre.0 Request processed in 105us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460198.816263:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788460198.816393:0:17943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac42f0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:17943:1875336022375424:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788460198.816405:0:17943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7000/0x5dfa74784542c096 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c09d expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460198.816426:0:17943:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7000/0x5dfa74784542c096 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542c09d expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788460198.817873:0:17943:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x14:0x0] index 46 count 46 00000040:00080000:0.0:1788460198.818768:0:17943:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788460198.822576:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].1, 224 off8416 00000040:00080000:0.0:1788460198.822635:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].2, 136 off8552 00000040:00080000:0.0:1788460198.822652:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].3, 176 off8728 00000040:00080000:0.0:1788460198.822666:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].4, 224 off8952 00000040:00080000:0.0:1788460198.822681:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].5, 224 off9176 00000040:00080000:0.0:1788460198.822694:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].6, 120 off9296 00000040:00080000:0.0:1788460198.822706:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].7, 112 off9408 00000040:00080000:0.0:1788460198.822718:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].8, 160 off9568 00000040:00080000:0.0:1788460198.822730:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].9, 224 off9792 00000040:00080000:0.0:1788460198.822742:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].10, 224 off10016 00000040:00080000:0.0:1788460198.822756:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].11, 88 off10104 00000040:00080000:0.0:1788460198.822768:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].12, 144 off10248 00000040:00080000:0.0:1788460198.822779:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].13, 152 off10400 00000040:00080000:0.0:1788460198.822793:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].14, 168 off10568 00000040:00080000:0.0:1788460198.822807:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].15, 224 off10792 00000040:00080000:0.0:1788460198.822824:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].16, 224 off11016 00000040:00080000:0.0:1788460198.822840:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].17, 80 off11096 00000040:00080000:0.0:1788460198.822852:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].18, 224 off11320 00000040:00080000:0.0:1788460198.822865:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].19, 224 off11544 00000040:00080000:0.0:1788460198.822881:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].20, 160 off11704 00000040:00080000:0.0:1788460198.822896:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].21, 224 off11928 00000040:00080000:0.0:1788460198.822912:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].22, 224 off12152 00000040:00080000:0.0:1788460198.822927:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].23, 80 off12232 00000040:00080000:0.0:1788460198.822993:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].24, 224 off12456 00000040:00080000:0.0:1788460198.823391:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].25, 224 off12680 00000040:00080000:0.0:1788460198.823407:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].26, 88 off12768 00000040:00080000:0.0:1788460198.823420:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].27, 144 off12912 00000040:00080000:0.0:1788460198.823433:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].28, 152 off13064 00000040:00080000:0.0:1788460198.823459:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].29, 136 off13200 00000040:00080000:0.0:1788460198.823471:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].30, 224 off13424 00000040:00080000:0.0:1788460198.823484:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].31, 224 off13648 00000040:00080000:0.0:1788460198.823496:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].32, 80 off13728 00000040:00080000:0.0:1788460198.823507:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].33, 224 off13952 00000040:00080000:0.0:1788460198.823520:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].34, 224 off14176 00000040:00080000:0.0:1788460198.823545:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].35, 88 off14264 00000040:00080000:0.0:1788460198.823558:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].36, 144 off14408 00000040:00080000:0.0:1788460198.823570:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].37, 152 off14560 00000040:00080000:0.0:1788460198.823581:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].38, 136 off14696 00000040:00080000:0.0:1788460198.823591:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].39, 224 off14920 00000040:00080000:0.0:1788460198.823602:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].40, 224 off15144 00000040:00080000:0.0:1788460198.823611:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].41, 80 off15224 00000040:00080000:0.0:1788460198.823622:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].42, 224 off15448 00000040:00080000:0.0:1788460198.823631:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].43, 224 off15672 00000040:00080000:0.0:1788460198.823641:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].44, 120 off15792 00000040:00080000:0.0:1788460198.823664:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1b:0x0].45, 224 off16016 00000040:00080000:0.0:1788460198.823668:0:17943:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x14:0x0] index 45 count 46 00000100:00100000:0.0:1788460198.823758:0:17943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4394a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:17943:1875336022375552:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788460198.823815:0:17943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460198.824208:0:17943:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bf2fc5300 going to sleep for 11 seconds 00000100:00100000:2.0:1788460198.824339:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022375552 00000100:00100000:2.0:1788460198.824346:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022375552 00000100:00100000:2.0:1788460198.824383:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788460198.824391:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfc2e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+16:17943:x1875336022375552:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788460198.824623:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfc2e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+16:17943:x1875336022375552:12345-0@lo:501:mount.lustre.0 Request processed in 231us (806us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460198.824631:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788460198.824762:0:17943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4394a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:17943:1875336022375552:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788460198.824795:0:17943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4394a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:17943:1875336022375680:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788460198.824840:0:17943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460198.824889:0:17943:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bf2fc5300 going to sleep for 11 seconds 00000100:00100000:2.0:1788460198.824920:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022375680 00000100:00100000:2.0:1788460198.824925:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022375680 00000100:00100000:0.0:1788460198.825299:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788460198.825310:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfc2e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+16:17943:x1875336022375680:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788460198.825896:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfc2e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+16:17943:x1875336022375680:12345-0@lo:503:mount.lustre.0 Request processed in 587us (1053us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460198.825912:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788460198.826022:0:17943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4394a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:17943:1875336022375680:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788460198.826434:0:17943:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788460198.826501:0:17943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac42f0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:17943:1875336022375808:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788460198.826731:0:17943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460198.827002:0:17943:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bedf63240 going to sleep for 11 seconds 00000100:00100000:1.0:1788460198.827245:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022375808 00000100:00100000:1.0:1788460198.827251:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022375808 00000100:00100000:1.0:1788460198.827287:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788460198.827295:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfc2e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+16:17943:x1875336022375808:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788460198.828213:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfc2e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+16:17943:x1875336022375808:12345-0@lo:502:mount.lustre.0 Request processed in 916us (1478us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460198.828224:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788460198.828335:0:17943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac42f0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:17943:1875336022375808:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788460198.828570:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].1, 224 off8416 00000040:00080000:2.0:1788460198.828601:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].2, 136 off8552 00000040:00080000:2.0:1788460198.828615:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].3, 176 off8728 00000040:00080000:2.0:1788460198.828630:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].4, 224 off8952 00000040:00080000:2.0:1788460198.828646:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].5, 224 off9176 00000040:00080000:2.0:1788460198.828659:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].6, 120 off9296 00000040:00080000:2.0:1788460198.828671:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].7, 112 off9408 00000040:00080000:2.0:1788460198.828695:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].8, 160 off9568 00000040:00080000:2.0:1788460198.828709:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].9, 224 off9792 00000040:00080000:2.0:1788460198.828722:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].10, 224 off10016 00000040:00080000:2.0:1788460198.828736:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].11, 88 off10104 00000040:00080000:2.0:1788460198.828750:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].12, 144 off10248 00000040:00080000:2.0:1788460198.828763:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].13, 152 off10400 00000040:00080000:2.0:1788460198.828776:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].14, 168 off10568 00000040:00080000:2.0:1788460198.828792:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].15, 224 off10792 00000040:00080000:2.0:1788460198.828805:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].16, 224 off11016 00000040:00080000:2.0:1788460198.828817:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].17, 80 off11096 00000040:00080000:2.0:1788460198.828831:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].18, 224 off11320 00000040:00080000:2.0:1788460198.828845:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].19, 224 off11544 00000040:00080000:2.0:1788460198.828859:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].20, 160 off11704 00000040:00080000:2.0:1788460198.828872:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].21, 224 off11928 00000040:00080000:2.0:1788460198.828884:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].22, 224 off12152 00000040:00080000:2.0:1788460198.828897:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].23, 80 off12232 00000040:00080000:2.0:1788460198.828912:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].24, 224 off12456 00000040:00080000:2.0:1788460198.828925:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].25, 224 off12680 00000040:00080000:2.0:1788460198.828938:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].26, 88 off12768 00000040:00080000:2.0:1788460198.828987:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].27, 144 off12912 00000040:00080000:2.0:1788460198.829197:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].28, 152 off13064 00000040:00080000:2.0:1788460198.829214:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].29, 136 off13200 00000040:00080000:2.0:1788460198.829226:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].30, 224 off13424 00000040:00080000:2.0:1788460198.829306:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].31, 224 off13648 00000040:00080000:2.0:1788460198.829323:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].32, 80 off13728 00000040:00080000:2.0:1788460198.829335:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].33, 224 off13952 00000040:00080000:2.0:1788460198.829346:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].34, 224 off14176 00000040:00080000:2.0:1788460198.829360:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].35, 88 off14264 00000040:00080000:2.0:1788460198.829373:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].36, 144 off14408 00000040:00080000:2.0:1788460198.829384:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].37, 152 off14560 00000040:00080000:2.0:1788460198.829395:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].38, 136 off14696 00000040:00080000:2.0:1788460198.829408:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].39, 224 off14920 00000040:00080000:2.0:1788460198.829422:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].40, 224 off15144 00000040:00080000:2.0:1788460198.829448:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].41, 80 off15224 00000040:00080000:2.0:1788460198.829462:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].42, 224 off15448 00000040:00080000:2.0:1788460198.829478:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].43, 224 off15672 00000040:00080000:2.0:1788460198.829491:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].44, 120 off15792 00000100:00100000:2.0:1788460198.829592:0:17943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac42f0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:17943:1875336022375936:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788460198.829656:0:17943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460198.830229:0:17943:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bedf63240 going to sleep for 11 seconds 00000100:00100000:1.0:1788460198.830338:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022375936 00000100:00100000:1.0:1788460198.830345:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022375936 00000100:00100000:1.0:1788460198.830422:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788460198.830432:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfc2e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+16:17943:x1875336022375936:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788460198.830619:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfc2e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+16:17943:x1875336022375936:12345-0@lo:502:mount.lustre.0 Request processed in 189us (962us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460198.830627:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788460198.830735:0:17943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac42f0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:17943:1875336022375936:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788460198.830795:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1c:0x0].45, 224 off16016 00000040:00080000:2.0:1788460198.830805:0:17943:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:3.0:1788460198.831819:0:17947:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788460198.831830:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788460198.831832:0:17947:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1788460198.831838:0:17947:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1788460198.831841:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788460198.831855:0:17947:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff8c4bef213310) 00000020:00000080:3.0:1788460198.831874:0:17947:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:3.0:1788460198.831880:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788460198.832296:0:17947:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788460198.832307:0:17947:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5dfa74784542c0ab 00000020:00000080:3.0:1788460198.832521:0:17947:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1788460198.832527:0:17947:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788460198.832604:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788460198.832606:0:17947:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1788460198.832610:0:17947:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788460198.832614:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788460198.832615:0:17947:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1788460198.832619:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788460198.832635:0:17947:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff8c4bfb5f1988) 00000020:00000080:3.0:1788460198.832648:0:17947:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:3.0:1788460198.832652:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788460198.832654:0:17947:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1788460198.832657:0:17947:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1788460198.832662:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788460198.832720:0:17947:0:(tgt_mount.c:167:server_get_mount()) get mount ffff8c4be0237800 from lustre-MDT0001, refs=2 00000020:00000080:3.0:1788460198.832732:0:17947:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff8c4bfb5f6620) 00000020:00000080:3.0:1788460198.832741:0:17947:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:3.0:1788460198.832786:0:17947:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788460198.832791:0:17947:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5dfa74784542c0c0 00000020:00000080:3.0:1788460198.832886:0:17947:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1788460198.832893:0:17947:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788460198.832896:0:17947:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x5dfa74784542c0c7 00080000:01000000:3.0:1788460198.832901:0:17947:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788460198.832904:0:17947:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5dfa74784542c0ce 00010000:00010000:1.0:1788460198.903028:0:17947:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:1.0:1788460198.903533:0:17947:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:1.0:1788460198.904273:0:17947:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788460198.906171:0:17947:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1788460198.906184:0:17947:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788460198.906190:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788460198.906192:0:17947:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1788460198.906197:0:17947:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788460198.906202:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788460198.906204:0:17947:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1788460198.906208:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788460198.906212:0:17947:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.105@tcp to nid 0x20000c0a8ce69 (192.168.206.105@tcp) 00000020:00000080:3.0:1788460198.906900:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788460198.906916:0:17947:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff8c4bfb5f3310) 00000020:00000080:3.0:1788460198.906937:0:17947:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:3.0:1788460198.906966:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788460198.907201:0:17947:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1788460198.907208:0:17947:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788460198.907214:0:17947:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5dfa74784542c0dc 00010000:00080000:3.0:1788460198.907618:0:17947:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c4bff80a000@lustre-MDT0000-osp-MDT0001: add connection 192.168.206.105@tcp at head 00010000:00010000:3.0:1788460198.912806:0:17947:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:1.0:1788460198.915865:0:17947:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788460198.915880:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1788460198.915931:0:17947:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788460198.915986:0:17947:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5dfa74784542c0e3 00000100:00080000:1.0:1788460198.916109:0:17947:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788460198.916117:0:17947:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8c4bff80a000 using connection 192.168.206.105@tcp/0@lo 00000100:00100000:1.0:1788460198.916155:0:17947:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4ac1e61f80 x1875336022376064/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788460198.916176:0:17947:0:(pinger.c:380:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788460198.916271:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1875336022376064:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788460198.916336:0:3658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460198.916400:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022376064 00000100:00100000:3.0:1788460198.916407:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022376064 00000100:00100000:3.0:1788460198.916436:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788460198.916443:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4286300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3658:x1875336022376064:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788460198.916465:0:17217:0:(ldlm_lib.c:1461:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 496 last 0 00000020:00000080:3.0:1788460198.916504:0:17217:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5dfa74784542c0ea 00000004:00100000:3.0:1788460198.916517:0:17217:0:(mdt_handler.c:7310:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1788460198.916522:0:17217:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000020:01000000:1.0:1788460198.916801:0:17947:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788460198.916806:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788460198.916808:0:17947:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1788460198.916811:0:17947:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788460198.916814:0:17947:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1788460198.916815:0:17947:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788460198.916817:0:17947:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788460198.916818:0:17947:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788460198.916821:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788460198.916822:0:17947:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788460198.916825:0:17947:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788460198.916829:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788460198.916830:0:17947:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1788460198.916834:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788460198.916870:0:17947:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788460198.916886:0:17947:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788460198.916890:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788460198.916891:0:17947:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1788460198.916894:0:17947:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788460198.916903:0:17947:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:1.0:1788460198.916904:0:17947:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788460198.916906:0:17947:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788460198.916908:0:17947:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788460198.916911:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788460198.916912:0:17947:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788460198.916914:0:17947:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788460198.916918:0:17947:0:(obd_mount.c:1049:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1788460198.916921:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788460198.916922:0:17947:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788460198.916925:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788460198.916928:0:17947:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.105@tcp to nid 0x20000c0a8ce69 (192.168.206.105@tcp) 00000020:01000000:1.0:1788460198.916966:0:17947:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1788460198.916969:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788460198.916982:0:17947:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8c4ac1ef6620) 00000020:00000080:1.0:1788460198.917006:0:17947:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1788460198.917013:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788460198.917076:0:17947:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1788460198.917082:0:17947:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:1.0:1788460198.917087:0:17947:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5dfa74784542c0f8 00010000:00080000:1.0:1788460198.917115:0:17947:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c4bef370800@lustre-OST0000-osc-MDT0001: add connection 192.168.206.105@tcp at head 00010000:00010000:1.0:1788460198.917330:0:17947:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000040:01000000:3.0:1788460198.922332:0:17947:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1788460198.923311:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:0.0:1788460198.923332:0:8:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788460198.923337:0:8:0:(pinger.c:244:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788460198.923340:0:8:0:(import.c:65:import_set_state_nolock()) ffff8c4bfa02b800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788460198.923348:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 492 00000100:00080000:0.0:1788460198.923353:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788460198.923360:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8c4bfa02b800 using connection 192.168.206.105@tcp/0@lo 00000100:00100000:0.0:1788460198.923383:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4bc4394380 x1875336022376320/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788460198.923398:0:8:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788460198.923402:0:8:0:(pinger.c:254:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788460198.923404:0:8:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788460198.923407:0:8:0:(pinger.c:254:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788460198.923516:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788460198.923544:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4395180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3662:1875336022376448:0@lo:400:kworker.0 00000100:00100000:1.0:1788460198.923609:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460198.923656:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022376448 00000100:00100000:1.0:1788460198.923662:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022376448 00000100:00100000:1.0:1788460198.923704:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788460198.923712:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac1e63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1875336022376448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460198.923759:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac1e63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1875336022376448:12345-0@lo:400:kworker.0 Request processed in 48us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460198.923780:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788460198.923819:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8c4bc4395180 x1875336022376448/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460214 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460198.923833:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4395180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3662:1875336022376448:0@lo:400:kworker.0 00000100:00100000:3.0:1788460198.924064:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4394380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1875336022376320:0@lo:38:kworker.0 00000100:00100000:3.0:1788460198.924096:0:3658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460198.924131:0:17216:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1788460198.924139:0:17216:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00080000:3.0:1788460198.924284:0:17217:0:(import.c:65:import_set_state_nolock()) ffff8c4bf76ac000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788460198.924309:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4395c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c482be18-c056-4068-8a37-ed5038fc364a:3659:1875336022376192:0@lo:400:kworker.0 00000100:00100000:3.0:1788460198.924332:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4286300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3658:x1875336022376064:12345-0@lo:38:llog_process_th.0 Request processed in 7885us (7993us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460198.924341:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788460198.924348:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460198.924357:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022376320 00000100:00100000:3.0:1788460198.924363:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022376320 00000100:00100000:2.0:1788460198.924396:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022376192 00000100:00100000:2.0:1788460198.924400:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022376192 00000100:00100000:3.0:1788460198.924411:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788460198.924418:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4284000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3658:x1875336022376320:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1788460198.924432:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788460198.924439:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfc2e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+16:3659:x1875336022376192:12345-0@lo:400:kworker.0 00000040:01000000:1.0:1788460198.925417:0:17947:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:2.0:1788460198.925456:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfc2e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+16:3659:x1875336022376192:12345-0@lo:400:kworker.0 Request processed in 1015us (1106us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460198.925465:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788460198.926129:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4395c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c482be18-c056-4068-8a37-ed5038fc364a:3659:1875336022376192:0@lo:400:kworker.0 00000100:00100000:3.0:1788460198.926510:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4284000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3658:x1875336022376320:12345-0@lo:38:kworker.0 Request processed in 2078us (2400us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788460198.926520:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788460198.926624:0:3658:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788460198.926631:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c4bfa02b800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788460198.926647:0:3658:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788460198.926651:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4394380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1875336022376320:0@lo:38:kworker.0 00000100:00100000:3.0:1788460198.926663:0:3658:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788460198.926686:0:3658:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1788460198.926694:0:3658:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1788460198.926714:0:3658:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788460198.926737:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c4bff80a000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788460198.926784:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1875336022376064:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788460198.927137:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788460198.927149:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4395c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022376576:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788460198.927199:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460198.928900:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022376576 00000100:00100000:2.0:1788460198.928910:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022376576 00000040:00080000:3.0:1788460198.929202:0:17947:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788460198.929774:0:17952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788460198.929785:0:17952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4286d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3661:x1875336022376576:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788460198.929850:0:17952:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788460198.929923:0:17952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4286d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3661:x1875336022376576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 140us (2724us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460198.929931:0:17952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788460198.930099:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4395c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022376576:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1788460198.930138:0:17947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1788460198.930562:0:17947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000040:00080000:0.0:1788460198.931212:0:17953:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788460198.931218:0:17953:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788460198.932215:0:17947:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788460198.932229:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788460198.932278:0:17947:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788460198.932299:0:17947:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5dfa74784542c0ff 00000100:00080000:3.0:1788460198.932309:0:17947:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788460198.932315:0:17947:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8c4bef370800 using connection 192.168.206.105@tcp/0@lo 00000100:00100000:3.0:1788460198.932350:0:17947:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4ac4285880 x1875336022376704/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788460198.932378:0:17947:0:(pinger.c:380:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:2.0:1788460198.932462:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4285880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1875336022376704:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788460198.932513:0:3658:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875336022376704 offset 0 length 520: 4 00000020:01000000:3.0:1788460198.932735:0:17947:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788460198.932739:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788460198.932741:0:17947:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788460198.932744:0:17947:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788460198.932747:0:17947:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:3.0:1788460198.932748:0:17947:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788460198.932750:0:17947:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788460198.932751:0:17947:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788460198.932754:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788460198.932755:0:17947:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788460198.932757:0:17947:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788460198.932770:0:17947:0:(obd_mount.c:1049:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1788460198.932774:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788460198.932776:0:17947:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788460198.932780:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788460198.932784:0:17947:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.105@tcp to nid 0x20000c0a8ce69 (192.168.206.105@tcp) 00000020:01000000:3.0:1788460198.932803:0:17947:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1788460198.932805:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788460198.932816:0:17947:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8c4bfb5f0000) 00000020:00000080:3.0:1788460198.932830:0:17947:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:3.0:1788460198.932834:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788460198.932900:0:17947:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:3.0:1788460198.932906:0:17947:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788460198.932913:0:17947:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5dfa74784542c10d 00010000:00080000:3.0:1788460198.932939:0:17947:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c4ac1eca800@lustre-OST0001-osc-MDT0001: add connection 192.168.206.105@tcp at head 00010000:00010000:3.0:1788460198.933184:0:17947:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:3.0:1788460198.933369:0:17947:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788460198.933385:0:17947:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:3.0:1788460198.935477:0:17947:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788460198.936281:0:17947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1788460198.936395:0:17947:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000100:00080000:1.0:1788460198.936855:0:8:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788460198.936861:0:8:0:(pinger.c:254:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788460198.936863:0:8:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788460198.936866:0:8:0:(pinger.c:254:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:3.0:1788460198.937201:0:17955:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788460198.937206:0:17955:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788460198.937906:0:17947:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788460198.937918:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788460198.938162:0:17947:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788460198.938185:0:17947:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5dfa74784542c114 00000100:00080000:0.0:1788460198.938194:0:17947:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788460198.938200:0:17947:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8c4ac1eca800 using connection 192.168.206.105@tcp/0@lo 00000100:00100000:0.0:1788460198.938233:0:17947:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4bc4395c00 x1875336022376832/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788460198.938341:0:17947:0:(pinger.c:380:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788460198.938439:0:17947:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788460198.938443:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788460198.938445:0:17947:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788460198.938448:0:17947:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788460198.938452:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788460198.938454:0:17947:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788460198.938457:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788460198.938459:0:17947:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788460198.938461:0:17947:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788460198.938463:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788460198.938464:0:17947:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788460198.938467:0:17947:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788460198.938469:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788460198.938470:0:17947:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788460198.938474:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788460198.938498:0:17947:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788460198.938501:0:17947:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788460198.938502:0:17947:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788460198.938505:0:17947:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1c:0x0] index 46 count 46 00000100:00100000:2.0:1788460198.938726:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4395c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1875336022376832:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788460198.938777:0:3658:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875336022376832 offset 0 length 520: 4 00000020:01000000:2.0:1788460198.938824:0:17943:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:2.0:1788460198.938844:0:17943:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1788460198.938864:0:17943:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7000/0x5dfa74784542c096 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c09d expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460198.938875:0:17943:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7000/0x5dfa74784542c096 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c09d expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788460198.938882:0:17943:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-mdtir-ffff8c4be0237800 from 1 10000000:01000000:2.0:1788460198.938886:0:17943:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788460198.938911:0:17943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7600/0x5dfa74784542c11b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460198.938919:0:17943:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7600/0x5dfa74784542c11b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460198.938931:0:17943:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7600/0x5dfa74784542c11b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460198.938980:0:17943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac42f0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:17943:1875336022376960:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788460198.939026:0:17943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460198.939067:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022376960 00000100:00100000:2.0:1788460198.939073:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022376960 00000100:00100000:2.0:1788460198.939111:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788460198.939119:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfc2e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+16:17943:x1875336022376960:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788460198.939132:0:17206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460198.939143:0:17206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4bfadc6c00/0x5dfa74784542c122 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542c11b expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460198.939164:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bfadc6c00/0x5dfa74784542c122 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542c11b expref: 17 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460198.939188:0:17206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4bfadc6c00/0x5dfa74784542c122 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542c11b expref: 17 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460198.939197:0:17206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bfadc6c00, rc 0) 00000100:00100000:2.0:1788460198.939227:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfc2e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+17:17943:x1875336022376960:12345-0@lo:101:mount.lustre.0 Request processed in 108us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460198.939234:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788460198.939282:0:17943:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4be27c3cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788460198.939300:0:17943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac42f0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:17943:1875336022376960:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788460198.939313:0:17943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7600/0x5dfa74784542c11b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c122 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460198.939321:0:17943:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7600/0x5dfa74784542c11b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542c122 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788460198.939807:0:8:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788460198.939812:0:8:0:(pinger.c:254:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788460198.939815:0:8:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788460198.939818:0:8:0:(pinger.c:254:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788460198.940240:0:17943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac42f0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:17943:1875336022377088:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788460198.940286:0:17943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460198.940318:0:17943:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4be27c3cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788460198.940395:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022377088 00000100:00100000:1.0:1788460198.940400:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022377088 00000100:00100000:1.0:1788460198.940441:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788460198.940449:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfc2e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+17:17943:x1875336022377088:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1788460198.940612:0:17204:0:(mgs_nids.c:1209:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788460198.940627:0:17204:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788460198.940631:0:17204:0:(mgs_nids.c:325:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1788460198.941003:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfc2e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+17:17943:x1875336022377088:12345-0@lo:256:mount.lustre.0 Request processed in 553us (714us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460198.941011:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788460198.941131:0:17943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac42f0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:17943:1875336022377088:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788460198.942378:0:17943:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788460198.942428:0:17943:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7600/0x5dfa74784542c11b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c122 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460198.942439:0:17943:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7600/0x5dfa74784542c11b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c122 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788460198.942597:0:17943:0:(mgc_request.c:2266:mgc_process_log()) Process log params-ffff8c4be0237800 from 1 10000000:01000000:2.0:1788460198.942600:0:17943:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788460198.942631:0:17943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7400/0x5dfa74784542c129 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460198.942639:0:17943:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7400/0x5dfa74784542c129 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460198.942649:0:17943:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7400/0x5dfa74784542c129 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460198.942669:0:17943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac42f0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:17943:1875336022377216:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788460198.942775:0:17943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460198.942849:0:17943:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4be27c3cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788460198.942902:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022377216 00000100:00100000:0.0:1788460198.942909:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022377216 00000100:00100000:2.0:1788460198.943159:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788460198.943169:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfc2e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+17:17943:x1875336022377216:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788460198.943182:0:17206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460198.943195:0:17206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4bfadc6400/0x5dfa74784542c130 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542c129 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460198.943217:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bfadc6400/0x5dfa74784542c130 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542c129 expref: 18 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460198.943227:0:17206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4bfadc6400/0x5dfa74784542c130 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542c129 expref: 18 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460198.943333:0:17206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bfadc6400, rc 0) 00000100:00100000:2.0:1788460198.943416:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfc2e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+18:17943:x1875336022377216:12345-0@lo:101:mount.lustre.0 Request processed in 248us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460198.943430:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788460198.943611:0:17943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac42f0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:17943:1875336022377216:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788460198.943626:0:17943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7400/0x5dfa74784542c129 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c130 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460198.943634:0:17943:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7400/0x5dfa74784542c129 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542c130 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788460198.948434:0:17943:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1a:0x0] index 13 count 13 00000040:00080000:2.0:1788460198.949098:0:17943:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788460198.949352:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].1, 224 off8416 00000040:00080000:2.0:1788460198.949375:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].2, 112 off8528 00000040:00080000:2.0:1788460198.949399:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].3, 224 off8752 00000040:00080000:2.0:1788460198.949412:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].4, 224 off8976 00000040:00080000:2.0:1788460198.949422:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].5, 112 off9088 00000040:00080000:2.0:1788460198.949433:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].6, 224 off9312 00000040:00080000:2.0:1788460198.949444:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].7, 224 off9536 00000040:00080000:2.0:1788460198.949455:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].8, 128 off9664 00000040:00080000:2.0:1788460198.949466:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].9, 224 off9888 00000040:00080000:2.0:1788460198.949677:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].10, 224 off10112 00000040:00080000:2.0:1788460198.949770:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].11, 128 off10240 00000040:00080000:2.0:1788460198.949789:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1d:0x0].12, 224 off10464 00000040:00080000:2.0:1788460198.949794:0:17943:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1a:0x0] index 12 count 13 00000100:00100000:2.0:1788460198.949870:0:17943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac42f0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:17943:1875336022377344:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788460198.949929:0:17943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460198.950154:0:17943:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bd0b85f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788460198.950359:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022377344 00000100:00100000:1.0:1788460198.950366:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022377344 00000100:00100000:2.0:1788460198.950676:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788460198.950757:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfc2e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+18:17943:x1875336022377344:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788460198.950935:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfc2e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+18:17943:x1875336022377344:12345-0@lo:501:mount.lustre.0 Request processed in 181us (1004us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460198.950981:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788460198.951329:0:17943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac42f0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:17943:1875336022377344:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788460198.951369:0:17943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4287800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:17943:1875336022377472:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788460198.951417:0:17943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460198.951498:0:17943:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bd47b9840 going to sleep for 11 seconds 00000100:00100000:2.0:1788460198.951765:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022377472 00000100:00100000:2.0:1788460198.951771:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022377472 00000100:00100000:2.0:1788460198.951855:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788460198.951865:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfc2e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+18:17943:x1875336022377472:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788460198.952008:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfc2e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+18:17943:x1875336022377472:12345-0@lo:503:mount.lustre.0 Request processed in 144us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460198.952016:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788460198.952105:0:17943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4287800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:17943:1875336022377472:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788460198.952517:0:17943:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788460198.952606:0:17943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4287800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:17943:1875336022377600:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788460198.952649:0:17943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460198.953486:0:17943:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bd47b9840 going to sleep for 11 seconds 00000100:00100000:0.0:1788460198.953676:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022377600 00000100:00100000:0.0:1788460198.953683:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022377600 00000100:00100000:1.0:1788460198.953854:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788460198.953864:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfc2e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+18:17943:x1875336022377600:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788460198.954335:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfc2e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+18:17943:x1875336022377600:12345-0@lo:502:mount.lustre.0 Request processed in 471us (1685us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460198.954343:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788460198.954654:0:17943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4287800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:17943:1875336022377600:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788460198.954874:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].1, 224 off8416 00000040:00080000:3.0:1788460198.954903:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].2, 112 off8528 00000040:00080000:3.0:1788460198.954918:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].3, 224 off8752 00000040:00080000:3.0:1788460198.954929:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].4, 224 off8976 00000040:00080000:3.0:1788460198.955230:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].5, 112 off9088 00000040:00080000:3.0:1788460198.955326:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].6, 224 off9312 00000040:00080000:3.0:1788460198.955342:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].7, 224 off9536 00000040:00080000:3.0:1788460198.955358:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].8, 128 off9664 00000040:00080000:3.0:1788460198.955372:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].9, 224 off9888 00000040:00080000:3.0:1788460198.955384:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].10, 224 off10112 00000040:00080000:3.0:1788460198.955397:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].11, 128 off10240 00000100:00100000:3.0:1788460198.955433:0:17943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4287800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:17943:1875336022377728:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788460198.955666:0:17943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460198.955752:0:17943:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bd47b9840 going to sleep for 11 seconds 00000100:00100000:1.0:1788460198.955810:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022377728 00000100:00100000:1.0:1788460198.955816:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022377728 00000100:00100000:1.0:1788460198.955860:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788460198.955869:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4040450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+18:17943:x1875336022377728:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788460198.956171:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4040450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+18:17943:x1875336022377728:12345-0@lo:502:mount.lustre.0 Request processed in 302us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460198.956179:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788460198.956322:0:17943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4287800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:17943:1875336022377728:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788460198.956373:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1e:0x0].12, 224 off10464 00000040:00080000:3.0:1788460198.956382:0:17943:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1788460198.957646:0:17957:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788460198.957656:0:17957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788460198.957659:0:17957:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788460198.957668:0:17957:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c4be0237800 00000020:00000080:0.0:1788460198.957671:0:17957:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788460198.957678:0:17957:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788460198.957681:0:17957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788460198.957683:0:17957:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788460198.957685:0:17957:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788460198.957688:0:17957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788460198.957689:0:17957:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788460198.957692:0:17957:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c4be0237800 00000020:00000080:0.0:1788460198.957694:0:17957:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788460198.957787:0:17957:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788460198.957791:0:17957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788460198.957792:0:17957:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788460198.957795:0:17957:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788460198.957797:0:17957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788460198.957798:0:17957:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788460198.957801:0:17957:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8c4be0237800 00000020:00000080:0.0:1788460198.957803:0:17957:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788460198.963680:0:17957:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788460198.963760:0:17957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788460198.963764:0:17957:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788460198.963770:0:17957:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788460198.963775:0:17957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788460198.963776:0:17957:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788460198.963782:0:17957:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8c4be0237800 00000020:00000080:1.0:1788460198.963784:0:17957:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788460198.963847:0:17957:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788460198.963858:0:17957:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788460198.963859:0:17957:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788460198.963863:0:17957:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1e:0x0] index 13 count 13 00000020:01000000:0.0:1788460198.964870:0:17943:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788460198.964884:0:17943:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788460198.964899:0:17943:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7400/0x5dfa74784542c129 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c130 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460198.964910:0:17943:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7400/0x5dfa74784542c129 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c130 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788460198.965645:0:17943:0:(mgc_request.c:2423:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788460198.965650:0:17943:0:(mgc_request.c:424:config_log_add()) add config log lustre-client-ffff8c4be0237800 10000000:01000000:0.0:1788460198.965653:0:17943:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-client-ffff8c4be0237800 10000000:01000000:0.0:1788460198.965662:0:17943:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788460198.965683:0:17943:0:(mgc_request_server.c:106:mgc_fs_setup()) mgc192.168.206.105@tcp: setup lustre-MDT0001-osd 00000040:01000000:0.0:1788460198.965774:0:17943:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.206.105@tcp ctxt 1 is initialized 00000040:01000000:0.0:1788460198.965782:0:17943:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.206.105@tcp ctxt 0 is initialized 10000000:01000000:0.0:1788460198.965794:0:17943:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-client-ffff8c4be0237800 from 1 10000000:01000000:0.0:1788460198.965797:0:17943:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788460198.965829:0:17943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bc2bd5800/0x5dfa74784542c137 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460198.965839:0:17943:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4bc2bd5800/0x5dfa74784542c137 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460198.965850:0:17943:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4bc2bd5800/0x5dfa74784542c137 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460198.965873:0:17943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4394380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:17943:1875336022377856:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788460198.965932:0:17943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460198.966215:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022377856 00000100:00100000:3.0:1788460198.966222:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022377856 00000100:00100000:3.0:1788460198.966264:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788460198.966272:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4040050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+18:17943:x1875336022377856:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788460198.966285:0:17206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460198.966298:0:17206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4bc29d2a00/0x5dfa74784542c13e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542c137 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460198.966333:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bc29d2a00/0x5dfa74784542c13e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542c137 expref: 19 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460198.966343:0:17206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4bc29d2a00/0x5dfa74784542c13e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542c137 expref: 19 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460198.966351:0:17206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc29d2a00, rc 0) 00000100:00100000:3.0:1788460198.967262:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4040050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+19:17943:x1875336022377856:12345-0@lo:101:mount.lustre.0 Request processed in 985us (1324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460198.967273:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788460198.967626:0:17943:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4be27c3cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788460198.967650:0:17943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4394380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:17943:1875336022377856:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788460198.967668:0:17943:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4bc2bd5800/0x5dfa74784542c137 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c13e expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460198.967678:0:17943:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4bc2bd5800/0x5dfa74784542c137 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542c13e expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788460198.976112:0:17943:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000040:00080000:0.0:1788460198.976395:0:17943:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788460198.978163:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].1, 224 off8416 00000040:00080000:3.0:1788460198.978210:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].2, 120 off8536 00000040:00080000:3.0:1788460198.978228:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].3, 168 off8704 00000040:00080000:3.0:1788460198.978242:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].4, 224 off8928 00000040:00080000:3.0:1788460198.978256:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].5, 224 off9152 00000040:00080000:3.0:1788460198.978271:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].6, 120 off9272 00000040:00080000:3.0:1788460198.978301:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].7, 168 off9440 00000040:00080000:3.0:1788460198.978318:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].8, 224 off9664 00000040:00080000:3.0:1788460198.978330:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].9, 224 off9888 00000040:00080000:3.0:1788460198.978344:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].10, 120 off10008 00000040:00080000:3.0:1788460198.978355:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].11, 224 off10232 00000040:00080000:3.0:1788460198.978368:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].12, 224 off10456 00000040:00080000:3.0:1788460198.978380:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].13, 88 off10544 00000040:00080000:3.0:1788460198.978393:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].14, 128 off10672 00000040:00080000:3.0:1788460198.978407:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].15, 144 off10816 00000040:00080000:3.0:1788460198.978420:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].16, 160 off10976 00000040:00080000:3.0:1788460198.978433:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].17, 224 off11200 00000040:00080000:3.0:1788460198.978447:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].18, 224 off11424 00000040:00080000:3.0:1788460198.978460:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].19, 80 off11504 00000040:00080000:3.0:1788460198.978484:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].20, 224 off11728 00000040:00080000:3.0:1788460198.978499:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].21, 224 off11952 00000040:00080000:3.0:1788460198.978510:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].22, 88 off12040 00000040:00080000:3.0:1788460198.981172:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].23, 128 off12168 00000040:00080000:3.0:1788460198.981222:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].24, 144 off12312 00000040:00080000:3.0:1788460198.981250:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].25, 160 off12472 00000040:00080000:3.0:1788460198.981275:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].26, 224 off12696 00000040:00080000:3.0:1788460198.981299:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].27, 224 off12920 00000040:00080000:3.0:1788460198.981323:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].28, 80 off13000 00000040:00080000:3.0:1788460198.981348:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].29, 224 off13224 00000040:00080000:3.0:1788460198.981372:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].30, 224 off13448 00000040:00080000:3.0:1788460198.981395:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].31, 88 off13536 00000040:00080000:3.0:1788460198.981411:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].32, 128 off13664 00000040:00080000:3.0:1788460198.981432:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].33, 144 off13808 00000040:00080000:3.0:1788460198.981456:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].34, 128 off13936 00000040:00080000:3.0:1788460198.981481:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].35, 224 off14160 00000040:00080000:3.0:1788460198.981505:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].36, 224 off14384 00000040:00080000:3.0:1788460198.981525:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].37, 80 off14464 00000040:00080000:3.0:1788460198.981982:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].38, 224 off14688 00000040:00080000:3.0:1788460198.982176:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].39, 224 off14912 00000040:00080000:3.0:1788460198.982196:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].40, 88 off15000 00000040:00080000:3.0:1788460198.982212:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].41, 128 off15128 00000040:00080000:3.0:1788460198.982226:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].42, 144 off15272 00000040:00080000:3.0:1788460198.982240:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].43, 128 off15400 00000040:00080000:3.0:1788460198.982253:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].44, 224 off15624 00000040:00080000:3.0:1788460198.982268:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].45, 224 off15848 00000040:00080000:3.0:1788460198.982283:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].46, 80 off15928 00000040:00080000:3.0:1788460198.982297:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].47, 224 off16152 00000040:00080000:3.0:1788460198.982313:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].48, 232 off16384 00000040:00080000:3.0:1788460198.982473:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].49, 224 off16608 00000040:00080000:3.0:1788460198.982495:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].50, 120 off16728 00000040:00080000:3.0:1788460198.982516:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1f:0x0].51, 224 off16952 00000040:00080000:3.0:1788460198.982522:0:17943:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 51 count 51 00000100:00100000:3.0:1788460198.982833:0:17943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4287800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:17943:1875336022377984:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788460198.983661:0:17943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460198.986452:0:17943:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bd47b9c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788460198.987620:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022377984 00000100:00100000:1.0:1788460198.987630:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022377984 00000100:00100000:1.0:1788460198.987681:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788460198.987691:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4043050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+19:17943:x1875336022377984:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788460198.987845:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4043050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+19:17943:x1875336022377984:12345-0@lo:501:mount.lustre.0 Request processed in 155us (4185us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460198.987853:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788460198.988699:0:17943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4287800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:17943:1875336022377984:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788460198.988751:0:17943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e60380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:17943:1875336022378112:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788460198.988808:0:17943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460198.989140:0:17943:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc682b3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788460198.989162:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022378112 00000100:00100000:1.0:1788460198.989168:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022378112 00000100:00100000:1.0:1788460198.989216:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788460198.989227:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4043450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+19:17943:x1875336022378112:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788460198.989328:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4043450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+19:17943:x1875336022378112:12345-0@lo:503:mount.lustre.0 Request processed in 103us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460198.989336:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788460198.989385:0:17943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e60380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:17943:1875336022378112:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788460198.989808:0:17943:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788460198.989892:0:17943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e60380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:17943:1875336022378240:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788460198.989934:0:17943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460198.989985:0:17943:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc682b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788460198.990114:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022378240 00000100:00100000:2.0:1788460198.990130:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022378240 00000100:00100000:2.0:1788460198.990165:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788460198.990174:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4041850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+19:17943:x1875336022378240:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788460198.990277:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4041850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+19:17943:x1875336022378240:12345-0@lo:502:mount.lustre.0 Request processed in 105us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460198.990285:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788460198.990413:0:17943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e60380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:17943:1875336022378240:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788460198.990625:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].1, 224 off8416 00000040:00080000:1.0:1788460198.990650:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].2, 120 off8536 00000040:00080000:1.0:1788460198.990664:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].3, 168 off8704 00000040:00080000:1.0:1788460198.990676:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].4, 224 off8928 00000040:00080000:1.0:1788460198.990690:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].5, 224 off9152 00000040:00080000:1.0:1788460198.990704:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].6, 120 off9272 00000040:00080000:1.0:1788460198.990734:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].7, 168 off9440 00000040:00080000:1.0:1788460198.990749:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].8, 224 off9664 00000040:00080000:1.0:1788460198.990763:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].9, 224 off9888 00000040:00080000:1.0:1788460198.990776:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].10, 120 off10008 00000040:00080000:1.0:1788460198.990789:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].11, 224 off10232 00000040:00080000:1.0:1788460198.990800:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].12, 224 off10456 00000040:00080000:1.0:1788460198.990814:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].13, 88 off10544 00000040:00080000:1.0:1788460198.990827:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].14, 128 off10672 00000040:00080000:1.0:1788460198.992073:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].15, 144 off10816 00000040:00080000:1.0:1788460198.992110:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].16, 160 off10976 00000040:00080000:1.0:1788460198.992128:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].17, 224 off11200 00000040:00080000:1.0:1788460198.992144:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].18, 224 off11424 00000040:00080000:1.0:1788460198.992158:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].19, 80 off11504 00000040:00080000:1.0:1788460198.992170:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].20, 224 off11728 00000040:00080000:1.0:1788460198.992184:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].21, 224 off11952 00000040:00080000:1.0:1788460198.992197:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].22, 88 off12040 00000040:00080000:1.0:1788460198.992233:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].23, 128 off12168 00000040:00080000:1.0:1788460198.992251:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].24, 144 off12312 00000040:00080000:1.0:1788460198.992265:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].25, 160 off12472 00000040:00080000:1.0:1788460198.992277:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].26, 224 off12696 00000040:00080000:1.0:1788460198.992291:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].27, 224 off12920 00000040:00080000:1.0:1788460198.992303:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].28, 80 off13000 00000040:00080000:1.0:1788460198.992316:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].29, 224 off13224 00000040:00080000:1.0:1788460198.992328:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].30, 224 off13448 00000040:00080000:1.0:1788460198.992339:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].31, 88 off13536 00000040:00080000:1.0:1788460198.992363:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].32, 128 off13664 00000040:00080000:1.0:1788460198.992378:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].33, 144 off13808 00000040:00080000:1.0:1788460198.992391:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].34, 128 off13936 00000040:00080000:1.0:1788460198.992402:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].35, 224 off14160 00000040:00080000:1.0:1788460198.992415:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].36, 224 off14384 00000040:00080000:1.0:1788460198.992427:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].37, 80 off14464 00000040:00080000:1.0:1788460198.992439:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].38, 224 off14688 00000040:00080000:1.0:1788460198.992464:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].39, 224 off14912 00000040:00080000:1.0:1788460198.992479:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].40, 88 off15000 00000040:00080000:1.0:1788460198.992491:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].41, 128 off15128 00000040:00080000:1.0:1788460198.992504:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].42, 144 off15272 00000040:00080000:1.0:1788460198.992517:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].43, 128 off15400 00000040:00080000:1.0:1788460198.992935:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].44, 224 off15624 00000040:00080000:1.0:1788460198.993127:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].45, 224 off15848 00000040:00080000:1.0:1788460198.993141:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].46, 80 off15928 00000040:00080000:1.0:1788460198.993154:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].47, 224 off16152 00000040:00080000:1.0:1788460198.993166:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].48, 232 off16384 00000100:00100000:1.0:1788460198.993216:0:17943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e60380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:17943:1875336022378368:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788460198.993286:0:17943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460198.993326:0:17943:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc682b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788460198.993482:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022378368 00000100:00100000:2.0:1788460198.993490:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022378368 00000100:00100000:2.0:1788460198.993544:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788460198.993553:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4040850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+19:17943:x1875336022378368:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788460198.993659:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4040850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+19:17943:x1875336022378368:12345-0@lo:502:mount.lustre.0 Request processed in 107us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460198.993666:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788460198.997409:0:17943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e60380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:17943:1875336022378368:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788460198.999430:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].49, 224 off16608 00000040:00080000:0.0:1788460198.999593:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].50, 120 off16728 00000100:00100000:0.0:1788460198.999644:0:17943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4394380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:17943:1875336022378496:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788460199.002544:0:17943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460199.002599:0:17943:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4be27c3cc0 going to sleep for 10 seconds 00000100:00100000:1.0:1788460199.002625:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022378496 00000100:00100000:1.0:1788460199.002633:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022378496 00000100:00100000:1.0:1788460199.002680:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788460199.002690:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4040c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+19:17943:x1875336022378496:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788460199.002833:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4040c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+19:17943:x1875336022378496:12345-0@lo:502:mount.lustre.0 Request processed in 144us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460199.002845:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788460199.002930:0:17943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4394380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:17943:1875336022378496:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788460199.003315:0:17943:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x20:0x0].51, 224 off16952 00000040:00080000:0.0:1788460199.003332:0:17943:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1788460199.004244:0:17962:0:(obd_mount.c:308:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1788460199.004259:0:17962:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff8c4c019a1988) 00000020:00000080:0.0:1788460199.004279:0:17962:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:0.0:1788460199.004355:0:17962:0:(tgt_mount.c:167:server_get_mount()) get mount ffff8c4be0237800 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1788460199.004359:0:17962:0:(tgt_mount.c:201:server_put_mount()) put mount ffff8c4be0237800 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1788460199.004361:0:17962:0:(obd_mount.c:798:lustre_put_lsi()) put ffff8c4be0237800 3 00010000:00080000:0.0:1788460199.004389:0:17962:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c4ac3ae5800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.206.105@tcp at head 00010000:00010000:0.0:1788460199.009746:0:17962:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:0.0:1788460199.009938:0:17962:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:0.0:1788460199.010007:0:17962:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788460199.010022:0:17962:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x5dfa74784542c14c 00000100:00080000:0.0:1788460199.010033:0:17962:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788460199.010049:0:17962:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8c4ac3ae5800 using connection 192.168.206.105@tcp/0@lo 00000100:00100000:1.0:1788460199.010103:0:17962:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4ac1e61500 x1875336022378624/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788460199.010129:0:17962:0:(pinger.c:380:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788460199.010156:0:8:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788460199.010161:0:8:0:(pinger.c:254:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788460199.010164:0:8:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788460199.010167:0:8:0:(pinger.c:254:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788460199.011270:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1875336022378624:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1788460199.011496:0:17962:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x20:0x0] index 52 count 51 00000100:00100000:0.0:1788460199.011841:0:3658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460199.012349:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022378624 00000100:00100000:3.0:1788460199.012358:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022378624 00000100:00100000:3.0:1788460199.012399:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788460199.012407:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc4394380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3658:x1875336022378624:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788460199.012433:0:17211:0:(ldlm_lib.c:1461:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 496 last 0 00000020:00000080:3.0:1788460199.012489:0:17211:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x5dfa74784542c153 00000004:00100000:3.0:1788460199.012504:0:17211:0:(mdt_handler.c:7310:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788460199.012541:0:17211:0:(import.c:65:import_set_state_nolock()) ffff8c4ac1ecc800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788460199.012602:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc4394380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3658:x1875336022378624:12345-0@lo:38:llog_process_th.0 Request processed in 194us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460199.012609:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788460199.012651:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8c4ac1e61500 x1875336022378624/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788460209 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460199.012661:0:3658:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788460199.012668:0:3658:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1788460199.012675:0:3658:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788460199.012678:0:3658:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788460199.012681:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c4ac3ae5800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788460199.012698:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3658:1875336022378624:0@lo:38:llog_process_th.0 00000020:01000000:1.0:1788460199.012754:0:17943:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788460199.012770:0:17943:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788460199.012784:0:17943:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bc2bd5800/0x5dfa74784542c137 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c13e expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460199.012794:0:17943:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4bc2bd5800/0x5dfa74784542c137 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c13e expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788460199.012844:0:17943:0:(tgt_mount.c:1239:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788460199.012847:0:17943:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788460199.012848:0:17943:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788460199.012850:0:17943:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:1.0:1788460199.012851:0:17943:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:1.0:1788460199.012852:0:17943:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:1.0:1788460199.012853:0:17943:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788460199.012855:0:17943:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788460199.012857:0:17943:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788460199.012860:0:17943:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:1.0:1788460199.012862:0:17943:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788460199.012863:0:17943:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788460199.012865:0:17943:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788460199.012866:0:17943:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:1.0:1788460199.012867:0:17943:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:1.0:1788460199.012867:0:17943:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:1.0:1788460199.012868:0:17943:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788460199.012869:0:17943:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788460199.012870:0:17943:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788460199.012888:0:17943:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1788460199.012902:0:17943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e62a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:17943:1875336022378752:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788460199.012967:0:17943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460199.012992:0:17943:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc682bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788460199.015195:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022378752 00000100:00100000:1.0:1788460199.015208:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022378752 00000100:00100000:1.0:1788460199.015266:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788460199.015276:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4043c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+19:17943:x1875336022378752:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788460199.015307:0:17205:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788460199.015320:0:17205:0:(mgs_nids.c:475:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:3.0:1788460199.018079:0:17192:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:1.0:1788460199.018356:0:17205:0:(mgs_nids.c:842:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788460199.018370:0:17205:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:1.0:1788460199.018486:0:17227:0:(mgs_nids.c:739:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788460199.018492:0:17227:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788460199.018515:0:17227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c4ac3677c00/0x5dfa74784542c15a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460199.018533:0:17227:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4bfadc7200/0x5dfa74784542c050 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542c049 expref: 19 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460199.018542:0:17227:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4bfadc6c00/0x5dfa74784542c122 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542c11b expref: 19 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460199.018550:0:17227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c4ac3677c00/0x5dfa74784542c15a lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460199.018589:0:17227:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4bfadc6c00/0x5dfa74784542c122 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5dfa74784542c11b expref: 19 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460199.018602:0:17227:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c4bfadc6c00/0x5dfa74784542c122 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5dfa74784542c11b expref: 19 pid: 17206 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460199.018616:0:17227:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e60a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17227:1875336022378880:0@lo:104: 00000100:00100000:1.0:1788460199.018850:0:17227:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788460199.019003:0:17227:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4bfadc7200/0x5dfa74784542c050 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5dfa74784542c049 expref: 19 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460199.019013:0:17227:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c4bfadc7200/0x5dfa74784542c050 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5dfa74784542c049 expref: 19 pid: 17204 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460199.019022:0:17227:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e62d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17227:1875336022379008:0@lo:104: 00000100:00100000:1.0:1788460199.019055:0:17227:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460199.019293:0:17227:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc682b480 going to sleep for 11 seconds 00000100:00100000:0.0:1788460199.019370:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022378880 00000100:00100000:0.0:1788460199.019377:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022378880 00000100:00100000:0.0:1788460199.019410:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022379008 00000100:00100000:0.0:1788460199.019413:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022379008 00000100:00100000:0.0:1788460199.019424:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788460199.019432:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac1e62680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c482be18-c056-4068-8a37-ed5038fc364a+4:17227:x1875336022378880:12345-0@lo:104: 00010000:00010000:0.0:1788460199.019453:0:17195:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7600/0x5dfa74784542c11b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542c122 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460199.019512:0:17195:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788460199.019518:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac1e62680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c482be18-c056-4068-8a37-ed5038fc364a+4:17227:x1875336022378880:12345-0@lo:104: Request processed in 87us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460199.019525:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788460199.019541:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788460199.019548:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac1e60000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c482be18-c056-4068-8a37-ed5038fc364a+3:17227:x1875336022379008:12345-0@lo:104: 00010000:00010000:0.0:1788460199.019555:0:17195:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2600/0x5dfa74784542c049 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542c050 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460199.019587:0:17195:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788460199.019593:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac1e60000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c482be18-c056-4068-8a37-ed5038fc364a+3:17227:x1875336022379008:12345-0@lo:104: Request processed in 46us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460199.019599:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1788460199.019615:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788460199.019620:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7600/0x5dfa74784542c11b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542c122 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460199.019640:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bfadc7600 already unused, calling callback (ffffffffc125ae00) 10000000:00010000:0.0:1788460199.019644:0:17200:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7600/0x5dfa74784542c11b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5dfa74784542c122 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460199.019651:0:17200:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7600/0x5dfa74784542c11b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5dfa74784542c122 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788460199.019658:0:17200:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7600/0x5dfa74784542c11b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5dfa74784542c122 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788460199.019671:0:17200:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788460199.019703:0:17200:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7600/0x5dfa74784542c11b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542c122 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460199.019711:0:17200:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788460199.019730:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7600/0x5dfa74784542c11b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542c122 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460199.019738:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7600/0x5dfa74784542c11b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542c122 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460199.019748:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788460199.019752:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2600/0x5dfa74784542c049 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542c050 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460199.019757:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc29d2600 already unused, calling callback (ffffffffc125ae00) 10000000:00010000:0.0:1788460199.019760:0:17200:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2600/0x5dfa74784542c049 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5dfa74784542c050 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460199.019767:0:17200:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2600/0x5dfa74784542c049 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5dfa74784542c050 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788460199.019774:0:17200:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2600/0x5dfa74784542c049 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5dfa74784542c050 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788460199.019779:0:17200:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788460199.019793:0:17200:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2600/0x5dfa74784542c049 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542c050 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460199.019799:0:17200:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788460199.019813:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2600/0x5dfa74784542c049 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542c050 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460199.019819:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2600/0x5dfa74784542c049 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542c050 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460199.019832:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460199.019834:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460199.019848:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788460199.019869:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4395180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c482be18-c056-4068-8a37-ed5038fc364a:3659:1875336022379136:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788460199.019899:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460199.019920:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788460199.019926:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4394a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c482be18-c056-4068-8a37-ed5038fc364a:3659:1875336022379264:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788460199.019970:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788460199.019978:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460199.020280:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022379136 00000100:00100000:1.0:1788460199.020286:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022379136 00010000:00010000:1.0:1788460199.020308:0:17197:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4bfadc6c00/0x5dfa74784542c122 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542c11b expref: 20 pid: 17206 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460199.020327:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022379264 00000100:00100000:1.0:1788460199.020330:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022379264 00010000:00010000:1.0:1788460199.020341:0:17197:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4bfadc7200/0x5dfa74784542c050 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542c049 expref: 21 pid: 17204 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460199.020353:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788460199.020361:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc4396a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c482be18-c056-4068-8a37-ed5038fc364a+21:3659:x1875336022379136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788460199.020372:0:17197:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788460199.020377:0:17197:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4bfadc6c00/0x5dfa74784542c122 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542c11b expref: 21 pid: 17206 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460199.020389:0:17197:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4bfadc6c00/0x5dfa74784542c122 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5dfa74784542c11b expref: 21 pid: 17206 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460199.020404:0:17197:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788460199.020447:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc4396a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c482be18-c056-4068-8a37-ed5038fc364a+21:3659:x1875336022379136:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460199.020455:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788460199.020469:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788460199.020475:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc4396d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c482be18-c056-4068-8a37-ed5038fc364a+20:3659:x1875336022379264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788460199.020482:0:17197:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788460199.020487:0:17197:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4bfadc7200/0x5dfa74784542c050 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542c049 expref: 20 pid: 17204 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460199.020495:0:17197:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4bfadc7200/0x5dfa74784542c050 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5dfa74784542c049 expref: 20 pid: 17204 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460199.020506:0:17197:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c4ac3677c00/0x5dfa74784542c15a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460199.020514:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4ac3677c00/0x5dfa74784542c15a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788460199.020528:0:17197:0:(mgs_nids.c:715:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002037221s 00010000:00010000:1.0:1788460199.020532:0:17197:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c4ac3677c00/0x5dfa74784542c15a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460199.020540:0:17197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c4ac3677c00/0x5dfa74784542c15a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460199.020546:0:17197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c4ac3677c00/0x5dfa74784542c15a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460199.020552:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c4ac3677c00/0x5dfa74784542c15a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460199.020567:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac3677c00 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:1.0:1788460199.020571:0:17197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c4ac3677c00/0x5dfa74784542c15a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460199.020579:0:17197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c4ac3677c00/0x5dfa74784542c15a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460199.020588:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c4ac3677c00/0x5dfa74784542c15a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460199.020597:0:17197:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788460199.020636:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc4396d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c482be18-c056-4068-8a37-ed5038fc364a+20:3659:x1875336022379264:12345-0@lo:103:ldlm_bl.0 Request processed in 150us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460199.020644:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788460199.020686:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4394a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c482be18-c056-4068-8a37-ed5038fc364a:3659:1875336022379264:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788460199.020699:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4395180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c482be18-c056-4068-8a37-ed5038fc364a:3659:1875336022379136:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788460199.020744:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4bfadc6c00/0x5dfa74784542c122 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5dfa74784542c11b expref: 19 pid: 17206 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460199.020756:0:17227:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e60a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17227:1875336022378880:0@lo:104: 00010000:00010000:1.0:1788460199.020768:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4bfadc7200/0x5dfa74784542c050 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5dfa74784542c049 expref: 18 pid: 17204 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460199.020776:0:17227:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e62d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17227:1875336022379008:0@lo:104: 00010000:00010000:1.0:1788460199.020794:0:17227:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c4ac3677c00/0x5dfa74784542c15a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460199.020813:0:17227:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c4ac3677c00/0x5dfa74784542c15a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460199.020819:0:17227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c4ac3677c00/0x5dfa74784542c15a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460199.020824:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4ac3677c00/0x5dfa74784542c15a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460199.022772:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4043c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+17:17943:x1875336022378752:12345-0@lo:253:mount.lustre.0 Request processed in 7491us (9820us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460199.022785:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788460199.023550:0:17943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e62a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:17943:1875336022378752:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788460199.023567:0:17943:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1788460199.023570:0:17943:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788460199.023572:0:17943:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788460199.023573:0:17943:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788460199.023574:0:17943:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:0.0:1788460199.023575:0:17943:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:0.0:1788460199.023576:0:17943:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:0.0:1788460199.023578:0:17943:0:(tgt_mount.c:1246:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788460199.023579:0:17943:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788460199.023581:0:17943:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788460199.023593:0:17943:0:(tgt_mount.c:2880:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000040:01000000:2.0:1788460199.034902:0:17943:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:0.0:1788460199.034926:0:17968:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1788460199.034931:0:17968:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:1.0:1788460199.041538:0:17943:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:01000000:2.0:1788460199.041622:0:17969:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1788460199.042168:0:17970:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e62d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17970:1875336022379392:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788460199.042236:0:17970:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460199.042266:0:17970:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac36aa3c0 going to sleep for 11 seconds 00000040:01000000:3.0:1788460199.042282:0:17943:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:3.0:1788460199.042320:0:17943:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788460199.042369:0:17969:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788460199.042809:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022379392 00000100:00100000:0.0:1788460199.042817:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022379392 00000100:00100000:0.0:1788460199.042862:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788460199.042877:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac1e60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17970:x1875336022379392:12345-0@lo:1000:lod0001_rec0000.0 00000004:00000080:3.0:1788460199.042900:0:17943:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788460199.042906:0:17943:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:3.0:1788460199.042970:0:17943:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788460199.042982:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac1e60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17970:x1875336022379392:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 106us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460199.043002:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788460199.043016:0:17970:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e62d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17970:1875336022379392:0@lo:1000:lod0001_rec0000.0 00000040:01000000:1.0:1788460199.043059:0:17970:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1788460199.043088:0:17970:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e62d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17970:1875336022379520:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788460199.043119:0:17970:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460199.043143:0:17970:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac36aac00 going to sleep for 11 seconds 00000100:00100000:0.0:1788460199.043428:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022379520 00000100:00100000:0.0:1788460199.043433:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022379520 00000100:00100000:0.0:1788460199.043464:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788460199.043479:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac1e63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17970:x1875336022379520:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788460199.043587:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac1e63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:17970:x1875336022379520:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 116us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460199.043593:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788460199.043883:0:17970:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e62d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17970:1875336022379520:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788460199.043934:0:17970:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e62d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17970:1875336022379648:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1788460199.044001:0:17970:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460199.044017:0:17970:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac36aa3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788460199.044099:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022379648 00000100:00100000:0.0:1788460199.044104:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022379648 00000100:00100000:0.0:1788460199.044134:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788460199.044140:0:17222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac1e61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17970:x1875336022379648:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1788460199.044175:0:17222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac1e61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17970:x1875336022379648:12345-0@lo:900:lod0001_rec0000.0 Request processed in 36us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460199.044181:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:00080000:3.0:1788460199.044297:0:17943:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00010000:00080000:1.0:1788460199.044539:0:17970:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8c4ac1e62d80 x1875336022379648/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788460215 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460199.044551:0:17970:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e62d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17970:1875336022379648:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1788460199.044594:0:17970:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e62d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17970:1875336022379776:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788460199.044630:0:17970:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460199.044657:0:17970:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac36aac00 going to sleep for 11 seconds 00000040:00080000:3.0:1788460199.044856:0:17943:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788460199.044885:0:17943:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000100:00100000:0.0:1788460199.045181:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022379776 00000100:00100000:0.0:1788460199.045187:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022379776 00000100:00100000:0.0:1788460199.045258:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788460199.045267:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac1e61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17970:x1875336022379776:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788460199.045337:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac1e61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17970:x1875336022379776:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 71us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460199.045344:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000040:00080000:3.0:1788460199.047959:0:17943:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788460199.048174:0:17969:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788460199.048340:0:17969:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:1.0:1788460199.048589:0:17970:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e62d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17970:1875336022379776:0@lo:1000:lod0001_rec0000.0 00000040:00080000:1.0:1788460199.048647:0:17970:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1788460199.050316:0:17943:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000001:00000004:3.0:1788460199.052712:0:17943:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1788460199.053986:0:17943:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788460199.054015:0:17943:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffba0a01a3b9b8 00100000:10000000:3.0:1788460199.054023:0:17943:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:0.0:1788460199.054871:0:17943:0:(tgt_mount.c:2600:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1788460199.054902:0:17943:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:0.0:1788460199.055720:0:17943:0:(tgt_mount.c:2486:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000040:00080000:1.0:1788460199.057076:0:17970:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000020:00000004:0.0:1788460199.057407:0:17943:0:(tgt_mount.c:2501:is_cmd_supported()) ioctl cmd=81009431 00000004:00080000:1.0:1788460199.057847:0:17970:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788460199.057852:0:17970:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000100:00100000:3.0:1788460199.250780:0:17253:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc65d7e40 going to sleep for 0 seconds 00010000:00010000:2.0:1788460199.827390:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788460200.021684:0:17965:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788460200.273081:0:17253:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc65d7e40 going to sleep for 0 seconds 10000000:01000000:0.0:1788460200.787094:0:17208:0:(mgc_request.c:715:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788460200.787102:0:17208:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-mdtir-ffff8c4be0237800 from 8 10000000:01000000:0.0:1788460200.787107:0:17208:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788460200.787153:0:17208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bc2bd4a00/0x5dfa74784542c161 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460200.787175:0:17208:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4bc2bd4a00/0x5dfa74784542c161 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460200.787187:0:17208:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4bc2bd4a00/0x5dfa74784542c161 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460200.787212:0:17208:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4397480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022379904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788460200.787290:0:17208:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460200.787348:0:17208:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bf2f9b900 going to sleep for 11 seconds 00000100:00100000:2.0:1788460200.787582:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022379904 00000100:00100000:2.0:1788460200.787589:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022379904 00000100:00100000:2.0:1788460200.787654:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788460200.787662:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4042850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+17:17208:x1875336022379904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788460200.787674:0:17204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460200.787686:0:17204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4bfadc7a00/0x5dfa74784542c168 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542c161 expref: -99 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460200.787731:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bfadc7a00/0x5dfa74784542c168 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542c161 expref: 18 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460200.787742:0:17204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4bfadc7a00/0x5dfa74784542c168 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542c161 expref: 18 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460200.787751:0:17204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bfadc7a00, rc 0) 00000100:00100000:2.0:1788460200.787795:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4042850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+18:17208:x1875336022379904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460200.787802:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788460200.788277:0:17208:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4397480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022379904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788460200.788294:0:17208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4bc2bd4a00/0x5dfa74784542c161 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c168 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460200.788304:0:17208:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4bc2bd4a00/0x5dfa74784542c161 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542c168 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460200.788357:0:17208:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4285500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022380032:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788460200.788394:0:17208:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460200.788710:0:17208:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc11ca300 going to sleep for 11 seconds 00000100:00100000:0.0:1788460200.798595:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022380032 00000100:00100000:0.0:1788460200.798611:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022380032 00000100:00100000:0.0:1788460200.798676:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788460200.798686:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4042050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+18:17208:x1875336022380032:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788460200.798712:0:17205:0:(mgs_nids.c:1209:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788460200.799822:0:17205:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788460200.799827:0:17205:0:(mgs_nids.c:325:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1788460200.799971:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4042050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+18:17208:x1875336022380032:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 1284us (11574us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460200.799996:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788460200.800069:0:17208:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4285500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022380032:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788460200.800343:0:17208:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788460200.800357:0:17208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bc2bd4a00/0x5dfa74784542c161 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c168 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460200.800369:0:17208:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4bc2bd4a00/0x5dfa74784542c161 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c168 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788460200.800383:0:17208:0:(mgc_request.c:715:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788460200.800386:0:17208:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-mdtir-ffff8c4ac428f800 from 8 10000000:01000000:0.0:1788460200.800389:0:17208:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788460200.800418:0:17208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bc2bd4000/0x5dfa74784542c16f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460200.800500:0:17208:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4bc2bd4000/0x5dfa74784542c16f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460200.800512:0:17208:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4bc2bd4000/0x5dfa74784542c16f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460200.800533:0:17208:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4395500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022380160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788460200.800569:0:17208:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460200.800600:0:17208:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc11ca300 going to sleep for 11 seconds 00000100:00100000:0.0:1788460200.800619:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022380160 00000100:00100000:0.0:1788460200.800624:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022380160 00000100:00100000:0.0:1788460200.800661:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788460200.800669:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4041050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+18:17208:x1875336022380160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788460200.800680:0:17206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460200.800692:0:17206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4bc2bd5400/0x5dfa74784542c176 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542c16f expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460200.800713:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bc2bd5400/0x5dfa74784542c176 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542c16f expref: 19 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460200.801168:0:17206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4bc2bd5400/0x5dfa74784542c176 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542c16f expref: 19 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460200.801176:0:17206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc2bd5400, rc 0) 00000100:00100000:0.0:1788460200.801222:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4041050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+19:17208:x1875336022380160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 553us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460200.801355:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788460200.801543:0:17208:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4395500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022380160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788460200.801558:0:17208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4bc2bd4000/0x5dfa74784542c16f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c176 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460200.801567:0:17208:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4bc2bd4000/0x5dfa74784542c16f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542c176 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460200.801622:0:17208:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e62d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022380288:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788460200.801662:0:17208:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460200.801693:0:17208:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac36aad80 going to sleep for 11 seconds 00000100:00100000:0.0:1788460200.801893:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022380288 00000100:00100000:0.0:1788460200.801899:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022380288 00000100:00100000:0.0:1788460200.801995:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788460200.802002:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4042c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+19:17208:x1875336022380288:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788460200.802018:0:17205:0:(mgs_nids.c:1209:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788460200.802043:0:17205:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788460200.802047:0:17205:0:(mgs_nids.c:325:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1788460200.802138:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4042c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+19:17208:x1875336022380288:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 136us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460200.802146:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788460200.804631:0:17208:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e62d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022380288:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788460200.804691:0:17208:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788460200.804701:0:17208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bc2bd4000/0x5dfa74784542c16f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c176 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460200.804711:0:17208:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4bc2bd4000/0x5dfa74784542c16f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c176 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460200.849207:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788460201.045727:0:17965:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788460201.308852:0:17253:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc65d7e40 going to sleep for 0 seconds 00010000:00010000:2.0:1788460201.873209:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460202.322442:0:17253:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc65d7e40 going to sleep for 0 seconds 00010000:00010000:2.0:1788460202.897851:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788460203.263927:0:18212:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1788460203.347732:0:17253:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc65d7e40 going to sleep for 0 seconds 00010000:00010000:2.0:1788460203.921092:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460204.113675:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4285500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022380416:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788460204.113748:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460204.113830:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022380416 00000100:00100000:3.0:1788460204.113837:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022380416 00000100:00100000:3.0:1788460204.113893:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788460204.113902:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4287800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022380416:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788460204.113991:0:17217:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788460204.114052:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4287800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022380416:12345-0@lo:41:osp-pre-0-1.0 Request processed in 150us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460204.114060:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788460204.114106:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4285500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022380416:0@lo:41:osp-pre-0-1.0 00000100:00080000:2.0:1788460204.114692:0:8:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788460204.114696:0:8:0:(pinger.c:244:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788460204.114700:0:8:0:(import.c:65:import_set_state_nolock()) ffff8c4bfa02b800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788460204.114707:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8c4bfa02b800 using connection 192.168.206.105@tcp/0@lo 00000100:00100000:2.0:1788460204.114728:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4ac42f2680 x1875336022380672/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788460204.114743:0:8:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788460204.114754:0:8:0:(pinger.c:254:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788460204.114756:0:8:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788460204.114759:0:8:0:(pinger.c:254:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788460204.114794:0:8:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788460204.114798:0:8:0:(pinger.c:254:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788460204.114800:0:8:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788460204.114802:0:8:0:(pinger.c:254:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788460204.114846:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac42f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1875336022380800:0@lo:400:kworker.0 00000100:00100000:2.0:1788460204.114889:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460204.114924:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788460204.114931:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac42f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1875336022380928:0@lo:400:kworker.0 00000100:00100000:2.0:1788460204.114974:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460204.115002:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022380800 00000100:00100000:2.0:1788460204.115007:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022380800 00000100:00100000:2.0:1788460204.115051:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022380928 00000100:00100000:2.0:1788460204.115054:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022380928 00000100:00100000:2.0:1788460204.115067:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788460204.115073:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac42f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1875336022380800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460204.115602:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac42f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1875336022380800:12345-0@lo:400:kworker.0 Request processed in 527us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460204.115612:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788460204.115629:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788460204.115636:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac42f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1875336022380928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460204.115667:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac42f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1875336022380928:12345-0@lo:400:kworker.0 Request processed in 33us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460204.115681:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788460204.115720:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c4ac42f0380 x1875336022380928/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460220 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460204.115731:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac42f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1875336022380928:0@lo:400:kworker.0 00010000:00080000:2.0:1788460204.115741:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c4ac42f1c00 x1875336022380800/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460220 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460204.115749:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac42f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1875336022380800:0@lo:400:kworker.0 00000100:00100000:3.0:1788460204.115887:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac42f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c482be18-c056-4068-8a37-ed5038fc364a:3662:1875336022380544:0@lo:400:kworker.0 00000100:00100000:3.0:1788460204.115922:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460204.115980:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022380544 00000100:00100000:3.0:1788460204.115985:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022380544 00000100:00100000:3.0:1788460204.116027:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788460204.116034:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4041450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+19:3662:x1875336022380544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460204.116070:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4041450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+19:3662:x1875336022380544:12345-0@lo:400:kworker.0 Request processed in 36us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460204.116076:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788460204.116107:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac42f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1875336022380672:0@lo:38:kworker.0 00000100:00100000:3.0:1788460204.116133:0:3658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460204.116164:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022380672 00000100:00100000:3.0:1788460204.116168:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022380672 00000100:00100000:3.0:1788460204.116185:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788460204.116190:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4285500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3658:x1875336022380672:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788460204.116223:0:17216:0:(ldlm_lib.c:1461:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 501 last 0 00000100:00100000:2.0:1788460204.116465:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac42f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c482be18-c056-4068-8a37-ed5038fc364a:3662:1875336022380544:0@lo:400:kworker.0 00000020:00000080:3.0:1788460204.117270:0:17216:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5dfa74784542c17d 00000004:00100000:3.0:1788460204.117286:0:17216:0:(mdt_handler.c:7310:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1788460204.117291:0:17216:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:1.0:1788460204.127337:0:17216:0:(import.c:65:import_set_state_nolock()) ffff8c4ac41f5000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788460204.127434:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4285500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3658:x1875336022380672:12345-0@lo:38:kworker.0 Request processed in 11241us (11298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460204.127445:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1788460204.127537:0:3658:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788460204.127546:0:3658:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1788460204.127552:0:3658:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788460204.127555:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c4bfa02b800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1788460204.127695:0:3658:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000378a36d9): req@ffff8c4ac4284380 x1875336022373248/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460204.127721:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac42f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1875336022380672:0@lo:38:kworker.0 00000100:00100000:1.0:1788460204.127754:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788460204.127767:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022381056:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788460204.127806:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460204.130734:0:17952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022381056 00000100:00100000:2.0:1788460204.130746:0:17952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022381056 00000100:00100000:2.0:1788460204.130863:0:17952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788460204.130873:0:17952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac1e63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3662:x1875336022381056:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788460204.130906:0:17952:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788460204.131365:0:17253:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460204.131411:0:17253:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc65d7e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788460204.131557:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022373248 00000100:00100000:1.0:1788460204.131562:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022373248 00000100:00100000:1.0:1788460204.131588:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788460204.131596:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc4396300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:17253:x1875336022373248:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788460204.131609:0:17952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac1e63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:3662:x1875336022381056:12345-0@lo:41:osp-pre-1-0.0 Request processed in 737us (3801us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460204.131619:0:17952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788460204.131670:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc4396300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17253:x1875336022373248:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 74us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460204.131678:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788460204.131712:0:17253:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4284380 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17253:1875336022373248:0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1788460204.131742:0:17253:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1788460204.132110:0:17253:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e60700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17253:1875336022381184:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788460204.132162:0:17253:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460204.132183:0:17253:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac36aa780 going to sleep for 11 seconds 00000100:00100000:1.0:1788460204.132209:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022381056:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788460204.132325:0:17952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022381184 00000100:00100000:2.0:1788460204.132330:0:17952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022381184 00000100:00100000:2.0:1788460204.132365:0:17952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788460204.132372:0:17952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac1e62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17253:x1875336022381184:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788460204.132547:0:17253:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e60700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17253:1875336022381184:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788460204.132610:0:17253:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e60700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17253:1875336022381312:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788460204.132633:0:17253:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460204.132659:0:17253:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac36aa780 going to sleep for 11 seconds 00000100:00100000:1.0:1788460204.132671:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022381312 00000100:00100000:1.0:1788460204.132675:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022381312 00000100:00100000:1.0:1788460204.132690:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788460204.132696:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac1e60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:17253:x1875336022381312:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788460204.132735:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac1e60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:17253:x1875336022381312:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 39us (102us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460204.132748:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788460204.132770:0:17253:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e60700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17253:1875336022381312:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1788460204.132801:0:17253:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788460204.135098:0:17952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac1e62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17253:x1875336022381184:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 2717us (2926us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460204.135112:0:17952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000040:00080000:1.0:1788460204.138407:0:17253:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788460204.138687:0:17253:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 19, retries 0 00000004:00080000:1.0:1788460204.138692:0:17253:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00000004:3.0:1788460204.183525:0:18265:0:(tgt_mount.c:2486:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788460204.183925:0:18265:0:(tgt_mount.c:2501:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788460204.946964:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788460205.157584:0:18316:0:(tgt_mount.c:2486:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788460205.157788:0:18316:0:(tgt_mount.c:2501:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788460205.969221:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788460206.189884:0:18364:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd29963610 20000000:00000080:3.0:1788460206.189901:0:18364:0:(mgs_handler.c:1172:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8c4bc6204000 uarg=0000000000000000 20000000:01000000:3.0:1788460206.189936:0:18364:0:(mgs_llog.c:6198:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1788460206.189967:0:18364:0:(mgs_llog.c:4653:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1788460206.189972:0:18364:0:(mgs_llog.c:1385:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1788460206.191056:0:18365:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:3.0:1788460206.191207:0:18364:0:(mgs_llog.c:1456:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788460206.200310:0:18364:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788460206.200337:0:18364:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c4bc29d2800/0x5dfa74784542c184 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460206.200353:0:18364:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4bc2bd4200/0x5dfa74784542c01f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542c018 expref: 18 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460206.200362:0:18364:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4bfadc6400/0x5dfa74784542c130 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542c129 expref: 18 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460206.200370:0:18364:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c4bc29d2800/0x5dfa74784542c184 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460206.200408:0:18364:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4bfadc6400/0x5dfa74784542c130 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5dfa74784542c129 expref: 18 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460206.200424:0:18364:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c4bfadc6400/0x5dfa74784542c130 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5dfa74784542c129 expref: 18 pid: 17206 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460206.200437:0:18364:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4286680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18364:1875336022381440:0@lo:104: 00000100:00100000:3.0:1788460206.200497:0:18364:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788460206.200608:0:18364:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4bc2bd4200/0x5dfa74784542c01f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5dfa74784542c018 expref: 18 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460206.200630:0:18364:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c4bc2bd4200/0x5dfa74784542c01f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5dfa74784542c018 expref: 18 pid: 17206 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460206.200639:0:18364:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4287480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18364:1875336022381568:0@lo:104: 00000100:00100000:3.0:1788460206.200662:0:18364:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460206.208732:0:18364:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bedf630c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788460206.210884:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022381440 00000100:00100000:1.0:1788460206.210897:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022381440 00000100:00100000:0.0:1788460206.211150:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022381568 00000100:00100000:0.0:1788460206.211155:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022381568 00000100:00100000:0.0:1788460206.211435:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788460206.211443:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4284a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c482be18-c056-4068-8a37-ed5038fc364a+4:18364:x1875336022381440:12345-0@lo:104: 00010000:00010000:0.0:1788460206.211460:0:17195:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7400/0x5dfa74784542c129 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542c130 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460206.211559:0:17195:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788460206.211565:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4284a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c482be18-c056-4068-8a37-ed5038fc364a+4:18364:x1875336022381440:12345-0@lo:104: Request processed in 123us (11069us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460206.211578:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788460206.211596:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788460206.211601:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4285c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c482be18-c056-4068-8a37-ed5038fc364a+3:18364:x1875336022381568:12345-0@lo:104: 00010000:00010000:0.0:1788460206.211609:0:17195:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2c00/0x5dfa74784542c018 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542c01f expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460206.211645:0:17195:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788460206.211650:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4285c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c482be18-c056-4068-8a37-ed5038fc364a+3:18364:x1875336022381568:12345-0@lo:104: Request processed in 49us (10988us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460206.211656:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1788460206.211673:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788460206.211679:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7400/0x5dfa74784542c129 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542c130 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460206.211697:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bfadc7400 already unused, calling callback (ffffffffc125ae00) 10000000:00010000:0.0:1788460206.211701:0:17200:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7400/0x5dfa74784542c129 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5dfa74784542c130 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460206.211709:0:17200:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7400/0x5dfa74784542c129 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5dfa74784542c130 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788460206.211716:0:17200:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7400/0x5dfa74784542c129 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5dfa74784542c130 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788460206.211722:0:17200:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788460206.212195:0:17201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1788460206.212660:0:18364:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4286680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18364:1875336022381440:0@lo:104: 00000100:00100000:3.0:1788460206.212672:0:18364:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4287480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18364:1875336022381568:0@lo:104: 00010000:00010000:3.0:1788460206.212693:0:18364:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c4bc29d2800/0x5dfa74784542c184 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460206.212910:0:17200:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7400/0x5dfa74784542c129 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542c130 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460206.212919:0:17200:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788460206.213174:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4397b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c482be18-c056-4068-8a37-ed5038fc364a:3662:1875336022381696:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788460206.213224:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788460206.213350:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7400/0x5dfa74784542c129 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542c130 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460206.213360:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7400/0x5dfa74784542c129 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542c130 expref: -99 pid: 17943 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460206.213373:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460206.213374:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460206.213376:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788460206.216179:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022381696 00000100:00100000:1.0:1788460206.216194:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022381696 00010000:00010000:1.0:1788460206.216236:0:17199:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4bfadc6400/0x5dfa74784542c130 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542c129 expref: 19 pid: 17206 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460206.216266:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788460206.216274:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac42f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c482be18-c056-4068-8a37-ed5038fc364a+19:3662:x1875336022381696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788460206.216287:0:17199:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788460206.216293:0:17199:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4bfadc6400/0x5dfa74784542c130 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542c129 expref: 19 pid: 17206 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460206.216305:0:17199:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4bfadc6400/0x5dfa74784542c130 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5dfa74784542c129 expref: 19 pid: 17206 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460206.216322:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4bfadc6400/0x5dfa74784542c130 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5dfa74784542c129 expref: 19 pid: 17206 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460206.216336:0:17199:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788460206.216671:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac42f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c482be18-c056-4068-8a37-ed5038fc364a+18:3662:x1875336022381696:12345-0@lo:103:ldlm_bl.0 Request processed in 397us (3446us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460206.216693:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1788460206.219955:0:18366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460206.219962:0:18366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460206.219964:0:18366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460206.220025:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2c00/0x5dfa74784542c018 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542c01f expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460206.220038:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc29d2c00 already unused, calling callback (ffffffffc125ae00) 10000000:00010000:0.0:1788460206.220043:0:17201:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2c00/0x5dfa74784542c018 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5dfa74784542c01f expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460206.220065:0:17201:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2c00/0x5dfa74784542c018 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5dfa74784542c01f expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788460206.220073:0:17201:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2c00/0x5dfa74784542c018 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5dfa74784542c01f expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788460206.220079:0:17201:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788460206.220127:0:17201:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2c00/0x5dfa74784542c018 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542c01f expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460206.220134:0:17201:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788460206.220157:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2c00/0x5dfa74784542c018 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542c01f expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460206.220164:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2c00/0x5dfa74784542c018 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542c01f expref: -99 pid: 17191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460206.220182:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460206.220184:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460206.220186:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788460206.220201:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4394e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c482be18-c056-4068-8a37-ed5038fc364a:3659:1875336022381824:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788460206.220272:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460206.220338:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022381824 00000100:00100000:0.0:1788460206.220345:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022381824 00010000:00010000:0.0:1788460206.220368:0:17197:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4bc2bd4200/0x5dfa74784542c01f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542c018 expref: 18 pid: 17206 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460206.220396:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788460206.220404:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc4397800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c482be18-c056-4068-8a37-ed5038fc364a+18:3659:x1875336022381824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788460206.220423:0:17197:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788460206.220428:0:17197:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4bc2bd4200/0x5dfa74784542c01f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542c018 expref: 18 pid: 17206 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460206.220439:0:17197:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4bc2bd4200/0x5dfa74784542c01f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5dfa74784542c018 expref: 18 pid: 17206 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460206.220453:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4bc2bd4200/0x5dfa74784542c01f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5dfa74784542c018 expref: 18 pid: 17206 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460206.220466:0:17197:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c4bc29d2800/0x5dfa74784542c184 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460206.220473:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bc29d2800/0x5dfa74784542c184 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460206.220487:0:17197:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c4bc29d2800/0x5dfa74784542c184 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460206.220494:0:17197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c4bc29d2800/0x5dfa74784542c184 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460206.220500:0:17197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c4bc29d2800/0x5dfa74784542c184 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460206.220507:0:17197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c4bc29d2800/0x5dfa74784542c184 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460206.220512:0:17197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc29d2800 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:0.0:1788460206.220516:0:17197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c4bc29d2800/0x5dfa74784542c184 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460206.220533:0:17197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c4bc29d2800/0x5dfa74784542c184 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460206.220548:0:17197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c4bc29d2800/0x5dfa74784542c184 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460206.220558:0:17197:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788460206.220591:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc4397800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c482be18-c056-4068-8a37-ed5038fc364a+17:3659:x1875336022381824:12345-0@lo:103:ldlm_bl.0 Request processed in 187us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460206.220599:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788460206.220637:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4394e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c482be18-c056-4068-8a37-ed5038fc364a:3659:1875336022381824:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788460206.222090:0:18364:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c4bc29d2800/0x5dfa74784542c184 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460206.222103:0:18364:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c4bc29d2800/0x5dfa74784542c184 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460206.222110:0:18364:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4bc29d2800/0x5dfa74784542c184 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460206.225584:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4397b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c482be18-c056-4068-8a37-ed5038fc364a:3662:1875336022381696:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788460206.993331:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788460207.377635:0:17247:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:1.0:1788460207.890104:0:17208:0:(mgc_request.c:715:do_requeue()) updating log params 10000000:01000000:1.0:1788460207.890111:0:17208:0:(mgc_request.c:2266:mgc_process_log()) Process log params-ffff8c4be0237800 from 13 10000000:01000000:1.0:1788460207.890115:0:17208:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788460207.890159:0:17208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac3676600/0x5dfa74784542c18b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460207.890171:0:17208:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4ac3676600/0x5dfa74784542c18b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460207.890181:0:17208:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4ac3676600/0x5dfa74784542c18b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460207.890219:0:17208:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e60700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022381952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788460207.890287:0:17208:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460207.890333:0:17208:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac36aa6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788460207.890442:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022381952 00000100:00100000:3.0:1788460207.890450:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022381952 00000100:00100000:3.0:1788460207.890499:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788460207.890507:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4041c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+17:17208:x1875336022381952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788460207.890520:0:17205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460207.890533:0:17205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4bc29d3c00/0x5dfa74784542c192 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542c18b expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460207.890553:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bc29d3c00/0x5dfa74784542c192 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542c18b expref: 18 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460207.890564:0:17205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4bc29d3c00/0x5dfa74784542c192 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542c18b expref: 18 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460207.890573:0:17205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc29d3c00, rc 0) 00000100:00100000:3.0:1788460207.890616:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4041c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+18:17208:x1875336022381952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460207.890622:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788460207.890967:0:17208:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e60700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022381952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788460207.890983:0:17208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4ac3676600/0x5dfa74784542c18b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c192 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460207.891001:0:17208:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4ac3676600/0x5dfa74784542c18b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542c192 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788460207.891159:0:17208:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1e:0x0] index 13 count 13 00000040:00080000:1.0:1788460207.891678:0:17208:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788460207.891856:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].1, 224 off8416 00000040:00080000:1.0:1788460207.891901:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].2, 112 off8528 00000040:00080000:1.0:1788460207.891915:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].3, 224 off8752 00000040:00080000:1.0:1788460207.891928:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].4, 224 off8976 00000040:00080000:1.0:1788460207.891939:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].5, 112 off9088 00000040:00080000:1.0:1788460207.892565:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].6, 224 off9312 00000040:00080000:1.0:1788460207.892587:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].7, 224 off9536 00000040:00080000:1.0:1788460207.892601:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].8, 128 off9664 00000040:00080000:1.0:1788460207.892614:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].9, 224 off9888 00000040:00080000:1.0:1788460207.892626:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].10, 224 off10112 00000040:00080000:1.0:1788460207.892638:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].11, 128 off10240 00000040:00080000:1.0:1788460207.892656:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x21:0x0].12, 224 off10464 00000040:00080000:1.0:1788460207.892662:0:17208:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1e:0x0] index 12 count 13 00000100:00100000:1.0:1788460207.893102:0:17208:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e60700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022382080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788460207.893152:0:17208:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460207.893342:0:17208:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac36aa6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788460207.899359:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022382080 00000100:00100000:3.0:1788460207.899372:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022382080 00000100:00100000:3.0:1788460207.899575:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788460207.899587:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4042450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+18:17208:x1875336022382080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788460207.899744:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4042450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+18:17208:x1875336022382080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 160us (6591us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460207.899826:0:17208:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e60700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022382080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788460207.899871:0:17208:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e60700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022382208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788460207.899926:0:17208:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460207.899970:0:17208:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac36aa6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788460207.899983:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022382208 00000100:00100000:1.0:1788460207.899987:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022382208 00000100:00100000:3.0:1788460207.908366:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788460207.908473:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788460207.908490:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4043850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+18:17208:x1875336022382208:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788460207.908925:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4043850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+18:17208:x1875336022382208:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 440us (9009us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460207.911815:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788460207.911912:0:17208:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e60700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022382208:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788460207.913759:0:17208:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788460207.913846:0:17208:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e60700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022382336:0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788460207.913906:0:17208:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460207.914147:0:17208:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac36aa6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788460207.918793:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022382336 00000100:00100000:2.0:1788460207.918807:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022382336 00000100:00100000:2.0:1788460207.918868:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788460207.918878:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfc2e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+18:17208:x1875336022382336:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788460207.919279:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfc2e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+18:17208:x1875336022382336:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 402us (5372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460207.919287:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788460207.920551:0:17208:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e60700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022382336:0@lo:502:ll_cfg_requeue.0 00000040:00080000:0.0:1788460207.929756:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].1, 224 off8416 00000040:00080000:0.0:1788460207.929795:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].2, 112 off8528 00000040:00080000:0.0:1788460207.929812:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].3, 224 off8752 00000040:00080000:0.0:1788460207.929830:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].4, 224 off8976 00000040:00080000:0.0:1788460207.929848:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].5, 112 off9088 00000040:00080000:0.0:1788460207.930407:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].6, 224 off9312 00000040:00080000:0.0:1788460207.930427:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].7, 224 off9536 00000040:00080000:0.0:1788460207.930440:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].8, 128 off9664 00000040:00080000:0.0:1788460207.930456:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].9, 224 off9888 00000040:00080000:0.0:1788460207.930486:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].10, 224 off10112 00000040:00080000:0.0:1788460207.930505:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].11, 128 off10240 00000100:00100000:0.0:1788460207.930552:0:17208:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4394e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022382464:0@lo:502:ll_cfg_requeue.0 00000100:00100000:0.0:1788460207.930630:0:17208:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460207.930679:0:17208:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bfa143000 going to sleep for 11 seconds 00000100:00100000:0.0:1788460207.930712:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022382464 00000100:00100000:0.0:1788460207.930718:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022382464 00000100:00100000:0.0:1788460207.930768:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788460207.930777:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfc2e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+18:17208:x1875336022382464:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:0.0:1788460207.930899:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfc2e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+18:17208:x1875336022382464:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 122us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460207.930907:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788460207.930979:0:17208:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4394e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022382464:0@lo:502:ll_cfg_requeue.0 00000040:00080000:0.0:1788460207.931386:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x22:0x0].12, 224 off10464 00000040:00080000:0.0:1788460207.931396:0:17208:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000040:00080000:1.0:1788460207.932747:0:18452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x22:0x0] index 64768 count 13 00000020:01000000:0.0:1788460207.932892:0:17208:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788460207.932904:0:17208:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788460207.932914:0:17208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac3676600/0x5dfa74784542c18b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c192 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460207.932927:0:17208:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4ac3676600/0x5dfa74784542c18b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c192 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788460207.932938:0:17208:0:(mgc_request.c:715:do_requeue()) updating log params 10000000:01000000:0.0:1788460207.933402:0:17208:0:(mgc_request.c:2266:mgc_process_log()) Process log params-ffff8c4ac428f800 from 13 10000000:01000000:0.0:1788460207.933407:0:17208:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788460207.933502:0:17208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677000/0x5dfa74784542c199 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460207.933511:0:17208:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677000/0x5dfa74784542c199 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460207.933521:0:17208:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677000/0x5dfa74784542c199 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460207.933542:0:17208:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e63480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022382592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788460207.933599:0:17208:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460207.933675:0:17208:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac36aa300 going to sleep for 11 seconds 00000100:00100000:0.0:1788460207.933711:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022382592 00000100:00100000:0.0:1788460207.933718:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022382592 00000100:00100000:0.0:1788460207.933797:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788460207.933814:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4133450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+18:17208:x1875336022382592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788460207.933828:0:17204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460207.933840:0:17204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4bc2bd5600/0x5dfa74784542c1a0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542c199 expref: -99 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460207.933864:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bc2bd5600/0x5dfa74784542c1a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542c199 expref: 19 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460207.933874:0:17204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4bc2bd5600/0x5dfa74784542c1a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542c199 expref: 19 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460207.933882:0:17204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc2bd5600, rc 0) 00000100:00100000:0.0:1788460207.933926:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4133450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+19:17208:x1875336022382592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460207.933933:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788460207.934231:0:17208:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e63480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022382592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788460207.934246:0:17208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677000/0x5dfa74784542c199 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c1a0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460207.934256:0:17208:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677000/0x5dfa74784542c199 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542c1a0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460207.934291:0:17208:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e63480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022382720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788460207.934320:0:17208:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460207.934346:0:17208:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac36aa300 going to sleep for 11 seconds 00000100:00100000:1.0:1788460207.934367:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022382720 00000100:00100000:1.0:1788460207.934371:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022382720 00000100:00100000:1.0:1788460207.934397:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788460207.934404:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4131c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+19:17208:x1875336022382720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788460207.934501:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4131c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+19:17208:x1875336022382720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 96us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460207.934508:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788460207.934544:0:17208:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e63480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022382720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788460207.934569:0:17208:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e63480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022382848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788460207.934608:0:17208:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460207.934628:0:17208:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac36aa300 going to sleep for 11 seconds 00000100:00100000:0.0:1788460207.934661:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022382848 00000100:00100000:0.0:1788460207.934665:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022382848 00000100:00100000:0.0:1788460207.934689:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788460207.934694:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4131850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+19:17208:x1875336022382848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788460207.934764:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4131850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+19:17208:x1875336022382848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 69us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460207.934771:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788460207.934845:0:17208:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e63480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022382848:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788460207.936785:0:18453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788460207.936895:0:17208:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788460207.936905:0:17208:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788460207.936915:0:17208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677000/0x5dfa74784542c199 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c1a0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460207.936926:0:17208:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677000/0x5dfa74784542c199 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c1a0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460208.017193:0:18366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788460208.209110:0:3658:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788460198/real 1788460198] req@ffff8c4bc4395c00 x1875336022376832/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788460208 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460208.209138:0:3658:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c4bc4395c00 x1875336022376832/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788460208 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460208.209148:0:3658:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788460198/real 1788460198] req@ffff8c4ac4285880 x1875336022376704/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788460208 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460208.209158:0:3658:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c4ac4285880 x1875336022376704/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788460208 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788460208.209174:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c4ac1eca800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788460208.209234:0:3658:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788460208.209238:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4395c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1875336022376832:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788460208.209252:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c4bef370800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788460208.210671:0:8:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788460208.210677:0:8:0:(pinger.c:254:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788460208.210679:0:8:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788460208.210682:0:8:0:(pinger.c:254:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788460208.210707:0:8:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788460208.210710:0:8:0:(pinger.c:244:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788460208.210713:0:8:0:(import.c:65:import_set_state_nolock()) ffff8c4bef370800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788460208.210720:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 496 00000100:00080000:2.0:1788460208.210725:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788460208.210732:0:8:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8c4bef370800 using connection 192.168.206.105@tcp/0@lo 00000100:00100000:2.0:1788460208.210751:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4ac42f0a80 x1875336022383360/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788460208.210763:0:8:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788460208.210766:0:8:0:(pinger.c:244:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788460208.210768:0:8:0:(import.c:65:import_set_state_nolock()) ffff8c4ac1eca800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788460208.210771:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 496 00000100:00080000:2.0:1788460208.210773:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788460208.210776:0:8:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8c4ac1eca800 using connection 192.168.206.105@tcp/0@lo 00000100:00100000:2.0:1788460208.210787:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4ac42f0700 x1875336022383488/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788460208.210986:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac42f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1875336022383616:0@lo:400:kworker.0 00000100:00100000:2.0:1788460208.211059:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460208.211096:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788460208.211102:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac42f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022382976:0@lo:400:kworker.0 00000100:00100000:2.0:1788460208.211147:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460208.211174:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac42f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022383232:0@lo:400:kworker.0 00000100:00100000:2.0:1788460208.211200:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460208.211217:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788460208.211286:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac42f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3662:1875336022383104:0@lo:400:kworker.0 00000100:00100000:2.0:1788460208.211310:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460208.211339:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022383616 00000100:00100000:2.0:1788460208.211346:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022383616 00000100:00100000:2.0:1788460208.211385:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022383104 00000100:00100000:2.0:1788460208.211388:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022383104 00000100:00100000:2.0:1788460208.211404:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788460208.211413:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac42f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1875336022383616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460208.211531:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac42f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3659:x1875336022383616:12345-0@lo:400:kworker.0 Request processed in 119us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460208.211538:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788460208.211553:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788460208.211560:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac42f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1875336022383104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460208.211661:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac42f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1875336022383104:12345-0@lo:400:kworker.0 Request processed in 102us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460208.211668:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788460208.211685:0:17952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022382976 00000100:00100000:2.0:1788460208.211688:0:17952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022382976 00000100:00100000:2.0:1788460208.211710:0:17952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022383232 00000100:00100000:2.0:1788460208.211713:0:17952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022383232 00000100:00100000:2.0:1788460208.211726:0:17952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788460208.211732:0:17952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac42f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3659:x1875336022382976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460208.211773:0:17952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac42f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3659:x1875336022382976:12345-0@lo:400:kworker.0 Request processed in 41us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460208.211780:0:17952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788460208.211791:0:17952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788460208.212039:0:17952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac42f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022383232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460208.212062:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac42f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022382976:0@lo:400:kworker.0 00000100:00100000:2.0:1788460208.212070:0:17952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac42f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022383232:12345-0@lo:400:kworker.0 Request processed in 274us (870us total) trans 0 rc 0/0 00010000:00080000:3.0:1788460208.212076:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c4ac42f1180 x1875336022383616/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460224 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460208.212076:0:17952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788460208.212086:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac42f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3659:1875336022383616:0@lo:400:kworker.0 00010000:00080000:2.0:1788460208.212101:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c4ac42f1c00 x1875336022383104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460224 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460208.212110:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac42f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3662:1875336022383104:0@lo:400:kworker.0 00000100:00100000:2.0:1788460208.212119:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac42f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022383232:0@lo:400:kworker.0 00000100:00080000:1.0:1788460208.212218:0:3658:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00080000:3.0:1788460208.212426:0:8:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788460208.212432:0:8:0:(pinger.c:254:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788460208.212434:0:8:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788460208.212436:0:8:0:(pinger.c:254:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788460208.212934:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4285880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1875336022376704:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1788460208.212984:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac42f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1875336022383360:0@lo:8:kworker.0 00000400:00000100:1.0:1788460208.213029:0:3658:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875336022383360 offset 0 length 520: 4 00000100:00100000:1.0:1788460208.213054:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac42f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1875336022383488:0@lo:8:kworker.0 00000400:00000100:1.0:1788460208.213071:0:3658:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875336022383488 offset 0 length 520: 4 00010000:00010000:2.0:1788460209.044516:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460209.233360:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4394e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022383744:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788460209.233457:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460209.233539:0:17952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022383744 00000100:00100000:0.0:1788460209.233547:0:17952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022383744 00000100:00100000:0.0:1788460209.233598:0:17952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788460209.233607:0:17952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4287480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022383744:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788460209.233640:0:17952:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788460209.234258:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788460209.234267:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022383872:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788460209.234312:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460209.234344:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022383872 00000100:00100000:1.0:1788460209.234349:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022383872 00000100:00100000:1.0:1788460209.234373:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788460209.234380:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac1e61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3662:x1875336022383872:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788460209.234400:0:17217:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788460209.234435:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac1e61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3662:x1875336022383872:12345-0@lo:41:osp-pre-1-0.0 Request processed in 55us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460209.234443:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788460209.234484:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022383872:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788460209.239019:0:17952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4287480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022383744:12345-0@lo:41:osp-pre-0-1.0 Request processed in 5403us (5566us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460209.239042:0:17952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788460209.240307:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4394e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022383744:0@lo:41:osp-pre-0-1.0 00000001:00100000:1.0:1788460209.748608:0:17944:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1788460210.065768:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788460210.260088:0:3658:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788460195/real 1788460195] req@ffff8c4ac4284700 x1875336022374272/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788460210 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460210.260118:0:3658:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c4ac4284700 x1875336022374272/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788460210 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460210.260128:0:3658:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788460195/real 1788460195] req@ffff8c4ac4287100 x1875336022374400/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788460210 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460210.260137:0:3658:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c4ac4287100 x1875336022374400/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788460210 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788460210.260154:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c4bc6b3a800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788460210.260172:0:3658:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788460210.260175:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4284700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1875336022374272:0@lo:8:kworker.0 00000100:00080000:0.0:1788460210.260180:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c4ac3abd000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788460210.260184:0:3658:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788460210.260186:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4287100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1875336022374400:0@lo:8:kworker.0 00000100:00080000:3.0:1788460210.261789:0:8:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788460210.261795:0:8:0:(pinger.c:244:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788460210.261798:0:8:0:(import.c:65:import_set_state_nolock()) ffff8c4bc6b3a800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788460210.261805:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 492 00000100:00080000:3.0:1788460210.261811:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788460210.261817:0:8:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8c4bc6b3a800 using connection 192.168.206.105@tcp/0@lo 00000100:00100000:3.0:1788460210.261838:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4ac4284700 x1875336022384256/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788460210.261857:0:8:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788460210.261860:0:8:0:(pinger.c:244:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788460210.261861:0:8:0:(import.c:65:import_set_state_nolock()) ffff8c4ac3abd000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788460210.261865:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 492 00000100:00080000:3.0:1788460210.261867:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788460210.261871:0:8:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8c4ac3abd000 using connection 192.168.206.105@tcp/0@lo 00000100:00100000:3.0:1788460210.261881:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4ac4285880 x1875336022384384/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788460210.261904:0:8:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788460210.261907:0:8:0:(pinger.c:254:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788460210.261910:0:8:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788460210.261913:0:8:0:(pinger.c:254:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788460210.261940:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022384640:0@lo:400:kworker.0 00000100:00100000:3.0:1788460210.262033:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460210.262081:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788460210.262088:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4286680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c482be18-c056-4068-8a37-ed5038fc364a:3661:1875336022384000:0@lo:400:kworker.0 00000100:00100000:3.0:1788460210.262118:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460210.262146:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875336022384768:0@lo:400:kworker.0 00000100:00100000:3.0:1788460210.262170:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460210.262197:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4287100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022384128:0@lo:400:kworker.0 00000100:00100000:1.0:1788460210.262463:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022384640 00000100:00100000:1.0:1788460210.262471:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022384640 00000100:00100000:1.0:1788460210.262516:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788460210.262526:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf75e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022384640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460210.262592:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf75e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022384640:12345-0@lo:400:kworker.0 Request processed in 67us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460210.262600:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788460210.262643:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022384640:0@lo:400:kworker.0 00000100:00100000:3.0:1788460210.263057:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460210.263084:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788460210.263091:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4284380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1875336022384512:0@lo:400:kworker.0 00000100:00100000:0.0:1788460210.263260:0:17952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022384128 00000100:00100000:0.0:1788460210.263265:0:17952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022384128 00000100:00100000:0.0:1788460210.263300:0:17952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788460210.263307:0:17952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf75e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022384128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460210.263347:0:17952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf75e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022384128:12345-0@lo:400:kworker.0 Request processed in 41us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460210.263354:0:17952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788460210.263444:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460210.263507:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4287100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022384128:0@lo:400:kworker.0 00000100:00100000:3.0:1788460210.263535:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022384000 00000100:00100000:3.0:1788460210.263539:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022384000 00000100:00100000:3.0:1788460210.263573:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788460210.263580:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4130c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+19:3661:x1875336022384000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460210.263614:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4130c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+19:3661:x1875336022384000:12345-0@lo:400:kworker.0 Request processed in 34us (1495us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460210.263620:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788460210.263688:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4286680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c482be18-c056-4068-8a37-ed5038fc364a:3661:1875336022384000:0@lo:400:kworker.0 00000100:00100000:0.0:1788460210.267869:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022384768 00000100:00100000:0.0:1788460210.267895:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022384768 00000100:00100000:0.0:1788460210.267964:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022384512 00000100:00100000:0.0:1788460210.267967:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022384512 00000100:00100000:0.0:1788460210.268000:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788460210.268010:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf75e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1875336022384768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460210.268101:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf75e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1875336022384768:12345-0@lo:400:kworker.0 Request processed in 92us (5929us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460210.268109:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788460210.268126:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788460210.268132:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf75e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1875336022384512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460210.268167:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf75e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1875336022384512:12345-0@lo:400:kworker.0 Request processed in 35us (4723us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460210.268173:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788460210.269232:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4284700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1875336022384256:0@lo:8:kworker.0 00000400:00000100:0.0:1788460210.269287:0:3658:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875336022384256 offset 0 length 520: 4 00000100:00100000:0.0:1788460210.269318:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4285880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1875336022384384:0@lo:8:kworker.0 00000400:00000100:0.0:1788460210.269333:0:3658:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875336022384384 offset 0 length 520: 4 00010000:00080000:1.0:1788460210.269698:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c4bf75e0e00 x1875336022384768/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460226 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460210.269715:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875336022384768:0@lo:400:kworker.0 00010000:00080000:2.0:1788460210.273046:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c4ac4284380 x1875336022384512/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460226 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460210.273065:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4284380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1875336022384512:0@lo:400:kworker.0 00010000:00010000:1.0:1788460211.090042:0:18366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788460211.284938:0:17965:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788460212.113180:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788460212.371183:0:18713:0:(obd_mount.c:1011:lmd_print()) mount data: 00000020:01000004:2.0:1788460212.371188:0:18713:0:(obd_mount.c:1014:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788460212.371189:0:18713:0:(obd_mount.c:1017:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1788460212.371299:0:18713:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8c4c01993000 00000020:01000004:2.0:1788460212.371314:0:18713:0:(tgt_mount.c:2642:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788460212.371328:0:18713:0:(obd_mount.c:308:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788460212.371341:0:18713:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8c4bd0b89988) 00000020:00000080:2.0:1788460212.371357:0:18713:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788460212.498825:0:18713:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788460212.503057:0:18713:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788460212.508350:0:18713:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1788460212.508740:0:18713:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788460212.509030:0:18713:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1788460212.509230:0:18713:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1788460212.509495:0:18713:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:3.0:1788460212.511873:0:18713:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788460212.512172:0:18713:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788460212.512184:0:18713:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788460212.512195:0:18713:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x5dfa74784542c1ae 00000020:01000004:3.0:1788460212.512202:0:18713:0:(tgt_mount.c:2727:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788460212.512223:0:18713:0:(obd_mount.c:488:lustre_start_mgc()) mgc192.168.206.105@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788460212.512227:0:18713:0:(mgc_request.c:1379:mgc_set_info_async()) InitRecov mgc192.168.206.105@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788460212.512232:0:18713:0:(tgt_mount.c:1939:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788460212.512236:0:18713:0:(obd_mount.c:308:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788460212.512247:0:18713:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8c4bfb5f4c98) 00000020:00000080:3.0:1788460212.512257:0:18713:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:3.0:1788460212.513346:0:18713:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788460212.513496:0:18713:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788460212.513502:0:18713:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788460212.520325:0:18713:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788460212.520339:0:18713:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1788460212.524108:0:18713:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1788460212.524121:0:18713:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1788460212.525904:0:18713:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788460212.526111:0:18713:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1788460212.526124:0:18713:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1788460212.528104:0:18713:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1788460212.528121:0:18713:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788460212.555146:0:18713:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788460212.555466:0:18713:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788460212.555472:0:18713:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1788460212.560821:0:18713:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788460212.560834:0:18713:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1788460212.567284:0:18713:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788460212.567314:0:18713:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1788460212.572145:0:18713:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788460212.572334:0:18713:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1788460212.572340:0:18713:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1788460212.573469:0:18713:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1788460212.573478:0:18713:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1788460212.646305:0:18713:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788460212.647275:0:18713:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1788460212.647284:0:18713:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1788460212.649762:0:18713:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1788460212.649773:0:18713:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1788460212.651155:0:18713:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1788460212.651202:0:18713:0:(tgt_mount.c:1519:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.105@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1788460212.651207:0:18713:0:(tgt_mount.c:1239:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788460212.651208:0:18713:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788460212.651210:0:18713:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788460212.651211:0:18713:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:0.0:1788460212.651212:0:18713:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:0.0:1788460212.651214:0:18713:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:0.0:1788460212.651215:0:18713:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788460212.651217:0:18713:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788460212.651218:0:18713:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788460212.651222:0:18713:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1788460212.651224:0:18713:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788460212.651225:0:18713:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788460212.651226:0:18713:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788460212.651227:0:18713:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:0.0:1788460212.651228:0:18713:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:0.0:1788460212.651229:0:18713:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:0.0:1788460212.651230:0:18713:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788460212.651231:0:18713:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788460212.651232:0:18713:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788460212.651257:0:18713:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788460212.651273:0:18713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4394000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:18713:1875336022384896:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788460212.651335:0:18713:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460212.651416:0:18713:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc800cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788460212.656127:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022384896 00000100:00100000:1.0:1788460212.656142:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022384896 00000100:00100000:1.0:1788460212.656216:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788460212.656228:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4130050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+19:18713:x1875336022384896:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788460212.656259:0:17205:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788460212.656264:0:17205:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1788460212.656267:0:17205:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1788460212.657934:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4130050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+19:18713:x1875336022384896:12345-0@lo:253:mount.lustre.0 Request processed in 1703us (6591us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460212.657979:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788460212.662575:0:18713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4394000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:18713:1875336022384896:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788460212.662594:0:18713:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788460212.662597:0:18713:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788460212.662599:0:18713:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788460212.662601:0:18713:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788460212.662602:0:18713:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:0.0:1788460212.662603:0:18713:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:0.0:1788460212.662604:0:18713:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:0.0:1788460212.662605:0:18713:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788460212.662607:0:18713:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788460212.662625:0:18713:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788460212.662648:0:18713:0:(tgt_mount.c:115:server_register_mount()) register mount ffff8c4c01993000 from lustre-OST0000 10000000:01000000:0.0:1788460212.662815:0:18713:0:(mgc_request.c:2423:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1788460212.662819:0:18713:0:(mgc_request.c:424:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788460212.662827:0:18713:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8c4c01993000 10000000:01000000:0.0:1788460212.662833:0:18713:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788460212.662867:0:18713:0:(mgc_request_server.c:106:mgc_fs_setup()) mgc192.168.206.105@tcp: setup lustre-OST0000-osd 00000040:01000000:0.0:1788460212.670829:0:18713:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.206.105@tcp ctxt 1 is initialized 00000040:01000000:1.0:1788460212.677511:0:18713:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.206.105@tcp ctxt 0 is initialized 10000000:01000000:1.0:1788460212.677532:0:18713:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-sptlrpc-ffff8c4c01993000 from 1 10000000:01000000:1.0:1788460212.677536:0:18713:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788460212.677582:0:18713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677400/0x5dfa74784542c1bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460212.677593:0:18713:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677400/0x5dfa74784542c1bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460212.677605:0:18713:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677400/0x5dfa74784542c1bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460212.677627:0:18713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e63480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:18713:1875336022385024:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788460212.677824:0:18713:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460212.677916:0:18713:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac2558780 going to sleep for 11 seconds 00000100:00100000:0.0:1788460212.681126:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022385024 00000100:00100000:0.0:1788460212.681139:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022385024 00000100:00100000:1.0:1788460212.692641:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788460212.692665:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4133850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+19:18713:x1875336022385024:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788460212.692685:0:17204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460212.692702:0:17204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4ac3676c00/0x5dfa74784542c1c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542c1bc expref: -99 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460212.692740:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4ac3676c00/0x5dfa74784542c1c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542c1bc expref: 20 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460212.692752:0:17204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4ac3676c00/0x5dfa74784542c1c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542c1bc expref: 20 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460212.692760:0:17204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ac3676c00, rc 0) 00000100:00100000:1.0:1788460212.692833:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4133850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+20:18713:x1875336022385024:12345-0@lo:101:mount.lustre.0 Request processed in 180us (15009us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460212.692839:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788460212.695104:0:18713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e63480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:18713:1875336022385024:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788460212.695134:0:18713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677400/0x5dfa74784542c1bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c1c3 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460212.695148:0:18713:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677400/0x5dfa74784542c1bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542c1c3 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460212.695246:0:18713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4394000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:18713:1875336022385152:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788460212.695302:0:18713:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460212.695341:0:18713:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bfa1856c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788460212.695631:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022385152 00000100:00100000:1.0:1788460212.695652:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022385152 00000100:00100000:1.0:1788460212.695714:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788460212.695732:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4132450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+20:18713:x1875336022385152:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788460212.695807:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4132450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+20:18713:x1875336022385152:12345-0@lo:501:mount.lustre.0 Request processed in 84us (504us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788460212.695815:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788460212.696019:0:18713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4394000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:18713:1875336022385152:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788460212.696035:0:18713:0:(mgc_request_server.c:748:mgc_llog_local_copy()) mgc192.168.206.105@tcp: no remote llog for lustre-sptlrpc, check MGS config 00000100:00100000:2.0:1788460212.696087:0:18713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac42f0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:18713:1875336022385280:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788460212.696117:0:18713:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460212.696145:0:18713:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc62d89c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788460212.696519:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022385280 00000100:00100000:0.0:1788460212.696525:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022385280 00000100:00100000:0.0:1788460212.696563:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788460212.696570:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4132850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+20:18713:x1875336022385280:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788460212.696629:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4132850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+20:18713:x1875336022385280:12345-0@lo:501:mount.lustre.0 Request processed in 59us (511us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788460212.696636:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788460212.696763:0:18713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac42f0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:18713:1875336022385280:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788460212.696782:0:18713:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788460212.696797:0:18713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677400/0x5dfa74784542c1bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c1c3 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460212.696808:0:18713:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677400/0x5dfa74784542c1bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c1c3 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788460212.696819:0:18713:0:(mgc_request.c:206:do_config_log_add()) do adding config log params-ffff8c4c01993000 10000000:01000000:2.0:1788460212.696825:0:18713:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788460212.696845:0:18713:0:(mgc_request_server.c:106:mgc_fs_setup()) mgc192.168.206.105@tcp: setup lustre-OST0000-osd 00000040:01000000:2.0:1788460212.696907:0:18713:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.206.105@tcp ctxt 1 is initialized 00000040:01000000:2.0:1788460212.696914:0:18713:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.206.105@tcp ctxt 0 is initialized 10000000:01000000:2.0:1788460212.696920:0:18713:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788460212.696923:0:18713:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788460212.696976:0:18713:0:(mgc_request_server.c:106:mgc_fs_setup()) mgc192.168.206.105@tcp: setup lustre-OST0000-osd 00000040:01000000:2.0:1788460212.697010:0:18713:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.206.105@tcp ctxt 1 is initialized 00000040:01000000:2.0:1788460212.697014:0:18713:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.206.105@tcp ctxt 0 is initialized 10000000:01000000:2.0:1788460212.697020:0:18713:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-mdtir-ffff8c4c01993000 10000000:01000000:2.0:1788460212.697023:0:18713:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788460212.697046:0:18713:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1788460212.697049:0:18713:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788460212.697076:0:18713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7e00/0x5dfa74784542c1ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460212.697085:0:18713:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7e00/0x5dfa74784542c1ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460212.697093:0:18713:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7e00/0x5dfa74784542c1ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460212.697106:0:18713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac42f0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:18713:1875336022385408:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788460212.697141:0:18713:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460212.697151:0:18713:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc62d8c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788460212.697324:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022385408 00000100:00100000:0.0:1788460212.697329:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022385408 00000100:00100000:0.0:1788460212.697365:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788460212.697379:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4130850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+20:18713:x1875336022385408:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788460212.697488:0:17204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460212.697500:0:17204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4bc2bd5a00/0x5dfa74784542c1d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542c1ca expref: -99 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460212.697520:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bc2bd5a00/0x5dfa74784542c1d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542c1ca expref: 21 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460212.697530:0:17204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4bc2bd5a00/0x5dfa74784542c1d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542c1ca expref: 21 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460212.697538:0:17204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc2bd5a00, rc 0) 00000100:00100000:0.0:1788460212.697566:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4130850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+21:18713:x1875336022385408:12345-0@lo:101:mount.lustre.0 Request processed in 188us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460212.697572:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788460212.699584:0:18713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac42f0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:18713:1875336022385408:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788460212.699608:0:18713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7e00/0x5dfa74784542c1ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c1d1 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460212.699620:0:18713:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7e00/0x5dfa74784542c1ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542c1d1 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788460212.703559:0:18713:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000040:00080000:2.0:1788460212.706250:0:18713:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788460212.710189:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].1, 224 off8416 00000040:00080000:2.0:1788460212.710247:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].2, 128 off8544 00000040:00080000:2.0:1788460212.710265:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].3, 112 off8656 00000040:00080000:2.0:1788460212.710277:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].4, 224 off8880 00000040:00080000:2.0:1788460212.710289:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].5, 224 off9104 00000040:00080000:2.0:1788460212.710302:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].6, 80 off9184 00000040:00080000:2.0:1788460212.710315:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].7, 224 off9408 00000040:00080000:2.0:1788460212.710330:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].8, 224 off9632 00000040:00080000:2.0:1788460212.710343:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].9, 80 off9712 00000040:00080000:2.0:1788460212.711559:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].10, 224 off9936 00000040:00080000:2.0:1788460212.711609:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].11, 224 off10160 00000040:00080000:2.0:1788460212.711625:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].12, 120 off10280 00000040:00080000:2.0:1788460212.711841:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].13, 224 off10504 00000040:00080000:2.0:1788460212.711852:0:18713:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 13 count 14 00000100:00100000:2.0:1788460212.712202:0:18713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac42f0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:18713:1875336022385536:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788460212.712268:0:18713:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460212.712310:0:18713:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc62d8000 going to sleep for 11 seconds 00000100:00100000:0.0:1788460212.713501:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022385536 00000100:00100000:0.0:1788460212.713515:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022385536 00000100:00100000:0.0:1788460212.713566:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788460212.713576:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4132050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+21:18713:x1875336022385536:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788460212.714215:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4132050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+21:18713:x1875336022385536:12345-0@lo:501:mount.lustre.0 Request processed in 639us (1945us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460212.714223:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788460212.714541:0:18713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac42f0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:18713:1875336022385536:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788460212.714586:0:18713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac42f0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:18713:1875336022385664:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788460212.714635:0:18713:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460212.714677:0:18713:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc62d8000 going to sleep for 11 seconds 00000100:00100000:1.0:1788460212.714845:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022385664 00000100:00100000:1.0:1788460212.714851:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022385664 00000100:00100000:1.0:1788460212.715033:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788460212.715043:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4132c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+21:18713:x1875336022385664:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788460212.718189:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4132c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+21:18713:x1875336022385664:12345-0@lo:503:mount.lustre.0 Request processed in 3141us (3546us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460212.718264:0:18713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac42f0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:18713:1875336022385664:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788460212.718685:0:18713:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788460212.718792:0:18713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:18713:1875336022385792:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788460212.718842:0:18713:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460212.718879:0:18713:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bced74240 going to sleep for 11 seconds 00000100:00100000:0.0:1788460212.719013:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022385792 00000100:00100000:0.0:1788460212.719019:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022385792 00000100:00100000:1.0:1788460212.722594:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788460212.727533:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788460212.727559:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4131050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+21:18713:x1875336022385792:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788460212.729704:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4131050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+21:18713:x1875336022385792:12345-0@lo:502:mount.lustre.0 Request processed in 2150us (10855us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460212.729731:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788460212.729821:0:18713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:18713:1875336022385792:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788460212.730190:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].1, 224 off8416 00000040:00080000:3.0:1788460212.730217:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].2, 128 off8544 00000040:00080000:3.0:1788460212.730236:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].3, 112 off8656 00000040:00080000:3.0:1788460212.730260:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].4, 224 off8880 00000040:00080000:3.0:1788460212.730272:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].5, 224 off9104 00000040:00080000:3.0:1788460212.730282:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].6, 80 off9184 00000040:00080000:3.0:1788460212.730293:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].7, 224 off9408 00000040:00080000:3.0:1788460212.730305:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].8, 224 off9632 00000040:00080000:3.0:1788460212.730317:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].9, 80 off9712 00000040:00080000:3.0:1788460212.730328:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].10, 224 off9936 00000040:00080000:3.0:1788460212.730339:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].11, 224 off10160 00000040:00080000:3.0:1788460212.730349:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].12, 120 off10280 00000100:00100000:3.0:1788460212.730450:0:18713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:18713:1875336022385920:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788460212.730498:0:18713:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460212.730536:0:18713:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bced74240 going to sleep for 11 seconds 00000100:00100000:1.0:1788460212.730605:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022385920 00000100:00100000:1.0:1788460212.730613:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022385920 00000100:00100000:1.0:1788460212.730652:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788460212.730781:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4131450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+21:18713:x1875336022385920:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788460212.730896:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4131450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+21:18713:x1875336022385920:12345-0@lo:502:mount.lustre.0 Request processed in 172us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460212.730904:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788460212.731160:0:18713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:18713:1875336022385920:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788460212.731208:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].13, 224 off10504 00000040:00080000:3.0:1788460212.731216:0:18713:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:0.0:1788460212.736370:0:18730:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788460212.736383:0:18730:0:(obd_mount.c:1049:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1788460212.736390:0:18730:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788460212.736393:0:18730:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1788460212.736400:0:18730:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788460212.736417:0:18730:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8c4c019a0000) 00000020:00000080:0.0:1788460212.736441:0:18730:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788460212.736448:0:18730:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788460212.736540:0:18730:0:(tgt_mount.c:167:server_get_mount()) get mount ffff8c4c01993000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1788460212.736550:0:18730:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788460212.736557:0:18730:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x5dfa74784542c1df 00010000:00010000:0.0:1788460212.747026:0:18730:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:0.0:1788460212.747994:0:18730:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:0.0:1788460212.749646:0:18730:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:2.0:1788460212.758730:0:18730:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1788460212.758744:0:18730:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788460212.758755:0:18730:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788460212.758758:0:18730:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1788460212.758762:0:18730:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788460212.758765:0:18730:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:2.0:1788460212.758767:0:18730:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788460212.758769:0:18730:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788460212.758771:0:18730:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788460212.758774:0:18730:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788460212.758775:0:18730:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788460212.758778:0:18730:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788460212.758782:0:18730:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788460212.758783:0:18730:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788460212.758786:0:18730:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788460212.758788:0:18730:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788460212.758791:0:18730:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788460212.758793:0:18730:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788460212.758795:0:18730:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788460212.758806:0:18730:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788460212.758808:0:18730:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788460212.758810:0:18730:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788460212.758813:0:18730:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788460212.758845:0:18730:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788460212.758848:0:18730:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788460212.758850:0:18730:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788460212.758853:0:18730:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x14:0x0] index 14 count 14 00000020:01000000:3.0:1788460212.759496:0:18713:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1788460212.759511:0:18713:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788460212.759540:0:18713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7e00/0x5dfa74784542c1ca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c1d1 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460212.759553:0:18713:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7e00/0x5dfa74784542c1ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c1d1 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788460212.759560:0:18713:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-mdtir-ffff8c4c01993000 from 1 10000000:01000000:3.0:1788460212.759563:0:18713:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788460212.759603:0:18713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2800/0x5dfa74784542c1e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460212.759612:0:18713:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2800/0x5dfa74784542c1e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460212.759633:0:18713:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2800/0x5dfa74784542c1e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460212.759667:0:18713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:18713:1875336022386048:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788460212.759731:0:18713:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460212.759772:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022386048 00000100:00100000:3.0:1788460212.759780:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022386048 00000100:00100000:3.0:1788460212.759827:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788460212.759835:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4133050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+21:18713:x1875336022386048:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788460212.759848:0:17204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460212.759859:0:17204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4bc29d2c00/0x5dfa74784542c1ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542c1e6 expref: -99 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460212.759881:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bc29d2c00/0x5dfa74784542c1ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542c1e6 expref: 22 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460212.759892:0:17204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4bc29d2c00/0x5dfa74784542c1ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542c1e6 expref: 22 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460212.759901:0:17204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc29d2c00, rc 0) 00000100:00100000:3.0:1788460212.759934:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4133050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+22:18713:x1875336022386048:12345-0@lo:101:mount.lustre.0 Request processed in 100us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460212.759941:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788460212.761176:0:18713:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bced74240 going to sleep for 11 seconds 00000100:00100000:3.0:1788460212.761208:0:18713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:18713:1875336022386048:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788460212.761226:0:18713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2800/0x5dfa74784542c1e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c1ed expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460212.761248:0:18713:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2800/0x5dfa74784542c1e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542c1ed expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460212.763999:0:18713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:18713:1875336022386176:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1788460212.764512:0:18713:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460212.764562:0:18713:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bced74240 going to sleep for 11 seconds 00000100:00100000:2.0:1788460212.764566:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022386176 00000100:00100000:2.0:1788460212.764576:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022386176 00000100:00100000:2.0:1788460212.764639:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788460212.764650:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4130450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+22:18713:x1875336022386176:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1788460212.764744:0:17206:0:(mgs_nids.c:1209:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788460212.764764:0:17206:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788460212.764768:0:17206:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788460212.764771:0:17206:0:(mgs_nids.c:325:mgs_nidtbl_read()) Read IR logs lustre return with 88, version 8 00000100:00100000:2.0:1788460212.764869:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4130450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+22:18713:x1875336022386176:12345-0@lo:256:mount.lustre.0 Request processed in 221us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460212.764878:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788460212.765037:0:18713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:18713:1875336022386176:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1788460212.767305:0:18713:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788460212.767335:0:18713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2800/0x5dfa74784542c1e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c1ed expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460212.767348:0:18713:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2800/0x5dfa74784542c1e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c1ed expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788460212.767379:0:18713:0:(mgc_request.c:2266:mgc_process_log()) Process log params-ffff8c4c01993000 from 1 10000000:01000000:1.0:1788460212.767778:0:18713:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788460212.767819:0:18713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677600/0x5dfa74784542c1f4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460212.767828:0:18713:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677600/0x5dfa74784542c1f4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460212.769081:0:18713:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677600/0x5dfa74784542c1f4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460212.769110:0:18713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e63480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:18713:1875336022386304:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788460212.769176:0:18713:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460212.769216:0:18713:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4beddf8f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788460212.769529:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022386304 00000100:00100000:3.0:1788460212.769536:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022386304 00000100:00100000:3.0:1788460212.769586:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788460212.769596:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac2b3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+22:18713:x1875336022386304:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788460212.769611:0:17205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460212.769625:0:17205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4bc29d2600/0x5dfa74784542c1fb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542c1f4 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460212.769648:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bc29d2600/0x5dfa74784542c1fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542c1f4 expref: 23 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460212.769844:0:17205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4bc29d2600/0x5dfa74784542c1fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542c1f4 expref: 23 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460212.769855:0:17205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc29d2600, rc 0) 00000100:00100000:3.0:1788460212.769906:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac2b3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+23:18713:x1875336022386304:12345-0@lo:101:mount.lustre.0 Request processed in 312us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460212.769913:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788460212.770794:0:18713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e63480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:18713:1875336022386304:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788460212.770814:0:18713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677600/0x5dfa74784542c1f4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c1fb expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460212.770825:0:18713:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677600/0x5dfa74784542c1f4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542c1fb expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788460212.774768:0:18713:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 13 count 13 00000040:00080000:1.0:1788460212.775090:0:18713:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788460212.775521:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].1, 224 off8416 00000040:00080000:1.0:1788460212.775553:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].2, 112 off8528 00000040:00080000:1.0:1788460212.775567:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].3, 224 off8752 00000040:00080000:1.0:1788460212.775579:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].4, 224 off8976 00000040:00080000:1.0:1788460212.775593:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].5, 112 off9088 00000040:00080000:1.0:1788460212.775606:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].6, 224 off9312 00000040:00080000:1.0:1788460212.775618:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].7, 224 off9536 00000040:00080000:1.0:1788460212.775629:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].8, 128 off9664 00000040:00080000:1.0:1788460212.775641:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].9, 224 off9888 00000040:00080000:1.0:1788460212.775654:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].10, 224 off10112 00000040:00080000:1.0:1788460212.775667:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].11, 128 off10240 00000040:00080000:1.0:1788460212.775685:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].12, 224 off10464 00000040:00080000:1.0:1788460212.775690:0:18713:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 12 count 13 00000100:00100000:1.0:1788460212.775770:0:18713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e60700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:18713:1875336022386432:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788460212.775855:0:18713:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460212.777587:0:18713:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4beddf8a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788460212.779713:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022386432 00000100:00100000:0.0:1788460212.779738:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022386432 00000100:00100000:0.0:1788460212.779809:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788460212.779819:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac2b3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+23:18713:x1875336022386432:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788460212.780022:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac2b3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+23:18713:x1875336022386432:12345-0@lo:501:mount.lustre.0 Request processed in 204us (4167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460212.780030:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788460212.781542:0:18713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e60700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:18713:1875336022386432:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788460212.781598:0:18713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e60700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:18713:1875336022386560:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788460212.781654:0:18713:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460212.781696:0:18713:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4beddf8a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788460212.781739:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022386560 00000100:00100000:0.0:1788460212.781746:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022386560 00000100:00100000:0.0:1788460212.781796:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788460212.781804:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac2b39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+23:18713:x1875336022386560:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788460212.781906:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac2b39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+23:18713:x1875336022386560:12345-0@lo:503:mount.lustre.0 Request processed in 102us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460212.781922:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788460212.781990:0:18713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e60700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:18713:1875336022386560:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788460212.782388:0:18713:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788460212.782449:0:18713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e60700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:18713:1875336022386688:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788460212.782486:0:18713:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460212.782516:0:18713:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4beddf8a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788460212.782741:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022386688 00000100:00100000:0.0:1788460212.782746:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022386688 00000100:00100000:0.0:1788460212.782780:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788460212.782788:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac2b38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+23:18713:x1875336022386688:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788460212.782867:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac2b38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+23:18713:x1875336022386688:12345-0@lo:502:mount.lustre.0 Request processed in 80us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460212.782875:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788460212.783715:0:18713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e60700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:18713:1875336022386688:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788460212.784011:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].1, 224 off8416 00000040:00080000:1.0:1788460212.784039:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].2, 112 off8528 00000040:00080000:1.0:1788460212.784055:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].3, 224 off8752 00000040:00080000:1.0:1788460212.784068:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].4, 224 off8976 00000040:00080000:1.0:1788460212.784083:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].5, 112 off9088 00000040:00080000:1.0:1788460212.784097:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].6, 224 off9312 00000040:00080000:1.0:1788460212.784110:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].7, 224 off9536 00000040:00080000:1.0:1788460212.784122:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].8, 128 off9664 00000040:00080000:1.0:1788460212.784135:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].9, 224 off9888 00000040:00080000:1.0:1788460212.784146:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].10, 224 off10112 00000040:00080000:1.0:1788460212.784158:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].11, 128 off10240 00000100:00100000:1.0:1788460212.784185:0:18713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e60700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:18713:1875336022386816:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788460212.784230:0:18713:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460212.784267:0:18713:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4beddf8a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788460212.784886:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022386816 00000100:00100000:0.0:1788460212.784894:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022386816 00000100:00100000:0.0:1788460212.785072:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788460212.785083:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac2b3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+23:18713:x1875336022386816:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788460212.785250:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac2b3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+23:18713:x1875336022386816:12345-0@lo:502:mount.lustre.0 Request processed in 168us (1018us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460212.789612:0:18713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e60700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:18713:1875336022386816:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788460212.789752:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].12, 224 off10464 00000040:00080000:3.0:1788460212.789778:0:18713:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1788460212.792472:0:18734:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788460212.792483:0:18734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788460212.792485:0:18734:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788460212.792492:0:18734:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c4c01993000 00000020:00000080:3.0:1788460212.792495:0:18734:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788460212.792503:0:18734:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788460212.792506:0:18734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788460212.792507:0:18734:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788460212.792510:0:18734:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788460212.792512:0:18734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788460212.792513:0:18734:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788460212.792516:0:18734:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c4c01993000 00000020:00000080:3.0:1788460212.792518:0:18734:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788460212.792590:0:18734:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788460212.792594:0:18734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788460212.792595:0:18734:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788460212.792597:0:18734:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788460212.792600:0:18734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788460212.792601:0:18734:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788460212.792604:0:18734:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8c4c01993000 00000020:00000080:3.0:1788460212.792606:0:18734:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788460212.792627:0:18734:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788460212.792630:0:18734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788460212.792632:0:18734:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788460212.792635:0:18734:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788460212.792637:0:18734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788460212.792639:0:18734:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788460212.792643:0:18734:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8c4c01993000 00000020:00000080:3.0:1788460212.792646:0:18734:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788460212.792681:0:18734:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788460212.792684:0:18734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788460212.792686:0:18734:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788460212.792690:0:18734:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x16:0x0] index 13 count 13 00000100:00100000:0.0:1788460212.792702:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000020:01000000:1.0:1788460212.794483:0:18713:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1788460212.794505:0:18713:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788460212.794531:0:18713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677600/0x5dfa74784542c1f4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c1fb expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460212.794545:0:18713:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677600/0x5dfa74784542c1f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c1fb expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788460212.794608:0:18713:0:(mgc_request.c:2423:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788460212.794611:0:18713:0:(mgc_request.c:424:config_log_add()) add config log lustre-client-ffff8c4c01993000 10000000:01000000:1.0:1788460212.794614:0:18713:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-client-ffff8c4c01993000 10000000:01000000:1.0:1788460212.794619:0:18713:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788460212.794636:0:18713:0:(mgc_request_server.c:106:mgc_fs_setup()) mgc192.168.206.105@tcp: setup lustre-OST0000-osd 00000040:01000000:1.0:1788460212.794701:0:18713:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.206.105@tcp ctxt 1 is initialized 00000040:01000000:1.0:1788460212.794708:0:18713:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.206.105@tcp ctxt 0 is initialized 10000000:01000000:1.0:1788460212.794721:0:18713:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-client-ffff8c4c01993000 from 1 10000000:01000000:1.0:1788460212.794724:0:18713:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788460212.794757:0:18713:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac3676400/0x5dfa74784542c202 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460212.794766:0:18713:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4ac3676400/0x5dfa74784542c202 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460212.794777:0:18713:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4ac3676400/0x5dfa74784542c202 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460212.794799:0:18713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e62d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:18713:1875336022386944:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788460212.794857:0:18713:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460212.794912:0:18713:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4beddf8240 going to sleep for 11 seconds 00000100:00100000:3.0:1788460212.794922:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022386944 00000100:00100000:3.0:1788460212.794931:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022386944 00000100:00100000:3.0:1788460212.795006:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788460212.795016:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac2b39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+23:18713:x1875336022386944:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788460212.795039:0:17204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460212.795051:0:17204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4bc29d3200/0x5dfa74784542c209 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542c202 expref: -99 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460212.795073:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bc29d3200/0x5dfa74784542c209 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542c202 expref: 24 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460212.795084:0:17204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4bc29d3200/0x5dfa74784542c209 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542c202 expref: 24 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460212.795092:0:17204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc29d3200, rc 0) 00000100:00100000:3.0:1788460212.795131:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac2b39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+24:18713:x1875336022386944:12345-0@lo:101:mount.lustre.0 Request processed in 117us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460212.795138:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788460212.795563:0:18713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e62d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:18713:1875336022386944:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788460212.795587:0:18713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4ac3676400/0x5dfa74784542c202 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c209 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460212.795596:0:18713:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4ac3676400/0x5dfa74784542c202 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542c209 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788460212.801903:0:18713:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:2.0:1788460212.802238:0:18713:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788460212.804547:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].1, 224 off8416 00000040:00080000:2.0:1788460212.804604:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].2, 120 off8536 00000040:00080000:2.0:1788460212.804638:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].3, 168 off8704 00000040:00080000:2.0:1788460212.805826:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].4, 224 off8928 00000040:00080000:2.0:1788460212.805858:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].5, 224 off9152 00000040:00080000:2.0:1788460212.805871:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].6, 120 off9272 00000040:00080000:2.0:1788460212.805886:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].7, 168 off9440 00000040:00080000:2.0:1788460212.805900:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].8, 224 off9664 00000040:00080000:2.0:1788460212.805915:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].9, 224 off9888 00000040:00080000:2.0:1788460212.805928:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].10, 120 off10008 00000040:00080000:2.0:1788460212.805941:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].11, 224 off10232 00000040:00080000:2.0:1788460212.806455:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].12, 224 off10456 00000040:00080000:2.0:1788460212.806477:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].13, 88 off10544 00000040:00080000:2.0:1788460212.806489:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].14, 128 off10672 00000040:00080000:2.0:1788460212.806500:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].15, 144 off10816 00000040:00080000:2.0:1788460212.806513:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].16, 160 off10976 00000040:00080000:2.0:1788460212.806525:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].17, 224 off11200 00000040:00080000:2.0:1788460212.806537:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].18, 224 off11424 00000040:00080000:2.0:1788460212.806549:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].19, 80 off11504 00000040:00080000:2.0:1788460212.806577:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].20, 224 off11728 00000040:00080000:2.0:1788460212.806591:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].21, 224 off11952 00000040:00080000:2.0:1788460212.806603:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].22, 88 off12040 00000040:00080000:2.0:1788460212.806614:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].23, 128 off12168 00000040:00080000:2.0:1788460212.806626:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].24, 144 off12312 00000040:00080000:2.0:1788460212.806639:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].25, 160 off12472 00000040:00080000:2.0:1788460212.806651:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].26, 224 off12696 00000040:00080000:2.0:1788460212.807224:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].27, 224 off12920 00000040:00080000:2.0:1788460212.807244:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].28, 80 off13000 00000040:00080000:2.0:1788460212.807256:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].29, 224 off13224 00000040:00080000:2.0:1788460212.807269:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].30, 224 off13448 00000040:00080000:2.0:1788460212.807283:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].31, 88 off13536 00000040:00080000:2.0:1788460212.807296:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].32, 128 off13664 00000040:00080000:2.0:1788460212.807310:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].33, 144 off13808 00000040:00080000:2.0:1788460212.807322:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].34, 128 off13936 00000040:00080000:2.0:1788460212.807337:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].35, 224 off14160 00000040:00080000:2.0:1788460212.809073:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].36, 224 off14384 00000040:00080000:2.0:1788460212.809142:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].37, 80 off14464 00000040:00080000:2.0:1788460212.809162:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].38, 224 off14688 00000040:00080000:2.0:1788460212.809176:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].39, 224 off14912 00000040:00080000:2.0:1788460212.809190:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].40, 88 off15000 00000040:00080000:2.0:1788460212.809204:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].41, 128 off15128 00000040:00080000:2.0:1788460212.809219:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].42, 144 off15272 00000040:00080000:2.0:1788460212.809234:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].43, 128 off15400 00000040:00080000:2.0:1788460212.809249:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].44, 224 off15624 00000040:00080000:2.0:1788460212.809265:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].45, 224 off15848 00000040:00080000:2.0:1788460212.809278:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].46, 80 off15928 00000040:00080000:2.0:1788460212.809292:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].47, 224 off16152 00000040:00080000:2.0:1788460212.809306:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].48, 232 off16384 00000040:00080000:2.0:1788460212.810200:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].49, 224 off16608 00000040:00080000:2.0:1788460212.810232:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].50, 120 off16728 00000040:00080000:2.0:1788460212.810268:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x17:0x0].51, 224 off16952 00000040:00080000:2.0:1788460212.810274:0:18713:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:2.0:1788460212.811862:0:18713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac42f1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:18713:1875336022387072:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788460212.811934:0:18713:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460212.812823:0:18713:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc62d8900 going to sleep for 11 seconds 00000100:00100000:3.0:1788460212.813098:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022387072 00000100:00100000:3.0:1788460212.813107:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022387072 00000100:00100000:3.0:1788460212.813160:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788460212.813169:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac2b3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+24:18713:x1875336022387072:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788460212.813312:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac2b3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+24:18713:x1875336022387072:12345-0@lo:501:mount.lustre.0 Request processed in 145us (1377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460212.813321:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788460212.813488:0:18713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac42f1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:18713:1875336022387072:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788460212.813530:0:18713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac42f1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:18713:1875336022387200:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788460212.813582:0:18713:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460212.813612:0:18713:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc62d8900 going to sleep for 11 seconds 00000100:00100000:3.0:1788460212.814499:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022387200 00000100:00100000:3.0:1788460212.814508:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022387200 00000100:00100000:3.0:1788460212.814546:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788460212.814554:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac2b3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+24:18713:x1875336022387200:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788460212.814684:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac2b3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+24:18713:x1875336022387200:12345-0@lo:503:mount.lustre.0 Request processed in 130us (1101us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460212.814691:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788460212.815640:0:18713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac42f1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:18713:1875336022387200:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788460212.817251:0:18713:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788460212.817339:0:18713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac42f1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:18713:1875336022387328:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788460212.819120:0:18713:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460212.819170:0:18713:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc62d8900 going to sleep for 11 seconds 00000100:00100000:3.0:1788460212.819609:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022387328 00000100:00100000:3.0:1788460212.819619:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022387328 00000100:00100000:3.0:1788460212.819681:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788460212.819691:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac2b39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+24:18713:x1875336022387328:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788460212.819829:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac2b39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+24:18713:x1875336022387328:12345-0@lo:502:mount.lustre.0 Request processed in 139us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460212.819837:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788460212.820525:0:18713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac42f1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:18713:1875336022387328:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788460212.820763:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].1, 224 off8416 00000040:00080000:2.0:1788460212.820789:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].2, 120 off8536 00000040:00080000:2.0:1788460212.820800:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].3, 168 off8704 00000040:00080000:2.0:1788460212.820811:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].4, 224 off8928 00000040:00080000:2.0:1788460212.820823:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].5, 224 off9152 00000040:00080000:2.0:1788460212.820834:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].6, 120 off9272 00000040:00080000:2.0:1788460212.820846:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].7, 168 off9440 00000040:00080000:2.0:1788460212.820858:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].8, 224 off9664 00000040:00080000:2.0:1788460212.820870:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].9, 224 off9888 00000040:00080000:2.0:1788460212.820881:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].10, 120 off10008 00000040:00080000:2.0:1788460212.820893:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].11, 224 off10232 00000040:00080000:2.0:1788460212.820903:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].12, 224 off10456 00000040:00080000:2.0:1788460212.820929:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].13, 88 off10544 00000040:00080000:2.0:1788460212.820961:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].14, 128 off10672 00000040:00080000:2.0:1788460212.823009:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].15, 144 off10816 00000040:00080000:2.0:1788460212.823043:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].16, 160 off10976 00000040:00080000:2.0:1788460212.823056:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].17, 224 off11200 00000040:00080000:2.0:1788460212.823068:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].18, 224 off11424 00000040:00080000:2.0:1788460212.823079:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].19, 80 off11504 00000040:00080000:2.0:1788460212.823089:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].20, 224 off11728 00000040:00080000:2.0:1788460212.823099:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].21, 224 off11952 00000040:00080000:2.0:1788460212.823108:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].22, 88 off12040 00000040:00080000:2.0:1788460212.823118:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].23, 128 off12168 00000040:00080000:2.0:1788460212.823134:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].24, 144 off12312 00000040:00080000:2.0:1788460212.823145:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].25, 160 off12472 00000040:00080000:2.0:1788460212.823156:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].26, 224 off12696 00000040:00080000:2.0:1788460212.823166:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].27, 224 off12920 00000040:00080000:2.0:1788460212.823178:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].28, 80 off13000 00000040:00080000:2.0:1788460212.823207:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].29, 224 off13224 00000040:00080000:2.0:1788460212.823222:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].30, 224 off13448 00000040:00080000:2.0:1788460212.823242:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].31, 88 off13536 00000040:00080000:2.0:1788460212.823255:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].32, 128 off13664 00000040:00080000:2.0:1788460212.823267:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].33, 144 off13808 00000040:00080000:2.0:1788460212.823279:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].34, 128 off13936 00000040:00080000:2.0:1788460212.823291:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].35, 224 off14160 00000040:00080000:2.0:1788460212.823304:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].36, 224 off14384 00000040:00080000:2.0:1788460212.823317:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].37, 80 off14464 00000040:00080000:2.0:1788460212.823330:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].38, 224 off14688 00000040:00080000:2.0:1788460212.823341:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].39, 224 off14912 00000040:00080000:2.0:1788460212.823353:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].40, 88 off15000 00000040:00080000:2.0:1788460212.823367:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].41, 128 off15128 00000040:00080000:2.0:1788460212.823381:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].42, 144 off15272 00000040:00080000:2.0:1788460212.823394:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].43, 128 off15400 00000040:00080000:2.0:1788460212.823407:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].44, 224 off15624 00000040:00080000:2.0:1788460212.823439:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].45, 224 off15848 00000040:00080000:2.0:1788460212.823456:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].46, 80 off15928 00000040:00080000:2.0:1788460212.823470:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].47, 224 off16152 00000040:00080000:2.0:1788460212.823483:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].48, 232 off16384 00000100:00100000:2.0:1788460212.823536:0:18713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac42f1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:18713:1875336022387456:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788460212.823608:0:18713:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460212.823656:0:18713:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc62d8900 going to sleep for 11 seconds 00000100:00100000:1.0:1788460212.823728:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022387456 00000100:00100000:1.0:1788460212.823735:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022387456 00000100:00100000:1.0:1788460212.823783:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788460212.823792:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac2b38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+24:18713:x1875336022387456:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788460212.823911:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac2b38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+24:18713:x1875336022387456:12345-0@lo:502:mount.lustre.0 Request processed in 119us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460212.823919:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788460212.825507:0:18713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac42f1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:18713:1875336022387456:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788460212.825739:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].49, 224 off16608 00000040:00080000:2.0:1788460212.825764:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].50, 120 off16728 00000100:00100000:2.0:1788460212.825798:0:18713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac42f1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:18713:1875336022387584:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788460212.825855:0:18713:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460212.825901:0:18713:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc62d8900 going to sleep for 11 seconds 00000100:00100000:3.0:1788460212.827137:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022387584 00000100:00100000:3.0:1788460212.827150:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022387584 00000100:00100000:3.0:1788460212.827208:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788460212.827217:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac2b3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+24:18713:x1875336022387584:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788460212.827352:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac2b3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+24:18713:x1875336022387584:12345-0@lo:502:mount.lustre.0 Request processed in 136us (1496us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460212.827360:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788460212.827645:0:18713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac42f1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:18713:1875336022387584:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788460212.828543:0:18713:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x18:0x0].51, 224 off16952 00000040:00080000:2.0:1788460212.828570:0:18713:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1788460212.840197:0:18739:0:(obd_mount.c:308:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788460212.840214:0:18739:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8c4bcec50000) 00000020:00000080:1.0:1788460212.840236:0:18739:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:1.0:1788460212.840333:0:18739:0:(tgt_mount.c:167:server_get_mount()) get mount ffff8c4c01993000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788460212.840338:0:18739:0:(tgt_mount.c:201:server_put_mount()) put mount ffff8c4c01993000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788460212.840341:0:18739:0:(obd_mount.c:798:lustre_put_lsi()) put ffff8c4c01993000 3 00010000:00080000:1.0:1788460212.840483:0:18739:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c4ac36fe800@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.105@tcp at head 00010000:00010000:1.0:1788460212.847216:0:18739:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:1.0:1788460212.848216:0:18739:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788460212.848264:0:18739:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788460212.848277:0:18739:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x5dfa74784542c217 00000100:00080000:1.0:1788460212.848287:0:18739:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788460212.848541:0:18739:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8c4ac36fe800 using connection 192.168.206.105@tcp/0@lo 00000100:00100000:1.0:1788460212.848577:0:18739:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4ac1e62d80 x1875336022387712/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788460212.848615:0:18739:0:(pinger.c:380:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788460212.848666:0:37:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788460212.848670:0:37:0:(pinger.c:254:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788460212.848672:0:37:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788460212.848675:0:37:0:(pinger.c:254:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788460212.848699:0:37:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788460212.848703:0:37:0:(pinger.c:254:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788460212.848705:0:37:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788460212.848708:0:37:0:(pinger.c:254:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788460212.848740:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022387840:0@lo:400:kworker.0 00000100:00100000:0.0:1788460212.848741:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1875336022387712:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788460212.852912:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022388096:0@lo:400:kworker.0 00000100:00100000:0.0:1788460212.852924:0:3658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460212.853004:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460212.853015:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3662:1875336022388224:0@lo:400:kworker.0 00000100:00100000:1.0:1788460212.853041:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460212.853048:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3660:1875336022387968:0@lo:400:kworker.0 00000100:00100000:3.0:1788460212.853069:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460212.853092:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022388096 00000100:00100000:3.0:1788460212.853094:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022387712 00000100:00100000:3.0:1788460212.853099:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022387712 00000100:00100000:1.0:1788460212.853099:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022388096 00000100:00100000:3.0:1788460212.853118:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022388224 00000100:00100000:3.0:1788460212.853120:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022388224 00000100:00100000:1.0:1788460212.853130:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788460212.853134:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022387968 00000100:00100000:1.0:1788460212.853137:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf75e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022388096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460212.853141:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022387968 00000100:00100000:3.0:1788460212.853157:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788460212.853162:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac1e60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1875336022388224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460212.853186:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf75e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022388096:12345-0@lo:400:kworker.0 Request processed in 48us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460212.853189:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac1e60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1875336022388224:12345-0@lo:400:kworker.0 Request processed in 28us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460212.853194:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788460212.853195:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788460212.853212:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788460212.853218:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf75e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1875336022387968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460212.853223:0:17213:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788460212.853229:0:17213:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1788460212.853243:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf75e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1875336022387968:12345-0@lo:400:kworker.0 Request processed in 27us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460212.853249:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788460212.853260:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788460212.853262:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022388096:0@lo:400:kworker.0 00000100:00100000:3.0:1788460212.853264:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc4395880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3658:x1875336022387712:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788460212.853284:0:17212:0:(ldlm_lib.c:1461:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 509 last 0 00000020:00000080:3.0:1788460212.853316:0:17212:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x5dfa74784542c21e 00000004:00100000:3.0:1788460212.853330:0:17212:0:(mdt_handler.c:7310:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:0.0:1788460212.853341:0:17211:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00080000:3.0:1788460212.853359:0:17212:0:(import.c:65:import_set_state_nolock()) ffff8c4ac484f000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788460212.853410:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc4395880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3658:x1875336022387712:12345-0@lo:38:llog_process_th.0 Request processed in 145us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460212.853418:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788460212.853445:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c4ac1e61500 x1875336022387968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460228 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460212.853456:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3660:1875336022387968:0@lo:400:kworker.0 00010000:00080000:1.0:1788460212.854048:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c4ac1e61f80 x1875336022388224/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460228 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460212.854058:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3662:1875336022388224:0@lo:400:kworker.0 00000100:00100000:1.0:1788460212.854164:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460212.854195:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022387840 00000100:00100000:1.0:1788460212.854200:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022387840 00000100:00100000:1.0:1788460212.854221:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788460212.854227:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac1e61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022387840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460212.854262:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac1e61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022387840:12345-0@lo:400:kworker.0 Request processed in 36us (99us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460212.854268:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788460212.854999:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022387840:0@lo:400:kworker.0 00010000:00080000:3.0:1788460212.856216:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c4ac1e62d80 x1875336022387712/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788460222 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460212.856242:0:3658:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788460212.856252:0:3658:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1788460212.856260:0:3658:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788460212.856265:0:3658:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788460212.856268:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c4ac36fe800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788460212.856276:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3658:1875336022387712:0@lo:38:llog_process_th.0 00000020:01000004:3.0:1788460212.856910:0:18739:0:(obd_mount.c:308:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788460212.856933:0:18739:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8c4ac488cc98) 00000020:00000080:3.0:1788460212.856998:0:18739:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:3.0:1788460212.857095:0:18739:0:(tgt_mount.c:167:server_get_mount()) get mount ffff8c4c01993000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788460212.857100:0:18739:0:(tgt_mount.c:201:server_put_mount()) put mount ffff8c4c01993000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788460212.857103:0:18739:0:(obd_mount.c:798:lustre_put_lsi()) put ffff8c4c01993000 3 00010000:00080000:3.0:1788460212.857130:0:18739:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c4ac484d000@lustre-MDT0001-lwp-OST0000: add connection 192.168.206.105@tcp at head 00010000:00010000:3.0:1788460212.861883:0:18739:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:3.0:1788460212.862130:0:18739:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1788460212.862178:0:18739:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788460212.862192:0:18739:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x5dfa74784542c22c 00000100:00080000:3.0:1788460212.862201:0:18739:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788460212.862207:0:18739:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8c4ac484d000 using connection 192.168.206.105@tcp/0@lo 00000100:00100000:3.0:1788460212.862241:0:18739:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4bf75e3800 x1875336022388352/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788460212.862275:0:18739:0:(pinger.c:380:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1788460212.862455:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3658:1875336022388352:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788460212.862521:0:3658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788460212.862683:0:37:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788460212.862688:0:37:0:(pinger.c:254:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788460212.862691:0:37:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788460212.862694:0:37:0:(pinger.c:254:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788460212.862697:0:37:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788460212.862700:0:37:0:(pinger.c:254:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788460212.862702:0:37:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788460212.862705:0:37:0:(pinger.c:254:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788460212.864883:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022388352 00000100:00100000:3.0:1788460212.864896:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022388352 00000100:00100000:3.0:1788460212.864940:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788460212.864972:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac1e62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3658:x1875336022388352:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788460212.865247:0:17212:0:(ldlm_lib.c:1461:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 509 last 0 00000020:00000080:3.0:1788460212.865288:0:17212:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x5dfa74784542c233 00000004:00100000:3.0:1788460212.865304:0:17212:0:(mdt_handler.c:7310:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788460212.865336:0:17212:0:(import.c:65:import_set_state_nolock()) ffff8c4ac484b800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788460212.865833:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac1e62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3658:x1875336022388352:12345-0@lo:38:llog_process_th.0 Request processed in 868us (3310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460212.865843:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788460212.866025:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8c4bf75e3800 x1875336022388352/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788460222 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460212.866037:0:3658:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788460212.866044:0:3658:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1788460212.866051:0:3658:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788460212.866056:0:3658:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788460212.866058:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c4ac484d000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788460212.866064:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3658:1875336022388352:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1788460212.871636:0:18739:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x18:0x0] index 52 count 51 00000020:01000000:2.0:1788460212.873928:0:18713:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788460212.873963:0:18713:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788460212.873988:0:18713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac3676400/0x5dfa74784542c202 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c209 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460212.874001:0:18713:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4ac3676400/0x5dfa74784542c202 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c209 expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788460212.874063:0:18713:0:(tgt_mount.c:1239:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788460212.874066:0:18713:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788460212.874067:0:18713:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788460212.874068:0:18713:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:2.0:1788460212.874069:0:18713:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788460212.874071:0:18713:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788460212.874072:0:18713:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788460212.874073:0:18713:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788460212.874075:0:18713:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788460212.874078:0:18713:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1788460212.874081:0:18713:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788460212.874082:0:18713:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788460212.874084:0:18713:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788460212.874085:0:18713:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:2.0:1788460212.874086:0:18713:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788460212.874086:0:18713:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788460212.874087:0:18713:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788460212.874088:0:18713:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788460212.874089:0:18713:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788460212.874114:0:18713:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788460212.874133:0:18713:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac42f1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:18713:1875336022388480:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788460212.874196:0:18713:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460212.874241:0:18713:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc62d8840 going to sleep for 11 seconds 00000100:00100000:0.0:1788460212.875800:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022388480 00000100:00100000:0.0:1788460212.875812:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022388480 00000100:00100000:0.0:1788460212.875871:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788460212.875880:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac2b39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+24:18713:x1875336022388480:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788460212.875907:0:17204:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788460212.875921:0:17204:0:(mgs_nids.c:475:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788460212.881700:0:17204:0:(mgs_nids.c:842:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788460212.881722:0:17204:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788460212.882069:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac2b39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+24:18713:x1875336022388480:12345-0@lo:253:mount.lustre.0 Request processed in 6186us (7868us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460212.882081:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788460212.882213:0:18713:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac42f1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:18713:1875336022388480:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788460212.882227:0:18713:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788460212.882230:0:18713:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788460212.882232:0:18713:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788460212.882234:0:18713:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788460212.882235:0:18713:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:3.0:1788460212.882237:0:18713:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:3.0:1788460212.882238:0:18713:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:3.0:1788460212.882240:0:18713:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788460212.882242:0:18713:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788460212.882243:0:18713:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788460212.882256:0:18713:0:(tgt_mount.c:2880:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:2.0:1788460212.883204:0:17227:0:(mgs_nids.c:739:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788460212.883209:0:17227:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788460212.883230:0:17227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c4bfadc7c00/0x5dfa74784542c23a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460212.883253:0:17227:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4bfadc7a00/0x5dfa74784542c168 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542c161 expref: 23 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460212.883261:0:17227:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4bc2bd5400/0x5dfa74784542c176 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542c16f expref: 23 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460212.883267:0:17227:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4bc29d2c00/0x5dfa74784542c1ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542c1e6 expref: 23 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460212.883273:0:17227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c4bfadc7c00/0x5dfa74784542c23a lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460212.883321:0:17227:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4bc29d2c00/0x5dfa74784542c1ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5dfa74784542c1e6 expref: 23 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460212.883337:0:17227:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c4bc29d2c00/0x5dfa74784542c1ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5dfa74784542c1e6 expref: 23 pid: 17204 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460212.883359:0:17227:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac42f3480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17227:1875336022388608:0@lo:104: 00000100:00100000:2.0:1788460212.883537:0:17227:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788460212.883576:0:17227:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4bc2bd5400/0x5dfa74784542c176 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5dfa74784542c16f expref: 23 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460212.883585:0:17227:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c4bc2bd5400/0x5dfa74784542c176 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5dfa74784542c16f expref: 23 pid: 17206 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460212.883594:0:17227:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac42f0000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17227:1875336022388736:0@lo:104: 00000100:00100000:2.0:1788460212.883612:0:17227:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788460212.883634:0:17227:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4bfadc7a00/0x5dfa74784542c168 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5dfa74784542c161 expref: 23 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460212.883648:0:17227:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c4bfadc7a00/0x5dfa74784542c168 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5dfa74784542c161 expref: 23 pid: 17204 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460212.883656:0:17227:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac42f0380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17227:1875336022388864:0@lo:104: 00000100:00100000:2.0:1788460212.883679:0:17227:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460212.883688:0:17227:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc62d8c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788460212.883709:0:17196:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788460212.883723:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022388608 00000100:00100000:2.0:1788460212.883728:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022388608 00000100:00100000:2.0:1788460212.883755:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022388736 00000100:00100000:2.0:1788460212.883758:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022388736 00000100:00100000:2.0:1788460212.883766:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022388864 00000100:00100000:2.0:1788460212.883768:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022388864 00000100:00100000:2.0:1788460212.883780:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788460212.883788:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac42f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c482be18-c056-4068-8a37-ed5038fc364a+5:17227:x1875336022388608:12345-0@lo:104: 00010000:00010000:2.0:1788460212.883800:0:17196:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2800/0x5dfa74784542c1e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542c1ed expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460212.883841:0:17196:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788460212.883846:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac42f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c482be18-c056-4068-8a37-ed5038fc364a+5:17227:x1875336022388608:12345-0@lo:104: Request processed in 60us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460212.883853:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788460212.883868:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788460212.883874:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac42f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c482be18-c056-4068-8a37-ed5038fc364a+4:17227:x1875336022388736:12345-0@lo:104: 00010000:00010000:2.0:1788460212.883881:0:17196:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.206.105@tcp lock: ffff8c4bc2bd4000/0x5dfa74784542c16f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542c176 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460212.883930:0:17196:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788460212.883976:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac42f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c482be18-c056-4068-8a37-ed5038fc364a+4:17227:x1875336022388736:12345-0@lo:104: Request processed in 68us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460212.883983:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788460212.883997:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788460212.884002:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfc2e6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c482be18-c056-4068-8a37-ed5038fc364a+3:17227:x1875336022388864:12345-0@lo:104: 00010000:00010000:2.0:1788460212.884009:0:17196:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.206.105@tcp lock: ffff8c4bc2bd4a00/0x5dfa74784542c161 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542c168 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460212.884038:0:17196:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788460212.884042:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfc2e6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c482be18-c056-4068-8a37-ed5038fc364a+3:17227:x1875336022388864:12345-0@lo:104: Request processed in 41us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460212.884046:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1788460212.884073:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788460212.884079:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2800/0x5dfa74784542c1e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542c1ed expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460212.884086:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc29d2800 already unused, calling callback (ffffffffc125ae00) 10000000:00010000:2.0:1788460212.884089:0:17200:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2800/0x5dfa74784542c1e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5dfa74784542c1ed expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460212.884098:0:17200:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2800/0x5dfa74784542c1e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5dfa74784542c1ed expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788460212.884104:0:17200:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2800/0x5dfa74784542c1e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5dfa74784542c1ed expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788460212.884109:0:17200:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788460212.884134:0:17200:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2800/0x5dfa74784542c1e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542c1ed expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460212.884149:0:17200:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788460212.884168:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2800/0x5dfa74784542c1e6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542c1ed expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460212.884175:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2800/0x5dfa74784542c1e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542c1ed expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460212.884187:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788460212.884190:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: ffff8c4bc2bd4000/0x5dfa74784542c16f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542c176 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460212.884195:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc2bd4000 already unused, calling callback (ffffffffc125ae00) 10000000:00010000:2.0:1788460212.884198:0:17200:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: ffff8c4bc2bd4000/0x5dfa74784542c16f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5dfa74784542c176 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460212.884204:0:17200:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: ffff8c4bc2bd4000/0x5dfa74784542c16f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5dfa74784542c176 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788460212.884209:0:17200:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: ffff8c4bc2bd4000/0x5dfa74784542c16f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5dfa74784542c176 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788460212.884214:0:17200:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788460212.884227:0:17200:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.206.105@tcp lock: ffff8c4bc2bd4000/0x5dfa74784542c16f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542c176 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460212.884232:0:17200:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788460212.884238:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: ffff8c4bc2bd4000/0x5dfa74784542c16f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542c176 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460212.884243:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: ffff8c4bc2bd4000/0x5dfa74784542c16f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542c176 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460212.884257:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788460212.884260:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: ffff8c4bc2bd4a00/0x5dfa74784542c161 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542c168 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460212.884266:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc2bd4a00 already unused, calling callback (ffffffffc125ae00) 10000000:00010000:2.0:1788460212.884268:0:17200:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: ffff8c4bc2bd4a00/0x5dfa74784542c161 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5dfa74784542c168 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460212.884275:0:17200:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: ffff8c4bc2bd4a00/0x5dfa74784542c161 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5dfa74784542c168 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788460212.884280:0:17200:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: ffff8c4bc2bd4a00/0x5dfa74784542c161 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5dfa74784542c168 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788460212.884285:0:17200:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788460212.884915:0:18366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460212.885310:0:17200:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.206.105@tcp lock: ffff8c4bc2bd4a00/0x5dfa74784542c161 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542c168 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460212.885320:0:17200:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788460212.885345:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: ffff8c4bc2bd4a00/0x5dfa74784542c161 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542c168 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460212.885359:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: ffff8c4bc2bd4a00/0x5dfa74784542c161 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542c168 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460212.885564:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460212.885567:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460212.885569:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460212.885577:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788460212.885605:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac42f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c482be18-c056-4068-8a37-ed5038fc364a:3660:1875336022389120:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788460212.885656:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460212.885697:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788460212.885704:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac42f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c482be18-c056-4068-8a37-ed5038fc364a:3660:1875336022388992:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788460212.885727:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460212.885761:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022389120 00000100:00100000:2.0:1788460212.885767:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022389120 00010000:00010000:2.0:1788460212.885790:0:17197:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4bc2bd5400/0x5dfa74784542c176 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542c16f expref: 24 pid: 17206 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460212.885814:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022388992 00000100:00100000:2.0:1788460212.885817:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022388992 00010000:00010000:2.0:1788460212.885828:0:17197:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4bc29d2c00/0x5dfa74784542c1ed lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542c1e6 expref: 25 pid: 17204 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460212.885842:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788460212.885849:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac42f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c482be18-c056-4068-8a37-ed5038fc364a+25:3660:x1875336022389120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788460212.885860:0:17197:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460212.885866:0:17197:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4bc2bd5400/0x5dfa74784542c176 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542c16f expref: 25 pid: 17206 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460212.885876:0:17197:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4bc2bd5400/0x5dfa74784542c176 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5dfa74784542c16f expref: 25 pid: 17206 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460212.885900:0:17197:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788460212.885932:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac42f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c482be18-c056-4068-8a37-ed5038fc364a+25:3660:x1875336022389120:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460212.885938:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788460212.885993:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788460212.885999:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac1e64c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c482be18-c056-4068-8a37-ed5038fc364a+24:3660:x1875336022388992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788460212.886012:0:17197:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460212.886016:0:17197:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4bc29d2c00/0x5dfa74784542c1ed lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542c1e6 expref: 24 pid: 17204 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460212.886025:0:17197:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4bc29d2c00/0x5dfa74784542c1ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5dfa74784542c1e6 expref: 24 pid: 17204 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460212.886034:0:17197:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788460212.886056:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac1e64c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c482be18-c056-4068-8a37-ed5038fc364a+24:3660:x1875336022388992:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460212.886061:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788460212.886110:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac42f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c482be18-c056-4068-8a37-ed5038fc364a:3660:1875336022388992:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788460212.886118:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac42f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c482be18-c056-4068-8a37-ed5038fc364a:3660:1875336022389120:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788460212.886146:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4bc29d2c00/0x5dfa74784542c1ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5dfa74784542c1e6 expref: 23 pid: 17204 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460212.886157:0:17227:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac42f3480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17227:1875336022388608:0@lo:104: 00010000:00010000:2.0:1788460212.886168:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4bc2bd5400/0x5dfa74784542c176 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5dfa74784542c16f expref: 22 pid: 17206 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460212.886175:0:17227:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac42f0000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17227:1875336022388736:0@lo:104: 00000100:00100000:2.0:1788460212.886183:0:17227:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac42f0380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17227:1875336022388864:0@lo:104: 00010000:00010000:2.0:1788460212.886198:0:17227:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c4bfadc7c00/0x5dfa74784542c23a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460212.886292:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788460212.886302:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac42f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c482be18-c056-4068-8a37-ed5038fc364a:3662:1875336022389248:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788460212.886328:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460212.886375:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022389248 00000100:00100000:1.0:1788460212.886379:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022389248 00010000:00010000:1.0:1788460212.886393:0:17199:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4bfadc7a00/0x5dfa74784542c168 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542c161 expref: 22 pid: 17204 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460212.886411:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788460212.886416:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac1e60380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c482be18-c056-4068-8a37-ed5038fc364a+22:3662:x1875336022389248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788460212.886422:0:17199:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788460212.886425:0:17199:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4bfadc7a00/0x5dfa74784542c168 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542c161 expref: 22 pid: 17204 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460212.886433:0:17199:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4bfadc7a00/0x5dfa74784542c168 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5dfa74784542c161 expref: 22 pid: 17204 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460212.886442:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4bfadc7a00/0x5dfa74784542c168 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5dfa74784542c161 expref: 22 pid: 17204 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460212.886458:0:17199:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c4bfadc7c00/0x5dfa74784542c23a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460212.886465:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bfadc7c00/0x5dfa74784542c23a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788460212.886477:0:17199:0:(mgs_nids.c:715:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003268400s 00010000:00010000:1.0:1788460212.886483:0:17199:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c4bfadc7c00/0x5dfa74784542c23a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460212.886489:0:17199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c4bfadc7c00/0x5dfa74784542c23a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460212.886496:0:17199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c4bfadc7c00/0x5dfa74784542c23a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460212.886502:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c4bfadc7c00/0x5dfa74784542c23a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460212.886507:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bfadc7c00 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:1.0:1788460212.886510:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c4bfadc7c00/0x5dfa74784542c23a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460212.886517:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c4bfadc7c00/0x5dfa74784542c23a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460212.886531:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c4bfadc7c00/0x5dfa74784542c23a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460212.886539:0:17199:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788460212.886575:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac1e60380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c482be18-c056-4068-8a37-ed5038fc364a+21:3662:x1875336022389248:12345-0@lo:103:ldlm_bl.0 Request processed in 158us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460212.886582:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788460212.886607:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac42f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c482be18-c056-4068-8a37-ed5038fc364a:3662:1875336022389248:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788460212.886625:0:17227:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c4bfadc7c00/0x5dfa74784542c23a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460212.886632:0:17227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c4bfadc7c00/0x5dfa74784542c23a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460212.886637:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4bfadc7c00/0x5dfa74784542c23a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:1.0:1788460212.888087:0:18713:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1788460212.892092:0:18713:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1788460212.892103:0:18713:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1788460212.892143:0:18713:0:(tgt_mount.c:2600:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1788460212.892164:0:18713:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:1.0:1788460212.892999:0:18713:0:(tgt_mount.c:2486:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788460212.893204:0:18713:0:(tgt_mount.c:2501:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788460213.138457:0:18366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788460213.782540:0:18793:0:(tgt_mount.c:2486:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788460213.782785:0:18793:0:(tgt_mount.c:2501:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:2.0:1788460214.161065:0:17208:0:(mgc_request.c:715:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788460214.161072:0:17208:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-mdtir-ffff8c4c01993000 from 9 10000000:01000000:2.0:1788460214.161094:0:17208:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788460214.161138:0:17208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7800/0x5dfa74784542c241 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460214.161151:0:17208:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7800/0x5dfa74784542c241 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460214.161162:0:17208:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7800/0x5dfa74784542c241 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460214.161187:0:17208:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac42f0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022389376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788460214.161539:0:17208:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460214.162841:0:17208:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc62d8900 going to sleep for 11 seconds 00000100:00100000:0.0:1788460214.164671:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022389376 00000100:00100000:0.0:1788460214.164685:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022389376 00000100:00100000:0.0:1788460214.164748:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788460214.164758:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4c02042450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+21:17208:x1875336022389376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788460214.164774:0:17206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460214.164802:0:17206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4bc2bd4400/0x5dfa74784542c248 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542c241 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460214.164827:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bc2bd4400/0x5dfa74784542c248 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542c241 expref: 22 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460214.164837:0:17206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4bc2bd4400/0x5dfa74784542c248 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542c241 expref: 22 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460214.164845:0:17206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc2bd4400, rc 0) 00000100:00100000:0.0:1788460214.164919:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4c02042450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+22:17208:x1875336022389376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 163us (3382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460214.164926:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788460214.165158:0:17208:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac42f0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022389376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788460214.165175:0:17208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7800/0x5dfa74784542c241 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c248 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460214.165183:0:17208:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7800/0x5dfa74784542c241 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542c248 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460214.165246:0:17208:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac42f0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022389504:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788460214.165293:0:17208:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460214.165335:0:17208:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc62d8900 going to sleep for 11 seconds 00000100:00100000:0.0:1788460214.167803:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022389504 00000100:00100000:0.0:1788460214.167818:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022389504 00000100:00100000:0.0:1788460214.167892:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788460214.167903:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4c02041450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+22:17208:x1875336022389504:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788460214.167926:0:17204:0:(mgs_nids.c:1209:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788460214.167996:0:17204:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788460214.168000:0:17204:0:(mgs_nids.c:325:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:0.0:1788460214.168125:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4c02041450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+22:17208:x1875336022389504:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 224us (2831us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460214.168139:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788460214.168413:0:17208:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac42f0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022389504:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788460214.168457:0:17208:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788460214.168467:0:17208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7800/0x5dfa74784542c241 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c248 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460214.168488:0:17208:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7800/0x5dfa74784542c241 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c248 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788460214.168502:0:17208:0:(mgc_request.c:715:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788460214.168516:0:17208:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-mdtir-ffff8c4be0237800 from 9 10000000:01000000:2.0:1788460214.168519:0:17208:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788460214.168557:0:17208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7200/0x5dfa74784542c24f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460214.168565:0:17208:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7200/0x5dfa74784542c24f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460214.168573:0:17208:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7200/0x5dfa74784542c24f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460214.168592:0:17208:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac42f0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022389632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788460214.168627:0:17208:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460214.168664:0:17208:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc62d8900 going to sleep for 11 seconds 00000100:00100000:1.0:1788460214.168804:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022389632 00000100:00100000:1.0:1788460214.168810:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022389632 00000100:00100000:1.0:1788460214.168844:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788460214.168851:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4c02042850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+22:17208:x1875336022389632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788460214.168861:0:17205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460214.168872:0:17205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4ac3677a00/0x5dfa74784542c256 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542c24f expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460214.168891:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4ac3677a00/0x5dfa74784542c256 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542c24f expref: 23 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460214.168908:0:17205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4ac3677a00/0x5dfa74784542c256 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542c24f expref: 23 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460214.168917:0:17205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ac3677a00, rc 0) 00000100:00100000:1.0:1788460214.169003:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4c02042850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+23:17208:x1875336022389632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460214.169010:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788460214.170359:0:17208:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac42f0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022389632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788460214.170383:0:17208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7200/0x5dfa74784542c24f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c256 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460214.170393:0:17208:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7200/0x5dfa74784542c24f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542c256 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460214.170455:0:17208:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac42f0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022389760:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788460214.170517:0:17208:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460214.171394:0:17208:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc62d8900 going to sleep for 11 seconds 00000100:00100000:2.0:1788460214.171416:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022389760 00000100:00100000:2.0:1788460214.171422:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022389760 00000100:00100000:2.0:1788460214.171462:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788460214.171469:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfc2e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+23:17208:x1875336022389760:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788460214.171488:0:17206:0:(mgs_nids.c:1209:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788460214.172099:0:17206:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788460214.172104:0:17206:0:(mgs_nids.c:325:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00010000:00010000:3.0:1788460214.172348:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788460214.172981:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfc2e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+23:17208:x1875336022389760:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 1473us (2425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460214.172993:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788460214.173308:0:17208:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac42f0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022389760:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788460214.173379:0:17208:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788460214.173388:0:17208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7200/0x5dfa74784542c24f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c256 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460214.173398:0:17208:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7200/0x5dfa74784542c24f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c256 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788460214.173409:0:17208:0:(mgc_request.c:715:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788460214.173411:0:17208:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-mdtir-ffff8c4ac428f800 from 9 10000000:01000000:0.0:1788460214.173414:0:17208:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788460214.173444:0:17208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bc2bd5c00/0x5dfa74784542c25d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460214.173451:0:17208:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4bc2bd5c00/0x5dfa74784542c25d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460214.173459:0:17208:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4bc2bd5c00/0x5dfa74784542c25d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460214.173478:0:17208:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4395f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022389888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788460214.173523:0:17208:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460214.173683:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022389888 00000100:00100000:1.0:1788460214.173689:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022389888 00000100:00100000:1.0:1788460214.173733:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788460214.173741:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfc2e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+23:17208:x1875336022389888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788460214.173754:0:17205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460214.173767:0:17205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4ac3677800/0x5dfa74784542c264 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542c25d expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460214.173803:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4ac3677800/0x5dfa74784542c264 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542c25d expref: 24 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460214.173813:0:17205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4ac3677800/0x5dfa74784542c264 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542c25d expref: 24 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460214.173821:0:17205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ac3677800, rc 0) 00000100:00100000:1.0:1788460214.177451:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfc2e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+24:17208:x1875336022389888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 3702us (3918us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460214.177465:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788460214.183493:0:17208:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4be0329840 going to sleep for 11 seconds 00000100:00100000:0.0:1788460214.183900:0:17208:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4395f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022389888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788460214.183927:0:17208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4bc2bd5c00/0x5dfa74784542c25d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c264 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460214.183996:0:17208:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4bc2bd5c00/0x5dfa74784542c25d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542c264 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460214.184069:0:17208:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4395f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022390016:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788460214.184129:0:17208:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460214.184155:0:17208:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4be0329840 going to sleep for 11 seconds 00000100:00100000:2.0:1788460214.184275:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022390016 00000100:00100000:2.0:1788460214.184282:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022390016 00000100:00100000:2.0:1788460214.184340:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788460214.184349:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfc2e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+24:17208:x1875336022390016:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788460214.184366:0:17206:0:(mgs_nids.c:1209:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788460214.184381:0:17206:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788460214.184384:0:17206:0:(mgs_nids.c:325:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:2.0:1788460214.184469:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfc2e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+24:17208:x1875336022390016:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 121us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460214.184477:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788460214.186175:0:17208:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4395f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022390016:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788460214.186437:0:17208:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788460214.186447:0:17208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bc2bd5c00/0x5dfa74784542c25d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c264 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460214.186457:0:17208:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4bc2bd5c00/0x5dfa74784542c25d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c264 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460214.353339:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4395f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022390144:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788460214.353409:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460214.353521:0:17952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022390144 00000100:00100000:0.0:1788460214.353529:0:17952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022390144 00000100:00100000:0.0:1788460214.353576:0:17952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788460214.353585:0:17952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac1e63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022390144:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788460214.353616:0:17952:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788460214.353663:0:17952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac1e63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022390144:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460214.353669:0:17952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788460214.353712:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4395f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022390144:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788460214.355529:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac42f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022390272:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788460214.355585:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460214.355700:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022390272 00000100:00100000:3.0:1788460214.355708:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022390272 00000100:00100000:3.0:1788460214.355758:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788460214.355767:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac1e62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022390272:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788460214.355796:0:17216:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788460214.356232:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac1e62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022390272:12345-0@lo:41:osp-pre-1-0.0 Request processed in 465us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460214.356240:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788460214.356317:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac42f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022390272:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788460215.185768:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460216.211745:0:18366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460217.233260:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788460217.618395:0:17247:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:2.0:1788460217.939472:0:37:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788460217.939478:0:37:0:(pinger.c:254:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788460217.939480:0:37:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788460217.939483:0:37:0:(pinger.c:254:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788460217.939499:0:37:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788460217.939509:0:37:0:(pinger.c:254:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788460217.939511:0:37:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788460217.939513:0:37:0:(pinger.c:254:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788460217.939555:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac42f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c482be18-c056-4068-8a37-ed5038fc364a:3660:1875336022390400:0@lo:400:kworker.0 00000100:00100000:2.0:1788460217.939626:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460217.939663:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac42f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3660:1875336022390912:0@lo:400:kworker.0 00000100:00100000:2.0:1788460217.939689:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460217.939713:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788460217.939718:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac42f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022390784:0@lo:400:kworker.0 00000100:00100000:2.0:1788460217.939742:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460217.939847:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac42f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022390528:0@lo:400:kworker.0 00000100:00100000:2.0:1788460217.939872:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460217.939890:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac42f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3661:1875336022391040:0@lo:400:kworker.0 00000100:00100000:2.0:1788460217.939910:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460217.939934:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788460217.939973:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac42f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875336022390656:0@lo:400:kworker.0 00000100:00100000:2.0:1788460217.939995:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460217.940286:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022390400 00000100:00100000:1.0:1788460217.940295:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022390400 00000100:00100000:1.0:1788460217.940335:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788460217.940482:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac42f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1875336022391168:0@lo:400:kworker.0 00000100:00100000:2.0:1788460217.940511:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460217.940541:0:17952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022390784 00000100:00100000:2.0:1788460217.940545:0:17952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022390784 00000100:00100000:2.0:1788460217.940568:0:17952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022390528 00000100:00100000:2.0:1788460217.940570:0:17952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022390528 00000100:00100000:2.0:1788460217.940582:0:17952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788460217.940588:0:17952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3672680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022390784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460217.940647:0:17952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3672680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022390784:12345-0@lo:400:kworker.0 Request processed in 58us (903us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460217.940655:0:17952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788460217.940671:0:17952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788460217.940676:0:17952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3673b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1875336022390528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460217.940706:0:17952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3673b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1875336022390528:12345-0@lo:400:kworker.0 Request processed in 29us (833us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460217.940712:0:17952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788460217.940727:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022390912 00000100:00100000:2.0:1788460217.940730:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022390912 00000100:00100000:2.0:1788460217.940744:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022391040 00000100:00100000:2.0:1788460217.940746:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022391040 00000100:00100000:1.0:1788460217.940874:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfc2e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+24:3660:x1875336022390400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460217.940908:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfc2e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+24:3660:x1875336022390400:12345-0@lo:400:kworker.0 Request processed in 37us (1282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460217.940915:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788460217.940966:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022390656 00000100:00100000:1.0:1788460217.940970:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022390656 00000100:00100000:1.0:1788460217.940985:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022391168 00000100:00100000:1.0:1788460217.940987:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022391168 00000100:00100000:0.0:1788460217.941187:0:18741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788460217.941481:0:18741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac42f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1875336022390912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460217.941522:0:18741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac42f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1875336022390912:12345-0@lo:400:kworker.0 Request processed in 44us (1832us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460217.941622:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788460217.941630:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3670700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1875336022390656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460217.941661:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3670700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1875336022390656:12345-0@lo:400:kworker.0 Request processed in 33us (1665us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460217.941668:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788460217.941682:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788460217.941688:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3672300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1875336022391168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460217.941715:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3672300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1875336022391168:12345-0@lo:400:kworker.0 Request processed in 27us (1202us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460217.941721:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788460217.942540:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788460217.942550:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3670380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1875336022391040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460217.942595:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3670380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1875336022391040:12345-0@lo:400:kworker.0 Request processed in 47us (2683us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460217.942600:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1788460217.942657:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4ac42f3b80 x1875336022390656/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460233 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460217.942670:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac42f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875336022390656:0@lo:400:kworker.0 00010000:00080000:2.0:1788460217.942681:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4ac42f0380 x1875336022391168/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460233 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460217.942688:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac42f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1875336022391168:0@lo:400:kworker.0 00000100:00100000:2.0:1788460217.942699:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac42f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022390528:0@lo:400:kworker.0 00010000:00080000:2.0:1788460217.942708:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4ac42f0000 x1875336022391040/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460233 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460217.942723:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac42f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3661:1875336022391040:0@lo:400:kworker.0 00000100:00100000:2.0:1788460217.942759:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac42f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022390784:0@lo:400:kworker.0 00000100:00100000:2.0:1788460217.942768:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac42f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c482be18-c056-4068-8a37-ed5038fc364a:3660:1875336022390400:0@lo:400:kworker.0 00010000:00080000:2.0:1788460217.942778:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4ac42f2a00 x1875336022390912/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460233 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460217.942786:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac42f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3660:1875336022390912:0@lo:400:kworker.0 00000100:00080000:2.0:1788460217.943043:0:17207:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788460217.943047:0:17207:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788460217.943765:0:18741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1788460218.257430:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788460218.998243:0:19083:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788460219.282302:0:18366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460219.473182:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4395f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022391296:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788460219.473246:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460219.473533:0:17952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022391296 00000100:00100000:2.0:1788460219.473540:0:17952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022391296 00000100:00100000:2.0:1788460219.473594:0:17952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788460219.473604:0:17952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf75e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022391296:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788460219.473635:0:17952:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788460219.473690:0:17952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf75e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022391296:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460219.473698:0:17952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788460219.473767:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4395f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022391296:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788460219.473782:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788460219.473789:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4396680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022391424:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788460219.473814:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460219.474577:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022391424 00000100:00100000:0.0:1788460219.474586:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022391424 00000100:00100000:0.0:1788460219.474626:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788460219.474634:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf75e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022391424:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788460219.474657:0:17216:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788460219.474717:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf75e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022391424:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (902us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460219.474724:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788460219.474742:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4396680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022391424:0@lo:41:osp-pre-1-0.0 00000020:00000004:1.0:1788460219.996257:0:19135:0:(tgt_mount.c:2486:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788460219.996459:0:19135:0:(tgt_mount.c:2501:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788460220.305561:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788460220.918393:0:19185:0:(tgt_mount.c:2486:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788460220.919849:0:19185:0:(tgt_mount.c:2501:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788460221.329190:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788460221.522581:0:17965:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788460222.357648:0:18366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788460223.058196:0:37:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788460223.058203:0:37:0:(pinger.c:254:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788460223.058206:0:37:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788460223.058216:0:37:0:(pinger.c:254:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788460223.058245:0:37:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788460223.058248:0:37:0:(pinger.c:254:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788460223.058250:0:37:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788460223.058253:0:37:0:(pinger.c:254:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788460223.058410:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3672a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c482be18-c056-4068-8a37-ed5038fc364a:3661:1875336022391552:0@lo:400:kworker.0 00000100:00100000:2.0:1788460223.058481:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460223.058527:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3673480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875336022392064:0@lo:400:kworker.0 00000100:00100000:2.0:1788460223.058551:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460223.058576:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788460223.058582:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3671180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022391680:0@lo:400:kworker.0 00000100:00100000:2.0:1788460223.058606:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460223.058623:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3673100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3661:1875336022392192:0@lo:400:kworker.0 00000100:00100000:2.0:1788460223.058641:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460223.058667:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3670e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1875336022391808:0@lo:400:kworker.0 00000100:00100000:2.0:1788460223.058688:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460223.061882:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3671c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1875336022392320:0@lo:400:kworker.0 00000100:00100000:2.0:1788460223.061975:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460223.062508:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788460223.062517:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3670a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022391936:0@lo:400:kworker.0 00000100:00100000:2.0:1788460223.062549:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460223.062580:0:17952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022391680 00000100:00100000:2.0:1788460223.062587:0:17952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022391680 00000100:00100000:2.0:1788460223.062637:0:17952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022391936 00000100:00100000:2.0:1788460223.062641:0:17952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022391936 00000100:00100000:2.0:1788460223.062656:0:17952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788460223.062663:0:17952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3672d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1875336022391680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460223.062720:0:17952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3672d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1875336022391680:12345-0@lo:400:kworker.0 Request processed in 56us (4112us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460223.062727:0:17952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788460223.062744:0:17952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788460223.062750:0:17952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3671880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022391936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460223.062781:0:17952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3671880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022391936:12345-0@lo:400:kworker.0 Request processed in 31us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460223.062787:0:17952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788460223.063802:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022392064 00000100:00100000:1.0:1788460223.063811:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022392064 00000100:00100000:1.0:1788460223.063844:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022392192 00000100:00100000:1.0:1788460223.063847:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022392192 00000100:00100000:1.0:1788460223.063880:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022391808 00000100:00100000:1.0:1788460223.063884:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022391808 00000100:00100000:1.0:1788460223.063895:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022392320 00000100:00100000:1.0:1788460223.063897:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022392320 00000100:00100000:1.0:1788460223.063923:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788460223.063932:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3670000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1875336022392064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460223.064007:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3670000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1875336022392064:12345-0@lo:400:kworker.0 Request processed in 76us (5454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460223.064014:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788460223.064027:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788460223.064033:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3671500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1875336022392192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460223.064056:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3671500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1875336022392192:12345-0@lo:400:kworker.0 Request processed in 23us (5414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460223.064061:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788460223.064069:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788460223.064073:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3671f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1875336022391808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460223.064093:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3671f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1875336022391808:12345-0@lo:400:kworker.0 Request processed in 20us (5405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460223.064099:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788460223.064108:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788460223.064114:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3673800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1875336022392320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460223.064137:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3673800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1875336022392320:12345-0@lo:400:kworker.0 Request processed in 24us (2164us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460223.064152:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:0.0:1788460223.064258:0:17207:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788460223.064262:0:17207:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788460223.064465:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3671180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022391680:0@lo:400:kworker.0 00010000:00080000:2.0:1788460223.064481:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4ac3673100 x1875336022392192/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460223.064492:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3673100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3661:1875336022392192:0@lo:400:kworker.0 00010000:00080000:2.0:1788460223.064503:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4ac3673480 x1875336022392064/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460223.064512:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3673480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875336022392064:0@lo:400:kworker.0 00000100:00100000:2.0:1788460223.064548:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3670a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022391936:0@lo:400:kworker.0 00010000:00080000:2.0:1788460223.064559:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4ac3670e00 x1875336022391808/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460223.064568:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3670e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1875336022391808:0@lo:400:kworker.0 00010000:00080000:2.0:1788460223.064578:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4ac3671c00 x1875336022392320/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460223.064595:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3671c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1875336022392320:0@lo:400:kworker.0 00000100:00100000:3.0:1788460223.065002:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022391552 00000100:00100000:3.0:1788460223.065009:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022391552 00000100:00100000:3.0:1788460223.065044:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788460223.065051:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfc2e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+24:3661:x1875336022391552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460223.065104:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfc2e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+24:3661:x1875336022391552:12345-0@lo:400:kworker.0 Request processed in 54us (6623us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460223.065110:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788460223.065201:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3672a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c482be18-c056-4068-8a37-ed5038fc364a:3661:1875336022391552:0@lo:400:kworker.0 00000100:00100000:2.0:1788460223.121036:0:3658:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788460208/real 1788460208] req@ffff8c4ac42f0a80 x1875336022383360/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788460223 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460223.121067:0:3658:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c4ac42f0a80 x1875336022383360/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788460223 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460223.121077:0:3658:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788460208/real 1788460208] req@ffff8c4ac42f0700 x1875336022383488/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788460223 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460223.121088:0:3658:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c4ac42f0700 x1875336022383488/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788460223 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788460223.121106:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c4bef370800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788460223.121128:0:3658:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788460223.121133:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac42f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1875336022383360:0@lo:8:kworker.0 00000100:00080000:2.0:1788460223.121138:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c4ac1eca800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788460223.121144:0:3658:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788460223.121146:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac42f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1875336022383488:0@lo:8:kworker.0 00000100:00080000:3.0:1788460223.122153:0:37:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788460223.122161:0:37:0:(pinger.c:254:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788460223.122164:0:37:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788460223.122166:0:37:0:(pinger.c:254:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788460223.122170:0:37:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788460223.122173:0:37:0:(pinger.c:244:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788460223.122176:0:37:0:(import.c:65:import_set_state_nolock()) ffff8c4bef370800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788460223.122182:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 505 00000100:00080000:3.0:1788460223.122204:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788460223.122211:0:37:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8c4bef370800 using connection 192.168.206.105@tcp/0@lo 00000100:00100000:3.0:1788460223.122246:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4bf75e1c00 x1875336022392448/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788460223.122264:0:37:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788460223.122267:0:37:0:(pinger.c:244:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788460223.122269:0:37:0:(import.c:65:import_set_state_nolock()) ffff8c4ac1eca800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788460223.122272:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 505 00000100:00080000:3.0:1788460223.122275:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788460223.122278:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8c4ac1eca800 using connection 192.168.206.105@tcp/0@lo 00000100:00100000:3.0:1788460223.122290:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4bf75e1180 x1875336022392576/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788460223.122505:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1875336022392448:0@lo:8:kworker.0 00000100:00100000:2.0:1788460223.122567:0:3658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460223.122610:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1875336022392576:0@lo:8:kworker.0 00000100:00100000:2.0:1788460223.122632:0:3658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460223.122713:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022392448 00000100:00100000:3.0:1788460223.122721:0:18719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022392448 00000100:00100000:3.0:1788460223.122752:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022392576 00000100:00100000:3.0:1788460223.122755:0:18719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022392576 00000100:00100000:3.0:1788460223.122770:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788460223.122776:0:18719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3672a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3658:x1875336022392448:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788460223.122805:0:18719:0:(ldlm_lib.c:1461:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 520 last 0 00000020:00000080:3.0:1788460223.122835:0:18719:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5dfa74784542c26b 00002000:00100000:3.0:1788460223.122850:0:18719:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8c4ac484c000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a07 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1788460223.122854:0:18719:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:3.0:1788460223.122857:0:18719:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788460223.123049:0:18719:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1788460223.123072:0:18719:0:(import.c:65:import_set_state_nolock()) ffff8c4ac484c800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788460223.123127:0:18719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3672a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3658:x1875336022392448:12345-0@lo:8:kworker.0 Request processed in 349us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460223.123143:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788460223.123162:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788460223.123166:0:18719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3671c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3658:x1875336022392576:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788460223.123178:0:18719:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:2.0:1788460223.125222:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4bf75e1c00 x1875336022392448/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788460243 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460223.125243:0:3658:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788460223.125254:0:3658:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1788460223.125263:0:3658:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788460223.125269:0:3658:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788460223.125272:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c4bef370800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788460223.125329:0:3658:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788460223.125336:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1875336022392448:0@lo:8:kworker.0 00000004:00080000:0.0:1788460223.125421:0:17953:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788460223.125504:0:17953:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 520228559311ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788460223.125510:0:17953:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1788460223.133490:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022392704:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788460223.133556:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788460223.133612:0:17954:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1788460223.133636:0:17954:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e61500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17954:1875336022392832:0@lo:7:osp-pre-0-1.0 00000100:00100000:1.0:1788460223.133663:0:17954:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460223.133692:0:18717:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788460223.133698:0:18717:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1788460223.133778:0:17954:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc55360c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788460223.133808:0:18717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022392832 00000100:00100000:1.0:1788460223.133814:0:18717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022392832 00000100:00080000:1.0:1788460223.133865:0:17207:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788460223.133969:0:19273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788460223.133978:0:19273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac383b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17954:x1875336022392832:12345-0@lo:7:osp-pre-0-1.0 00000100:00100000:0.0:1788460223.134255:0:18721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022392704 00000100:00100000:0.0:1788460223.134260:0:18721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022392704 00000100:00100000:0.0:1788460223.134291:0:18721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788460223.134310:0:18721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac1e62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3660:x1875336022392704:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788460223.134326:0:18721:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788460223.134382:0:18721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac1e62d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3660:x1875336022392704:12345-0@lo:13:osp-pre-0-1.0 Request processed in 74us (826us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460223.134390:0:18721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788460223.134652:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4ac1e60000 x1875336022392704/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460239 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460223.134671:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022392704:0@lo:13:osp-pre-0-1.0 00000004:00080000:0.0:1788460223.136115:0:17944:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:1.0:1788460223.140720:0:19273:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1788460223.140730:0:19273:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:1.0:1788460223.140828:0:19273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac383b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17954:x1875336022392832:12345-0@lo:7:osp-pre-0-1.0 Request processed in 6848us (7160us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460223.140853:0:19273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788460223.144590:0:17954:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4ac1e61500 x1875336022392832/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788460239 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460223.144607:0:17954:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e61500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17954:1875336022392832:0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1788460223.144621:0:17954:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:0.0:1788460223.144659:0:17954:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4394700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17954:1875336022392960:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1788460223.144710:0:17954:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460223.144749:0:17954:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac28b4b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788460223.149480:0:18717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022392960 00000100:00100000:2.0:1788460223.149495:0:18717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022392960 00000100:00100000:2.0:1788460223.149557:0:18717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788460223.149568:0:18717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc4397100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17954:x1875336022392960:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1788460223.149597:0:18717:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:2.0:1788460223.149677:0:18717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc4397100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17954:x1875336022392960:12345-0@lo:5:osp-pre-0-1.0 Request processed in 111us (4966us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460223.149685:0:18717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788460223.149728:0:17954:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4bc4394700 x1875336022392960/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788460239 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460223.149743:0:17954:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4394700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17954:1875336022392960:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1788460223.149757:0:17954:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:2.0:1788460223.149795:0:17954:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3670e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17954:1875336022393088:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1788460223.149827:0:17954:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460223.149847:0:17954:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc66a7600 going to sleep for 11 seconds 00000100:00100000:1.0:1788460223.151992:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022393088 00000100:00100000:1.0:1788460223.152005:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022393088 00000100:00100000:1.0:1788460223.152053:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788460223.152063:0:18720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3670a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17954:x1875336022393088:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1788460223.152108:0:18720:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:3.0:1788460223.160475:0:18719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3671c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3658:x1875336022392576:12345-0@lo:8:kworker.0 Request processed in 37299us (37833us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788460223.160490:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1788460223.160801:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c4ac1eca800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788460223.160807:0:3658:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788460223.160812:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1875336022392576:0@lo:8:kworker.0 00000001:00080000:0.0:1788460223.184692:0:18714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:0.0:1788460223.184707:0:18714:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1788460223.185252:0:18720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3670a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:17954:x1875336022393088:12345-0@lo:5:osp-pre-0-1.0 Request processed in 33186us (35419us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788460223.185263:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788460223.185273:0:17954:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4ac3670e00 x1875336022393088/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788460239 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460223.185284:0:17954:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1788460223.185290:0:17954:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3670e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17954:1875336022393088:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1788460223.185306:0:17954:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:3.0:1788460223.185585:0:17954:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17954:1875336022393216:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1788460223.185826:0:17954:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460223.185856:0:17954:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac286c780 going to sleep for 11 seconds 00000100:00100000:1.0:1788460223.185966:0:17223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022393216 00000100:00100000:1.0:1788460223.185973:0:17223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022393216 00000100:00100000:1.0:1788460223.186009:0:17223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788460223.186016:0:17222:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 2 min 2 max 256 00000100:00100000:1.0:1788460223.186018:0:17223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf75e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17954:x1875336022393216:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1788460223.186023:0:17222:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0002' 00000100:00100000:1.0:1788460223.186065:0:17223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf75e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17954:x1875336022393216:12345-0@lo:900:osp-pre-0-1.0 Request processed in 48us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460223.186072:0:17223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788460223.186183:0:17954:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4bf75e1500 x1875336022393216/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788460239 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460223.186194:0:17954:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17954:1875336022393216:0@lo:900:osp-pre-0-1.0 00010000:00010000:1.0:1788460223.383322:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460224.403282:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788460224.596192:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3673480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022393344:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788460224.596260:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460224.596306:0:17952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022393344 00000100:00100000:2.0:1788460224.596311:0:17952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022393344 00000100:00100000:2.0:1788460224.596348:0:17952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788460224.596356:0:17952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3673100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1875336022393344:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788460224.596388:0:17952:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788460224.596424:0:17952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3673100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1875336022393344:12345-0@lo:41:osp-pre-1-0.0 Request processed in 68us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460224.596430:0:17952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788460224.596471:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3673480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022393344:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788460224.596600:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788460224.596608:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3839500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022393472:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788460224.596633:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460224.596702:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022393472 00000100:00100000:1.0:1788460224.596706:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022393472 00000100:00100000:1.0:1788460224.596735:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788460224.596741:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf75e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022393472:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788460224.596757:0:17216:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788460224.596793:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf75e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022393472:12345-0@lo:41:osp-pre-0-1.0 Request processed in 52us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460224.596799:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788460224.596855:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3839500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022393472:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788460225.425217:0:18366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460226.451062:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460227.479369:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788460227.699297:0:19532:0:(obd_mount.c:1011:lmd_print()) mount data: 00000020:01000004:0.0:1788460227.699302:0:19532:0:(obd_mount.c:1014:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:0.0:1788460227.699303:0:19532:0:(obd_mount.c:1017:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1788460227.699412:0:19532:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8c4ac389b000 00000020:01000004:0.0:1788460227.699428:0:19532:0:(tgt_mount.c:2642:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1788460227.699444:0:19532:0:(obd_mount.c:308:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788460227.699459:0:19532:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8c4c019a3310) 00000020:00000080:0.0:1788460227.699476:0:19532:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788460227.774289:0:19532:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788460227.776261:0:19532:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788460227.779818:0:19532:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1788460227.780115:0:19532:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1788460227.780357:0:19532:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1788460227.780580:0:19532:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788460227.780824:0:19532:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:01000000:3.0:1788460227.785221:0:19532:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788460227.785435:0:19532:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788460227.785449:0:19532:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788460227.785461:0:19532:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x5dfa74784542c279 00000020:01000004:3.0:1788460227.785468:0:19532:0:(tgt_mount.c:2727:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1788460227.785490:0:19532:0:(obd_mount.c:488:lustre_start_mgc()) mgc192.168.206.105@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788460227.785494:0:19532:0:(mgc_request.c:1379:mgc_set_info_async()) InitRecov mgc192.168.206.105@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788460227.785500:0:19532:0:(tgt_mount.c:1939:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788460227.785532:0:19532:0:(tgt_mount.c:1519:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.105@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1788460227.785535:0:19532:0:(tgt_mount.c:1239:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788460227.785537:0:19532:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788460227.785538:0:19532:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788460227.785539:0:19532:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:3.0:1788460227.785541:0:19532:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:3.0:1788460227.785542:0:19532:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:3.0:1788460227.785543:0:19532:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788460227.785545:0:19532:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788460227.785546:0:19532:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788460227.785549:0:19532:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1788460227.785551:0:19532:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788460227.785552:0:19532:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788460227.785554:0:19532:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788460227.785555:0:19532:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:3.0:1788460227.785556:0:19532:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:3.0:1788460227.785558:0:19532:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:3.0:1788460227.785558:0:19532:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788460227.785559:0:19532:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788460227.785566:0:19532:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788460227.785590:0:19532:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788460227.785609:0:19532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:19532:1875336022393600:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788460227.785675:0:19532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460227.785730:0:19532:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac286c840 going to sleep for 11 seconds 00000100:00100000:1.0:1788460227.787556:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022393600 00000100:00100000:1.0:1788460227.787569:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022393600 00000100:00100000:1.0:1788460227.787626:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788460227.787635:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfc2e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+24:19532:x1875336022393600:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788460227.787665:0:17206:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788460227.787668:0:17206:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1788460227.787672:0:17206:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788460227.788058:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfc2e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+24:19532:x1875336022393600:12345-0@lo:253:mount.lustre.0 Request processed in 422us (2380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460227.788066:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788460227.788306:0:19532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:19532:1875336022393600:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788460227.788319:0:19532:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788460227.788322:0:19532:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788460227.788324:0:19532:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788460227.788325:0:19532:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788460227.788326:0:19532:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:2.0:1788460227.788327:0:19532:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788460227.788329:0:19532:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788460227.788330:0:19532:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788460227.788332:0:19532:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788460227.788333:0:19532:0:(tgt_mount.c:1280:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788460227.788350:0:19532:0:(tgt_mount.c:115:server_register_mount()) register mount ffff8c4ac389b000 from lustre-OST0001 10000000:01000000:2.0:1788460227.788377:0:19532:0:(mgc_request.c:2423:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788460227.788380:0:19532:0:(mgc_request.c:424:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788460227.788387:0:19532:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8c4ac389b000 10000000:01000000:2.0:1788460227.788392:0:19532:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788460227.788421:0:19532:0:(mgc_request_server.c:106:mgc_fs_setup()) mgc192.168.206.105@tcp: setup lustre-OST0001-osd 00000040:01000000:2.0:1788460227.794289:0:19532:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.206.105@tcp ctxt 1 is initialized 00000040:01000000:3.0:1788460227.799791:0:19532:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.206.105@tcp ctxt 0 is initialized 10000000:01000000:3.0:1788460227.799823:0:19532:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-sptlrpc-ffff8c4ac389b000 from 1 10000000:01000000:3.0:1788460227.799827:0:19532:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788460227.799865:0:19532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2c00/0x5dfa74784542c280 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460227.799877:0:19532:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2c00/0x5dfa74784542c280 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460227.800001:0:19532:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2c00/0x5dfa74784542c280 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460227.800028:0:19532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:19532:1875336022393728:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788460227.800093:0:19532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460227.800128:0:19532:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac286c540 going to sleep for 11 seconds 00000100:00100000:1.0:1788460227.800194:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022393728 00000100:00100000:1.0:1788460227.800201:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022393728 00000100:00100000:1.0:1788460227.800254:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788460227.800263:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfc2e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+24:19532:x1875336022393728:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788460227.800275:0:17205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460227.800287:0:17205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4ac3676a00/0x5dfa74784542c287 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542c280 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460227.800308:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4ac3676a00/0x5dfa74784542c287 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542c280 expref: 25 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460227.800319:0:17205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4ac3676a00/0x5dfa74784542c287 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542c280 expref: 25 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460227.800326:0:17205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ac3676a00, rc 0) 00000100:00100000:1.0:1788460227.800413:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfc2e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+25:19532:x1875336022393728:12345-0@lo:101:mount.lustre.0 Request processed in 151us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460227.800420:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788460227.800623:0:19532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:19532:1875336022393728:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788460227.800638:0:19532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2c00/0x5dfa74784542c280 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c287 expref: -99 pid: 19532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460227.800647:0:19532:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2c00/0x5dfa74784542c280 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542c287 expref: -99 pid: 19532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460227.800716:0:19532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:19532:1875336022393856:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788460227.800743:0:19532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460227.800818:0:19532:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac286c540 going to sleep for 11 seconds 00000100:00100000:0.0:1788460227.800905:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022393856 00000100:00100000:0.0:1788460227.800910:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022393856 00000100:00100000:0.0:1788460227.801009:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788460227.801018:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfc2e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+25:19532:x1875336022393856:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788460227.801083:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfc2e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+25:19532:x1875336022393856:12345-0@lo:501:mount.lustre.0 Request processed in 66us (339us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788460227.801096:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788460227.801194:0:19532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:19532:1875336022393856:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788460227.801207:0:19532:0:(mgc_request_server.c:748:mgc_llog_local_copy()) mgc192.168.206.105@tcp: no remote llog for lustre-sptlrpc, check MGS config 00000100:00100000:3.0:1788460227.801237:0:19532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:19532:1875336022393984:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788460227.801261:0:19532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460227.801331:0:19532:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac286c540 going to sleep for 11 seconds 00000100:00100000:1.0:1788460227.801408:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022393984 00000100:00100000:1.0:1788460227.801412:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022393984 00000100:00100000:1.0:1788460227.801434:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788460227.801439:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfc2e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+25:19532:x1875336022393984:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788460227.801495:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfc2e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+25:19532:x1875336022393984:12345-0@lo:501:mount.lustre.0 Request processed in 55us (233us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788460227.801501:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788460227.801574:0:19532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:19532:1875336022393984:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788460227.801592:0:19532:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788460227.801611:0:19532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2c00/0x5dfa74784542c280 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c287 expref: -99 pid: 19532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460227.801620:0:19532:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2c00/0x5dfa74784542c280 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c287 expref: -99 pid: 19532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788460227.801632:0:19532:0:(mgc_request.c:206:do_config_log_add()) do adding config log params-ffff8c4ac389b000 10000000:01000000:3.0:1788460227.801637:0:19532:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788460227.801659:0:19532:0:(mgc_request_server.c:106:mgc_fs_setup()) mgc192.168.206.105@tcp: setup lustre-OST0001-osd 00000040:01000000:3.0:1788460227.801727:0:19532:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.206.105@tcp ctxt 1 is initialized 00000040:01000000:3.0:1788460227.801734:0:19532:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.206.105@tcp ctxt 0 is initialized 10000000:01000000:3.0:1788460227.801741:0:19532:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788460227.801745:0:19532:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788460227.801759:0:19532:0:(mgc_request_server.c:106:mgc_fs_setup()) mgc192.168.206.105@tcp: setup lustre-OST0001-osd 00000040:01000000:3.0:1788460227.801784:0:19532:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.206.105@tcp ctxt 1 is initialized 00000040:01000000:3.0:1788460227.801788:0:19532:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.206.105@tcp ctxt 0 is initialized 10000000:01000000:3.0:1788460227.801794:0:19532:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-mdtir-ffff8c4ac389b000 10000000:01000000:3.0:1788460227.801797:0:19532:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788460227.801840:0:19532:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788460227.801843:0:19532:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788460227.801868:0:19532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2800/0x5dfa74784542c28e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460227.801875:0:19532:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2800/0x5dfa74784542c28e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460227.801883:0:19532:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2800/0x5dfa74784542c28e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460227.801906:0:19532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:19532:1875336022394112:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788460227.801930:0:19532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460227.801962:0:19532:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc66a7c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788460227.802092:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022394112 00000100:00100000:1.0:1788460227.802097:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022394112 00000100:00100000:1.0:1788460227.802116:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788460227.802123:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfc2e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+25:19532:x1875336022394112:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788460227.802131:0:17205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460227.802140:0:17205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4ac3676200/0x5dfa74784542c295 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542c28e expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460227.802158:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4ac3676200/0x5dfa74784542c295 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542c28e expref: 26 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460227.802167:0:17205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4ac3676200/0x5dfa74784542c295 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542c28e expref: 26 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460227.802175:0:17205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ac3676200, rc 0) 00000100:00100000:1.0:1788460227.802212:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfc2e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+26:19532:x1875336022394112:12345-0@lo:101:mount.lustre.0 Request processed in 90us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460227.802218:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788460227.802288:0:19532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:19532:1875336022394112:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788460227.802298:0:19532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2800/0x5dfa74784542c28e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c295 expref: -99 pid: 19532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460227.802307:0:19532:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2800/0x5dfa74784542c28e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542c295 expref: -99 pid: 19532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788460227.803290:0:19532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:3.0:1788460227.803862:0:19532:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788460227.807428:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1788460227.807480:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 128 off8544 00000040:00080000:3.0:1788460227.807496:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 112 off8656 00000040:00080000:3.0:1788460227.807510:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8880 00000040:00080000:3.0:1788460227.807523:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9104 00000040:00080000:3.0:1788460227.807538:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 80 off9184 00000040:00080000:3.0:1788460227.807552:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9408 00000040:00080000:3.0:1788460227.807565:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9632 00000040:00080000:3.0:1788460227.807579:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 120 off9752 00000040:00080000:3.0:1788460227.807617:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off9976 00000040:00080000:3.0:1788460227.807623:0:19532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 11 00000100:00100000:3.0:1788460227.807722:0:19532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:19532:1875336022394240:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788460227.807786:0:19532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460227.807838:0:19532:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc60a6b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788460227.808022:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022394240 00000100:00100000:1.0:1788460227.808029:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022394240 00000100:00100000:1.0:1788460227.808074:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788460227.808083:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfc2e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+26:19532:x1875336022394240:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788460227.808223:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfc2e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+26:19532:x1875336022394240:12345-0@lo:501:mount.lustre.0 Request processed in 140us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460227.808231:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788460227.808746:0:19532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:19532:1875336022394240:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788460227.808785:0:19532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:19532:1875336022394368:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788460227.810696:0:19532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460227.810749:0:19532:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc60a6b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788460227.811074:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022394368 00000100:00100000:2.0:1788460227.811095:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022394368 00000100:00100000:2.0:1788460227.811151:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788460227.811160:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfc2e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+26:19532:x1875336022394368:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788460227.812281:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfc2e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+26:19532:x1875336022394368:12345-0@lo:503:mount.lustre.0 Request processed in 1119us (1588us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460227.812291:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788460227.812377:0:19532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:19532:1875336022394368:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788460227.812746:0:19532:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788460227.812822:0:19532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:19532:1875336022394496:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788460227.812865:0:19532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460227.812973:0:19532:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc60a6b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788460227.813278:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022394496 00000100:00100000:2.0:1788460227.813284:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022394496 00000100:00100000:2.0:1788460227.813363:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788460227.813372:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfc2e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+26:19532:x1875336022394496:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788460227.813735:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfc2e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+26:19532:x1875336022394496:12345-0@lo:502:mount.lustre.0 Request processed in 363us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460227.813742:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788460227.814042:0:19532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:19532:1875336022394496:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788460227.814214:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1788460227.814241:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 128 off8544 00000040:00080000:3.0:1788460227.814254:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 112 off8656 00000040:00080000:3.0:1788460227.814265:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8880 00000040:00080000:3.0:1788460227.814277:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9104 00000040:00080000:3.0:1788460227.814290:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 80 off9184 00000040:00080000:3.0:1788460227.814303:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9408 00000040:00080000:3.0:1788460227.814316:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9632 00000040:00080000:3.0:1788460227.814332:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 120 off9752 00000100:00100000:3.0:1788460227.814362:0:19532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:19532:1875336022394624:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788460227.814495:0:19532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460227.814563:0:19532:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc60a6b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788460227.814599:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022394624 00000100:00100000:2.0:1788460227.814604:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022394624 00000100:00100000:2.0:1788460227.814679:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788460227.814688:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfc2e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+26:19532:x1875336022394624:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788460227.814822:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfc2e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+26:19532:x1875336022394624:12345-0@lo:502:mount.lustre.0 Request processed in 135us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460227.814829:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788460227.814980:0:19532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:19532:1875336022394624:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788460227.815019:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off9976 00000040:00080000:3.0:1788460227.815026:0:19532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:1.0:1788460227.816234:0:19536:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788460227.816243:0:19536:0:(obd_mount.c:1049:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1788460227.816249:0:19536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788460227.816258:0:19536:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788460227.816264:0:19536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788460227.816278:0:19536:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8c4bcec54c98) 00000020:00000080:1.0:1788460227.816318:0:19536:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788460227.816327:0:19536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788460227.816403:0:19536:0:(tgt_mount.c:167:server_get_mount()) get mount ffff8c4ac389b000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788460227.816413:0:19536:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788460227.816420:0:19536:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x5dfa74784542c2a3 00010000:00010000:1.0:1788460227.820317:0:19536:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:1.0:1788460227.820691:0:19536:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:1.0:1788460227.821921:0:19536:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:1.0:1788460227.823256:0:19536:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788460227.823267:0:19536:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788460227.823273:0:19536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788460227.823275:0:19536:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788460227.823278:0:19536:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788460227.823282:0:19536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788460227.823283:0:19536:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788460227.823286:0:19536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788460227.823288:0:19536:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788460227.823290:0:19536:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788460227.823293:0:19536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788460227.823294:0:19536:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788460227.823297:0:19536:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788460227.823299:0:19536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788460227.823300:0:19536:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788460227.823303:0:19536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788460227.823328:0:19536:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788460227.823331:0:19536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788460227.823332:0:19536:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788460227.823335:0:19536:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 11 count 11 00000020:01000000:3.0:1788460227.823482:0:19532:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1788460227.823495:0:19532:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788460227.823514:0:19532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2800/0x5dfa74784542c28e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c295 expref: -99 pid: 19532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460227.823526:0:19532:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4bc29d2800/0x5dfa74784542c28e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c295 expref: -99 pid: 19532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788460227.823534:0:19532:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-mdtir-ffff8c4ac389b000 from 1 10000000:01000000:3.0:1788460227.823537:0:19532:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788460227.823570:0:19532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0200/0x5dfa74784542c2aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460227.823579:0:19532:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0200/0x5dfa74784542c2aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460227.823589:0:19532:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0200/0x5dfa74784542c2aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460227.823611:0:19532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:19532:1875336022394752:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788460227.823672:0:19532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460227.823714:0:19532:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc60a6840 going to sleep for 11 seconds 00000100:00100000:2.0:1788460227.823763:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022394752 00000100:00100000:2.0:1788460227.823771:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022394752 00000100:00100000:2.0:1788460227.823829:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788460227.823838:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfc2e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+26:19532:x1875336022394752:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788460227.823850:0:17206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460227.823861:0:17206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4bfadc7a00/0x5dfa74784542c2b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542c2aa expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460227.823905:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bfadc7a00/0x5dfa74784542c2b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542c2aa expref: 27 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460227.823915:0:17206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4bfadc7a00/0x5dfa74784542c2b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542c2aa expref: 27 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460227.823923:0:17206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bfadc7a00, rc 0) 00000100:00100000:2.0:1788460227.823988:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfc2e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+27:19532:x1875336022394752:12345-0@lo:101:mount.lustre.0 Request processed in 151us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460227.823995:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788460227.824137:0:19532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:19532:1875336022394752:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788460227.824151:0:19532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0200/0x5dfa74784542c2aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c2b1 expref: -99 pid: 19532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460227.824169:0:19532:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0200/0x5dfa74784542c2aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542c2b1 expref: -99 pid: 19532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460227.824682:0:19532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:19532:1875336022394880:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1788460227.824720:0:19532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460227.824755:0:19532:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc60a6840 going to sleep for 11 seconds 00000100:00100000:3.0:1788460227.824776:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022394880 00000100:00100000:3.0:1788460227.824781:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022394880 00000100:00100000:3.0:1788460227.824874:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788460227.824883:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfc2e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+27:19532:x1875336022394880:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788460227.824908:0:17204:0:(mgs_nids.c:1209:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788460227.824923:0:17204:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788460227.824927:0:17204:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788460227.824930:0:17204:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788460227.824932:0:17204:0:(mgs_nids.c:325:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 9 00000100:00100000:3.0:1788460227.825034:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfc2e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+27:19532:x1875336022394880:12345-0@lo:256:mount.lustre.0 Request processed in 152us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460227.825041:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788460227.825079:0:19532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:19532:1875336022394880:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1788460227.825650:0:19532:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788460227.825660:0:19532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0200/0x5dfa74784542c2aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c2b1 expref: -99 pid: 19532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460227.825670:0:19532:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0200/0x5dfa74784542c2aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c2b1 expref: -99 pid: 19532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788460227.825689:0:19532:0:(mgc_request.c:2266:mgc_process_log()) Process log params-ffff8c4ac389b000 from 1 10000000:01000000:3.0:1788460227.825692:0:19532:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788460227.825716:0:19532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0400/0x5dfa74784542c2b8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460227.825724:0:19532:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0400/0x5dfa74784542c2b8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460227.825733:0:19532:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0400/0x5dfa74784542c2b8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460227.825748:0:19532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:19532:1875336022395008:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788460227.825780:0:19532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460227.826011:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022395008 00000100:00100000:2.0:1788460227.826017:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022395008 00000100:00100000:2.0:1788460227.826045:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788460227.826052:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4040450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+27:19532:x1875336022395008:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788460227.826062:0:17206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460227.826072:0:17206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4bfadc7c00/0x5dfa74784542c2bf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542c2b8 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460227.826091:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bfadc7c00/0x5dfa74784542c2bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542c2b8 expref: 28 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460227.826101:0:17206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4bfadc7c00/0x5dfa74784542c2bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542c2b8 expref: 28 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460227.826109:0:17206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bfadc7c00, rc 0) 00000100:00100000:2.0:1788460227.826139:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4040450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+28:19532:x1875336022395008:12345-0@lo:101:mount.lustre.0 Request processed in 88us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460227.826145:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788460227.826216:0:19532:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc60a6840 going to sleep for 11 seconds 00000100:00100000:3.0:1788460227.826233:0:19532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:19532:1875336022395008:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788460227.826243:0:19532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0400/0x5dfa74784542c2b8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c2bf expref: -99 pid: 19532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460227.826252:0:19532:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0400/0x5dfa74784542c2b8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542c2bf expref: -99 pid: 19532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788460227.828915:0:19532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000040:00080000:3.0:1788460227.830216:0:19532:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788460227.830396:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:3.0:1788460227.830441:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 112 off8528 00000040:00080000:3.0:1788460227.830552:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 224 off8752 00000040:00080000:3.0:1788460227.830567:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8976 00000040:00080000:3.0:1788460227.830579:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 112 off9088 00000040:00080000:3.0:1788460227.830603:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 224 off9312 00000040:00080000:3.0:1788460227.830618:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 224 off9536 00000040:00080000:3.0:1788460227.830628:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 128 off9664 00000040:00080000:3.0:1788460227.830639:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:3.0:1788460227.830650:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 224 off10112 00000040:00080000:3.0:1788460227.830661:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 128 off10240 00000040:00080000:3.0:1788460227.830677:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10464 00000040:00080000:3.0:1788460227.830682:0:19532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 12 count 13 00000100:00100000:3.0:1788460227.830756:0:19532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:19532:1875336022395136:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788460227.831424:0:19532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460227.831471:0:19532:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc60a6cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788460227.831926:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022395136 00000100:00100000:2.0:1788460227.831934:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022395136 00000100:00100000:2.0:1788460227.832007:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788460227.832016:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4040050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+28:19532:x1875336022395136:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788460227.832133:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4040050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+28:19532:x1875336022395136:12345-0@lo:501:mount.lustre.0 Request processed in 118us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460227.832139:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788460227.832272:0:19532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:19532:1875336022395136:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788460227.832311:0:19532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4394700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:19532:1875336022395264:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788460227.832347:0:19532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460227.832377:0:19532:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bedf3a180 going to sleep for 11 seconds 00000100:00100000:3.0:1788460227.832417:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022395264 00000100:00100000:3.0:1788460227.832422:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022395264 00000100:00100000:3.0:1788460227.832455:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788460227.832462:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4043050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+28:19532:x1875336022395264:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788460227.832530:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4043050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+28:19532:x1875336022395264:12345-0@lo:503:mount.lustre.0 Request processed in 69us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460227.832537:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788460227.832637:0:19532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4394700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:19532:1875336022395264:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788460227.833242:0:19532:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788460227.833311:0:19532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4394700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:19532:1875336022395392:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788460227.833347:0:19532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460227.833440:0:19532:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bedf3a180 going to sleep for 11 seconds 00000100:00100000:3.0:1788460227.833642:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022395392 00000100:00100000:3.0:1788460227.833648:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022395392 00000100:00100000:3.0:1788460227.833683:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788460227.833691:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4043450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+28:19532:x1875336022395392:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788460227.833785:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4043450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+28:19532:x1875336022395392:12345-0@lo:502:mount.lustre.0 Request processed in 94us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460227.833792:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788460227.833968:0:19532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4394700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:19532:1875336022395392:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788460227.834152:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:0.0:1788460227.834179:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 112 off8528 00000040:00080000:0.0:1788460227.834193:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 224 off8752 00000040:00080000:0.0:1788460227.834206:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8976 00000040:00080000:0.0:1788460227.834218:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 112 off9088 00000040:00080000:0.0:1788460227.834231:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 224 off9312 00000040:00080000:0.0:1788460227.834244:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 224 off9536 00000040:00080000:0.0:1788460227.834256:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 128 off9664 00000040:00080000:0.0:1788460227.834269:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:0.0:1788460227.834280:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 224 off10112 00000040:00080000:0.0:1788460227.834304:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 128 off10240 00000100:00100000:0.0:1788460227.834328:0:19532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4394700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:19532:1875336022395520:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788460227.834365:0:19532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460227.834394:0:19532:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bedf3a180 going to sleep for 11 seconds 00000100:00100000:2.0:1788460227.834450:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022395520 00000100:00100000:2.0:1788460227.834455:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022395520 00000100:00100000:2.0:1788460227.834493:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788460227.834501:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4041850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+28:19532:x1875336022395520:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788460227.834580:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4041850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+28:19532:x1875336022395520:12345-0@lo:502:mount.lustre.0 Request processed in 80us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460227.834587:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788460227.834670:0:19532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4394700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:19532:1875336022395520:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788460227.834714:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10464 00000040:00080000:0.0:1788460227.834722:0:19532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1788460227.835442:0:19540:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788460227.835451:0:19540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788460227.835453:0:19540:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788460227.835460:0:19540:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c4ac389b000 00000020:00000080:0.0:1788460227.835463:0:19540:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788460227.835470:0:19540:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788460227.835472:0:19540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788460227.835474:0:19540:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788460227.835476:0:19540:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788460227.835478:0:19540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788460227.835480:0:19540:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788460227.835483:0:19540:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8c4ac389b000 00000020:00000080:0.0:1788460227.835485:0:19540:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788460227.835546:0:19540:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788460227.835550:0:19540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788460227.835552:0:19540:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788460227.835554:0:19540:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788460227.835557:0:19540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788460227.835559:0:19540:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788460227.835562:0:19540:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8c4ac389b000 00000020:00000080:0.0:1788460227.835564:0:19540:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788460227.835581:0:19540:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788460227.835584:0:19540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788460227.835586:0:19540:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788460227.835588:0:19540:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788460227.835591:0:19540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788460227.835592:0:19540:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788460227.835596:0:19540:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8c4ac389b000 00000020:00000080:0.0:1788460227.835598:0:19540:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788460227.835617:0:19540:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788460227.835627:0:19540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788460227.835628:0:19540:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788460227.835632:0:19540:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 13 count 13 00000020:01000000:3.0:1788460227.838727:0:19532:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788460227.838746:0:19532:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788460227.838770:0:19532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0400/0x5dfa74784542c2b8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c2bf expref: -99 pid: 19532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460227.838791:0:19532:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0400/0x5dfa74784542c2b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c2bf expref: -99 pid: 19532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788460227.838873:0:19532:0:(mgc_request.c:2423:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788460227.838877:0:19532:0:(mgc_request.c:424:config_log_add()) add config log lustre-client-ffff8c4ac389b000 10000000:01000000:3.0:1788460227.838880:0:19532:0:(mgc_request.c:206:do_config_log_add()) do adding config log lustre-client-ffff8c4ac389b000 10000000:01000000:3.0:1788460227.838896:0:19532:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788460227.838916:0:19532:0:(mgc_request_server.c:106:mgc_fs_setup()) mgc192.168.206.105@tcp: setup lustre-OST0001-osd 00000040:01000000:3.0:1788460227.839005:0:19532:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.206.105@tcp ctxt 1 is initialized 00000040:01000000:3.0:1788460227.839012:0:19532:0:(llog_obd.c:197:llog_setup()) obd mgc192.168.206.105@tcp ctxt 0 is initialized 10000000:01000000:3.0:1788460227.839025:0:19532:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-client-ffff8c4ac389b000 from 1 10000000:01000000:3.0:1788460227.839029:0:19532:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788460227.839062:0:19532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f1000/0x5dfa74784542c2c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460227.839070:0:19532:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f1000/0x5dfa74784542c2c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460227.839082:0:19532:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f1000/0x5dfa74784542c2c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460227.839104:0:19532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:19532:1875336022395648:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788460227.839166:0:19532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460227.839206:0:19532:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc60a6180 going to sleep for 11 seconds 00000100:00100000:2.0:1788460227.849080:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022395648 00000100:00100000:2.0:1788460227.849092:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022395648 00000100:00100000:2.0:1788460227.849140:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788460227.849150:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4040850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+28:19532:x1875336022395648:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788460227.849164:0:17206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460227.849180:0:17206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4bfadc7600/0x5dfa74784542c2cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542c2c6 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460227.849205:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bfadc7600/0x5dfa74784542c2cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542c2c6 expref: 29 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460227.849216:0:17206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4bfadc7600/0x5dfa74784542c2cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542c2c6 expref: 29 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460227.849236:0:17206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bfadc7600, rc 0) 00000100:00100000:2.0:1788460227.849308:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4040850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+29:19532:x1875336022395648:12345-0@lo:101:mount.lustre.0 Request processed in 159us (10141us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460227.849315:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788460227.849371:0:19532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:19532:1875336022395648:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788460227.849387:0:19532:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f1000/0x5dfa74784542c2c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c2cd expref: -99 pid: 19532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460227.849397:0:19532:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f1000/0x5dfa74784542c2c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542c2cd expref: -99 pid: 19532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788460227.853357:0:19532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 52 count 51 00000040:00080000:2.0:1788460227.853641:0:19532:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788460227.856861:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].1, 224 off8416 00000040:00080000:2.0:1788460227.856927:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].2, 120 off8536 00000040:00080000:2.0:1788460227.856961:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].3, 168 off8704 00000040:00080000:2.0:1788460227.856979:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].4, 224 off8928 00000040:00080000:2.0:1788460227.856992:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].5, 224 off9152 00000040:00080000:2.0:1788460227.857005:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].6, 120 off9272 00000040:00080000:2.0:1788460227.857017:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].7, 168 off9440 00000040:00080000:2.0:1788460227.857030:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].8, 224 off9664 00000040:00080000:2.0:1788460227.857062:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].9, 224 off9888 00000040:00080000:2.0:1788460227.857076:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].10, 120 off10008 00000040:00080000:2.0:1788460227.857089:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].11, 224 off10232 00000040:00080000:2.0:1788460227.857103:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].12, 224 off10456 00000040:00080000:2.0:1788460227.857116:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].13, 88 off10544 00000040:00080000:2.0:1788460227.857128:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].14, 128 off10672 00000040:00080000:2.0:1788460227.857140:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].15, 144 off10816 00000040:00080000:2.0:1788460227.857164:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].16, 160 off10976 00000040:00080000:2.0:1788460227.857179:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].17, 224 off11200 00000040:00080000:2.0:1788460227.857190:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].18, 224 off11424 00000040:00080000:2.0:1788460227.857201:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].19, 80 off11504 00000040:00080000:2.0:1788460227.857215:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].20, 224 off11728 00000040:00080000:2.0:1788460227.857227:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].21, 224 off11952 00000040:00080000:2.0:1788460227.857237:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].22, 88 off12040 00000040:00080000:2.0:1788460227.857249:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].23, 128 off12168 00000040:00080000:2.0:1788460227.857262:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].24, 144 off12312 00000040:00080000:2.0:1788460227.857292:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].25, 160 off12472 00000040:00080000:2.0:1788460227.857306:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].26, 224 off12696 00000040:00080000:2.0:1788460227.857319:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].27, 224 off12920 00000040:00080000:2.0:1788460227.857331:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].28, 80 off13000 00000040:00080000:2.0:1788460227.857344:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].29, 224 off13224 00000040:00080000:2.0:1788460227.857356:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].30, 224 off13448 00000040:00080000:2.0:1788460227.857370:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].31, 88 off13536 00000040:00080000:2.0:1788460227.857383:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].32, 128 off13664 00000040:00080000:2.0:1788460227.857395:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].33, 144 off13808 00000040:00080000:2.0:1788460227.857409:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].34, 128 off13936 00000040:00080000:2.0:1788460227.857423:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].35, 224 off14160 00000040:00080000:2.0:1788460227.857435:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].36, 224 off14384 00000040:00080000:2.0:1788460227.857445:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].37, 80 off14464 00000040:00080000:2.0:1788460227.857458:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].38, 224 off14688 00000040:00080000:2.0:1788460227.857472:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].39, 224 off14912 00000040:00080000:2.0:1788460227.857483:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].40, 88 off15000 00000040:00080000:2.0:1788460227.857510:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].41, 128 off15128 00000040:00080000:2.0:1788460227.857526:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].42, 144 off15272 00000040:00080000:2.0:1788460227.857540:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].43, 128 off15400 00000040:00080000:2.0:1788460227.857553:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].44, 224 off15624 00000040:00080000:2.0:1788460227.857567:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].45, 224 off15848 00000040:00080000:2.0:1788460227.857582:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].46, 80 off15928 00000040:00080000:2.0:1788460227.857596:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].47, 224 off16152 00000040:00080000:2.0:1788460227.857608:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].48, 232 off16384 00000040:00080000:2.0:1788460227.857760:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].49, 224 off16608 00000040:00080000:2.0:1788460227.857781:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].50, 120 off16728 00000040:00080000:2.0:1788460227.857802:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x13:0x0].51, 224 off16952 00000040:00080000:2.0:1788460227.857807:0:19532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 51 count 51 00000100:00100000:2.0:1788460227.857914:0:19532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3673480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:19532:1875336022395776:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788460227.858002:0:19532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460227.858046:0:19532:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bd46c13c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788460227.861401:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022395776 00000100:00100000:2.0:1788460227.861416:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022395776 00000100:00100000:2.0:1788460227.861468:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788460227.861478:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4040c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+29:19532:x1875336022395776:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788460227.861630:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4040c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+29:19532:x1875336022395776:12345-0@lo:501:mount.lustre.0 Request processed in 154us (3628us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460227.861638:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788460227.861699:0:19532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3673480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:19532:1875336022395776:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788460227.861761:0:19532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3673480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:19532:1875336022395904:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788460227.862059:0:19532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460227.862120:0:19532:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bd46c13c0 going to sleep for 11 seconds 00000040:00080000:3.0:1788460227.864469:0:17247:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788460227.867563:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022395904 00000100:00100000:1.0:1788460227.867577:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022395904 00000100:00100000:1.0:1788460227.867631:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788460227.867648:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4043c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+29:19532:x1875336022395904:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788460227.867828:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4043c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+29:19532:x1875336022395904:12345-0@lo:503:mount.lustre.0 Request processed in 169us (6009us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460227.867837:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788460227.868323:0:19532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3673480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:19532:1875336022395904:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788460227.868741:0:19532:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788460227.868882:0:19532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3673480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:19532:1875336022396032:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788460227.868939:0:19532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460227.869109:0:19532:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac36aae40 going to sleep for 11 seconds 00000100:00100000:3.0:1788460227.869226:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022396032 00000100:00100000:3.0:1788460227.869232:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022396032 00000100:00100000:3.0:1788460227.869260:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788460227.869267:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4042850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+29:19532:x1875336022396032:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788460227.869372:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4042850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+29:19532:x1875336022396032:12345-0@lo:502:mount.lustre.0 Request processed in 104us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460227.869379:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788460227.869486:0:19532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3673480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:19532:1875336022396032:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788460227.869652:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].1, 224 off8416 00000040:00080000:2.0:1788460227.869695:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].2, 120 off8536 00000040:00080000:2.0:1788460227.869713:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].3, 168 off8704 00000040:00080000:2.0:1788460227.869727:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].4, 224 off8928 00000040:00080000:2.0:1788460227.869742:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].5, 224 off9152 00000040:00080000:2.0:1788460227.869756:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].6, 120 off9272 00000040:00080000:2.0:1788460227.869771:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].7, 168 off9440 00000040:00080000:2.0:1788460227.869785:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].8, 224 off9664 00000040:00080000:2.0:1788460227.869799:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].9, 224 off9888 00000040:00080000:2.0:1788460227.869903:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].10, 120 off10008 00000040:00080000:2.0:1788460227.869922:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].11, 224 off10232 00000040:00080000:2.0:1788460227.869937:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].12, 224 off10456 00000040:00080000:2.0:1788460227.870023:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].13, 88 off10544 00000040:00080000:2.0:1788460227.870039:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].14, 128 off10672 00000040:00080000:2.0:1788460227.870054:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].15, 144 off10816 00000040:00080000:2.0:1788460227.870068:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].16, 160 off10976 00000040:00080000:2.0:1788460227.870082:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].17, 224 off11200 00000040:00080000:2.0:1788460227.870109:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].18, 224 off11424 00000040:00080000:2.0:1788460227.870126:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].19, 80 off11504 00000040:00080000:2.0:1788460227.870140:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].20, 224 off11728 00000040:00080000:2.0:1788460227.870155:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].21, 224 off11952 00000040:00080000:2.0:1788460227.870169:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].22, 88 off12040 00000040:00080000:2.0:1788460227.870184:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].23, 128 off12168 00000040:00080000:2.0:1788460227.870199:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].24, 144 off12312 00000040:00080000:2.0:1788460227.870212:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].25, 160 off12472 00000040:00080000:2.0:1788460227.870227:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].26, 224 off12696 00000040:00080000:2.0:1788460227.870241:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].27, 224 off12920 00000040:00080000:2.0:1788460227.870255:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].28, 80 off13000 00000040:00080000:2.0:1788460227.870268:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].29, 224 off13224 00000040:00080000:2.0:1788460227.870282:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].30, 224 off13448 00000040:00080000:2.0:1788460227.870296:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].31, 88 off13536 00000040:00080000:2.0:1788460227.870310:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].32, 128 off13664 00000040:00080000:2.0:1788460227.870324:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].33, 144 off13808 00000040:00080000:2.0:1788460227.870351:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].34, 128 off13936 00000040:00080000:2.0:1788460227.870377:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].35, 224 off14160 00000040:00080000:2.0:1788460227.870391:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].36, 224 off14384 00000040:00080000:2.0:1788460227.870404:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].37, 80 off14464 00000040:00080000:2.0:1788460227.870418:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].38, 224 off14688 00000040:00080000:2.0:1788460227.870431:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].39, 224 off14912 00000040:00080000:2.0:1788460227.870445:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].40, 88 off15000 00000040:00080000:2.0:1788460227.870457:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].41, 128 off15128 00000040:00080000:2.0:1788460227.870470:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].42, 144 off15272 00000040:00080000:2.0:1788460227.870482:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].43, 128 off15400 00000040:00080000:2.0:1788460227.870497:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].44, 224 off15624 00000040:00080000:2.0:1788460227.870510:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].45, 224 off15848 00000040:00080000:2.0:1788460227.870524:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].46, 80 off15928 00000040:00080000:2.0:1788460227.870538:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].47, 224 off16152 00000040:00080000:2.0:1788460227.870553:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].48, 232 off16384 00000100:00100000:2.0:1788460227.870605:0:19532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3673480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:19532:1875336022396160:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788460227.870658:0:19532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460227.870683:0:19532:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac36aae40 going to sleep for 11 seconds 00000100:00100000:3.0:1788460227.870772:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022396160 00000100:00100000:3.0:1788460227.870777:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022396160 00000100:00100000:3.0:1788460227.870933:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788460227.870971:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4042050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+29:19532:x1875336022396160:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788460227.871069:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4042050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+29:19532:x1875336022396160:12345-0@lo:502:mount.lustre.0 Request processed in 128us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460227.871078:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788460227.871235:0:19532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3673480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:19532:1875336022396160:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788460227.871401:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].49, 224 off16608 00000040:00080000:2.0:1788460227.871423:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].50, 120 off16728 00000100:00100000:2.0:1788460227.871445:0:19532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3673480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:19532:1875336022396288:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788460227.871482:0:19532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460227.871553:0:19532:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac36aae40 going to sleep for 11 seconds 00000100:00100000:1.0:1788460227.874155:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022396288 00000100:00100000:1.0:1788460227.874170:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022396288 00000100:00100000:0.0:1788460227.874498:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788460227.874509:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4041050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+29:19532:x1875336022396288:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788460227.874672:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4041050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+29:19532:x1875336022396288:12345-0@lo:502:mount.lustre.0 Request processed in 164us (3188us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460227.874680:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788460227.874990:0:19532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3673480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:19532:1875336022396288:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788460227.875067:0:19532:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x14:0x0].51, 224 off16952 00000040:00080000:2.0:1788460227.875080:0:19532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1788460227.875869:0:19545:0:(obd_mount.c:308:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788460227.875895:0:19545:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8c4ac4889988) 00000020:00000080:3.0:1788460227.875920:0:19545:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:3.0:1788460227.876045:0:19545:0:(tgt_mount.c:167:server_get_mount()) get mount ffff8c4ac389b000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788460227.876049:0:19545:0:(tgt_mount.c:201:server_put_mount()) put mount ffff8c4ac389b000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788460227.876052:0:19545:0:(obd_mount.c:798:lustre_put_lsi()) put ffff8c4ac389b000 3 00010000:00080000:3.0:1788460227.876083:0:19545:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c4ac4221800@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.105@tcp at head 00010000:00010000:3.0:1788460227.877710:0:19545:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:3.0:1788460227.878116:0:19545:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788460227.878156:0:19545:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788460227.878171:0:19545:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x5dfa74784542c2db 00000100:00080000:3.0:1788460227.878182:0:19545:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788460227.878189:0:19545:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8c4ac4221800 using connection 192.168.206.105@tcp/0@lo 00000100:00100000:3.0:1788460227.878226:0:19545:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4bf75e3b80 x1875336022396416/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788460227.878273:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1875336022396416:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788460227.878343:0:3658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460227.878404:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022396416 00000100:00100000:3.0:1788460227.878411:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022396416 00000100:00100000:3.0:1788460227.878441:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788460227.878448:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf75e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3658:x1875336022396416:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788460227.878471:0:17213:0:(ldlm_lib.c:1461:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 524 last 0 00000020:00000080:3.0:1788460227.878508:0:17213:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x5dfa74784542c2e2 00000004:00100000:3.0:1788460227.878522:0:17213:0:(mdt_handler.c:7310:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788460227.878550:0:17213:0:(import.c:65:import_set_state_nolock()) ffff8c4ac4227800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788460227.878596:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf75e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3658:x1875336022396416:12345-0@lo:38:llog_process_th.0 Request processed in 147us (253us total) trans 0 rc 0/0 00000100:00080000:2.0:1788460227.882937:0:19545:0:(pinger.c:380:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788460227.883077:0:16617:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788460227.883083:0:16617:0:(pinger.c:254:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788460227.883085:0:16617:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788460227.883088:0:16617:0:(pinger.c:254:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788460227.883121:0:16617:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788460227.883124:0:16617:0:(pinger.c:244:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788460227.883127:0:16617:0:(import.c:65:import_set_state_nolock()) ffff8c4ac1eca800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788460227.883134:0:16617:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 520 00000100:00080000:0.0:1788460227.883140:0:16617:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788460227.883146:0:16617:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8c4ac1eca800 using connection 192.168.206.105@tcp/0@lo 00000100:00100000:0.0:1788460227.883165:0:16617:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4bc4396d80 x1875336022397056/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788460227.883209:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4396680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3660:1875336022396672:0@lo:400:kworker.0 00000100:00100000:0.0:1788460227.883270:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460227.883299:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4394000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3660:1875336022397312:0@lo:400:kworker.0 00000100:00100000:0.0:1788460227.883319:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460227.883351:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788460227.883357:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4394700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022396544:0@lo:400:kworker.0 00000100:00100000:0.0:1788460227.883380:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460227.883398:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4397800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3660:1875336022397184:0@lo:400:kworker.0 00000100:00100000:0.0:1788460227.883416:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460227.883439:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4395f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022396800:0@lo:400:kworker.0 00000100:00100000:0.0:1788460227.883459:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460227.883477:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4394e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1875336022397440:0@lo:400:kworker.0 00000100:00100000:0.0:1788460227.883498:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460227.883509:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788460227.883515:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4396a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022396928:0@lo:400:kworker.0 00000100:00100000:0.0:1788460227.883537:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460227.883567:0:18741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022396672 00000100:00100000:0.0:1788460227.883574:0:18741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022396672 00000100:00100000:0.0:1788460227.883607:0:18741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022397312 00000100:00100000:0.0:1788460227.883610:0:18741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022397312 00000100:00100000:0.0:1788460227.883630:0:18741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022397184 00000100:00100000:0.0:1788460227.883633:0:18741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022397184 00000100:00100000:0.0:1788460227.883642:0:18741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022397440 00000100:00100000:0.0:1788460227.883644:0:18741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022397440 00000100:00100000:0.0:1788460227.883657:0:18741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788460227.883665:0:18741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc4395c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1875336022396672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460227.883714:0:18741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc4395c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1875336022396672:12345-0@lo:400:kworker.0 Request processed in 49us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460227.883721:0:18741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788460227.883736:0:18741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788460227.883742:0:18741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc4397b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1875336022397312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460227.883781:0:18741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc4397b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1875336022397312:12345-0@lo:400:kworker.0 Request processed in 39us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460227.883788:0:18741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788460227.883802:0:18741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788460227.884467:0:18741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc4397480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1875336022397184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460227.884515:0:18741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc4397480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1875336022397184:12345-0@lo:400:kworker.0 Request processed in 708us (1098us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460227.884523:0:18741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788460227.884538:0:18741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788460227.884546:0:18741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc4394a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1875336022397440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460227.884581:0:18741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc4394a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3661:x1875336022397440:12345-0@lo:400:kworker.0 Request processed in 36us (1082us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460227.884587:0:18741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788460227.884610:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022396544 00000100:00100000:0.0:1788460227.884616:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022396544 00000100:00100000:0.0:1788460227.884639:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022396800 00000100:00100000:0.0:1788460227.884641:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022396800 00000100:00100000:0.0:1788460227.884651:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788460227.884657:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc4395500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022396544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460227.884683:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc4395500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022396544:12345-0@lo:400:kworker.0 Request processed in 27us (1302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460227.884689:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788460227.884698:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788460227.884702:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc4395180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022396800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460227.884723:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc4395180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022396800:12345-0@lo:400:kworker.0 Request processed in 21us (1263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460227.884739:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788460227.884764:0:19273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022396928 00000100:00100000:0.0:1788460227.884767:0:19273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022396928 00000100:00100000:0.0:1788460227.884791:0:19273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788460227.884796:0:19273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc532d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022396928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460227.884996:0:19273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc532d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022396928:12345-0@lo:400:kworker.0 Request processed in 199us (1458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460227.885002:0:19273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1788460227.885018:0:17207:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788460227.885022:0:17207:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788460227.885023:0:17207:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788460227.885051:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4394700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022396544:0@lo:400:kworker.0 00010000:00080000:0.0:1788460227.885064:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4bc4397800 x1875336022397184/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460243 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460227.885074:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4397800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3660:1875336022397184:0@lo:400:kworker.0 00010000:00080000:0.0:1788460227.885085:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4bc4396680 x1875336022396672/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460243 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460227.885094:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4396680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3660:1875336022396672:0@lo:400:kworker.0 00010000:00080000:0.0:1788460227.885103:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4bc4394000 x1875336022397312/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460243 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460227.885110:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4394000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3660:1875336022397312:0@lo:400:kworker.0 00010000:00080000:0.0:1788460227.885145:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4bc4396a00 x1875336022396928/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788460243 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460227.885152:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4396a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022396928:0@lo:400:kworker.0 00000100:00100000:0.0:1788460227.885171:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4395f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022396800:0@lo:400:kworker.0 00010000:00080000:0.0:1788460227.885180:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4bc4394e00 x1875336022397440/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460243 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460227.885188:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4394e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3661:1875336022397440:0@lo:400:kworker.0 00000100:00100000:3.0:1788460227.885388:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788460227.885425:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4396d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1875336022397056:0@lo:8:kworker.0 00000100:00100000:3.0:1788460227.885463:0:3658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788460227.885492:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4bf75e3b80 x1875336022396416/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788460237 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460227.885499:0:3658:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788460227.885507:0:3658:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1788460227.885514:0:3658:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788460227.885518:0:3658:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788460227.885520:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c4ac4221800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788460227.885526:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3658:1875336022396416:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788460227.885546:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022397056 00000100:00100000:3.0:1788460227.885550:0:18719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022397056 00000100:00100000:3.0:1788460227.885570:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788460227.885575:0:18719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf75e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3658:x1875336022397056:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1788460227.885624:0:18719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf75e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3658:x1875336022397056:12345-0@lo:8:kworker.0 Request processed in 48us (160us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788460227.885629:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788460227.885651:0:3658:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788460227.885655:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c4ac1eca800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788460227.885658:0:3658:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788460227.885661:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4396d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1875336022397056:0@lo:8:kworker.0 00000020:01000004:1.0:1788460227.890075:0:19545:0:(obd_mount.c:308:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788460227.890095:0:19545:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8c4bcec56620) 00000020:00000080:1.0:1788460227.890118:0:19545:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:1.0:1788460227.890201:0:19545:0:(tgt_mount.c:167:server_get_mount()) get mount ffff8c4ac389b000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788460227.890205:0:19545:0:(tgt_mount.c:201:server_put_mount()) put mount ffff8c4ac389b000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788460227.890208:0:19545:0:(obd_mount.c:798:lustre_put_lsi()) put ffff8c4ac389b000 3 00010000:00080000:1.0:1788460227.890239:0:19545:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8c4ac3725800@lustre-MDT0001-lwp-OST0001: add connection 192.168.206.105@tcp at head 00010000:00010000:1.0:1788460227.891940:0:19545:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:1.0:1788460227.892178:0:19545:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1788460227.892219:0:19545:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788460227.892232:0:19545:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x5dfa74784542c2f0 00000100:00080000:1.0:1788460227.892242:0:19545:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788460227.892247:0:19545:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8c4ac3725800 using connection 192.168.206.105@tcp/0@lo 00000100:00100000:1.0:1788460227.892284:0:19545:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4ac3839c00 x1875336022397568/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788460227.892312:0:19545:0:(pinger.c:380:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1788460227.893383:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3839c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3658:1875336022397568:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788460227.893453:0:3658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460227.893908:0:18741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022397568 00000100:00100000:2.0:1788460227.893924:0:18741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022397568 00000100:00100000:2.0:1788460227.893979:0:18741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788460227.893987:0:18741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf75e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3658:x1875336022397568:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788460227.894014:0:18741:0:(ldlm_lib.c:1461:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 524 last 0 00000020:00000080:2.0:1788460227.894051:0:18741:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x5dfa74784542c2f7 00000004:00100000:2.0:1788460227.894067:0:18741:0:(mdt_handler.c:7310:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788460227.894099:0:18741:0:(import.c:65:import_set_state_nolock()) ffff8c4c0147b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788460227.894156:0:18741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf75e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3658:x1875336022397568:12345-0@lo:38:llog_process_th.0 Request processed in 168us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460227.894164:0:18741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788460227.894206:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4ac3839c00 x1875336022397568/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788460237 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460227.894217:0:3658:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788460227.894224:0:3658:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1788460227.894231:0:3658:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788460227.894235:0:3658:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788460227.894238:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c4ac3725800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788460227.894243:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3839c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3658:1875336022397568:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1788460227.894935:0:16617:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000040:00080000:2.0:1788460227.895156:0:19545:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x14:0x0] index 52 count 51 00000100:00080000:1.0:1788460227.895304:0:16617:0:(pinger.c:254:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788460227.895309:0:16617:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788460227.895312:0:16617:0:(pinger.c:254:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:0.0:1788460227.896930:0:19532:0:(obd_config.c:2143:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788460227.896971:0:19532:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788460227.896985:0:19532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f1000/0x5dfa74784542c2c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c2cd expref: -99 pid: 19532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460227.896997:0:19532:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f1000/0x5dfa74784542c2c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c2cd expref: -99 pid: 19532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788460227.897059:0:19532:0:(tgt_mount.c:1239:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788460227.897062:0:19532:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788460227.897064:0:19532:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788460227.897065:0:19532:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:0.0:1788460227.897066:0:19532:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:0.0:1788460227.897067:0:19532:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:0.0:1788460227.897068:0:19532:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788460227.897070:0:19532:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788460227.897071:0:19532:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788460227.897075:0:19532:0:(mgc_request_server.c:449:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1788460227.897077:0:19532:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788460227.897079:0:19532:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788460227.897080:0:19532:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788460227.897081:0:19532:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:0.0:1788460227.897082:0:19532:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:0.0:1788460227.897083:0:19532:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:0.0:1788460227.897084:0:19532:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788460227.897086:0:19532:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788460227.897087:0:19532:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788460227.897114:0:19532:0:(mgc_request_server.c:279:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788460227.897133:0:19532:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc532dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:19532:1875336022397696:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788460227.897207:0:19532:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460227.897247:0:19532:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bedf3a180 going to sleep for 11 seconds 00000100:00100000:2.0:1788460227.897997:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022397696 00000100:00100000:2.0:1788460227.898007:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022397696 00000100:00100000:2.0:1788460227.898049:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788460227.898058:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4042c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+29:19532:x1875336022397696:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788460227.898085:0:17206:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788460227.898098:0:17206:0:(mgs_nids.c:475:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788460227.906408:0:17206:0:(mgs_nids.c:842:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788460227.906456:0:17206:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788460227.906836:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4042c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+29:19532:x1875336022397696:12345-0@lo:253:mount.lustre.0 Request processed in 8773us (9623us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460227.906850:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788460227.907257:0:19532:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc532dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c482be18-c056-4068-8a37-ed5038fc364a:19532:1875336022397696:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788460227.907281:0:19532:0:(mgc_request_server.c:300:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788460227.907284:0:19532:0:(tgt_mount.c:1239:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788460227.907285:0:19532:0:(tgt_mount.c:1240:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788460227.907286:0:19532:0:(tgt_mount.c:1241:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788460227.907287:0:19532:0:(tgt_mount.c:1242:server_mti_print()) uuid: 00000020:01000004:2.0:1788460227.907288:0:19532:0:(tgt_mount.c:1243:server_mti_print()) ver: 0 00000020:01000004:2.0:1788460227.907290:0:19532:0:(tgt_mount.c:1244:server_mti_print()) flags: 00000020:01000004:2.0:1788460227.907291:0:19532:0:(tgt_mount.c:1248:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788460227.907292:0:19532:0:(tgt_mount.c:1278:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788460227.907294:0:19532:0:(tgt_mount.c:1284:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788460227.907308:0:19532:0:(tgt_mount.c:2880:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:1.0:1788460227.910124:0:17227:0:(mgs_nids.c:739:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788460227.910133:0:17227:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788460227.910159:0:17227:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c4ac3677e00/0x5dfa74784542c2fe lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460227.910177:0:17227:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4bc2bd4400/0x5dfa74784542c248 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542c241 expref: 28 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460227.910185:0:17227:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4ac3677a00/0x5dfa74784542c256 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542c24f expref: 28 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460227.910192:0:17227:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4ac3677800/0x5dfa74784542c264 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542c25d expref: 28 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460227.910198:0:17227:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4bfadc7a00/0x5dfa74784542c2b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542c2aa expref: 28 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460227.910205:0:17227:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c4ac3677e00/0x5dfa74784542c2fe lrc: 7/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460227.910246:0:17227:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4bfadc7a00/0x5dfa74784542c2b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5dfa74784542c2aa expref: 28 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460227.910259:0:17227:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c4bfadc7a00/0x5dfa74784542c2b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5dfa74784542c2aa expref: 28 pid: 17206 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460227.910272:0:17227:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac383bb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17227:1875336022397824:0@lo:104: 00000100:00100000:1.0:1788460227.910329:0:17227:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788460227.910426:0:17227:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4ac3677800/0x5dfa74784542c264 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5dfa74784542c25d expref: 28 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460227.910452:0:17227:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c4ac3677800/0x5dfa74784542c264 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5dfa74784542c25d expref: 28 pid: 17205 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460227.910461:0:17227:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac383aa00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17227:1875336022397952:0@lo:104: 00000100:00100000:1.0:1788460227.910483:0:17227:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788460227.911224:0:17227:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4ac3677a00/0x5dfa74784542c256 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5dfa74784542c24f expref: 28 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460227.911234:0:17227:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c4ac3677a00/0x5dfa74784542c256 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5dfa74784542c24f expref: 28 pid: 17205 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460227.911243:0:17227:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac383a300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17227:1875336022398080:0@lo:104: 00000100:00100000:1.0:1788460227.911268:0:17227:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460227.914208:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022397824 00000100:00100000:0.0:1788460227.914218:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022397824 00000100:00100000:0.0:1788460227.914257:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022397952 00000100:00100000:0.0:1788460227.914260:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022397952 00000100:00100000:0.0:1788460227.914275:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788460227.914284:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3839880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c482be18-c056-4068-8a37-ed5038fc364a+4:17227:x1875336022397824:12345-0@lo:104: 00010000:00010000:0.0:1788460227.914301:0:17195:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0200/0x5dfa74784542c2aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542c2b1 expref: -99 pid: 19532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460227.914384:0:17195:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788460227.914390:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3839880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c482be18-c056-4068-8a37-ed5038fc364a+4:17227:x1875336022397824:12345-0@lo:104: Request processed in 108us (4061us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460227.914398:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788460227.914415:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788460227.914422:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3838e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c482be18-c056-4068-8a37-ed5038fc364a+3:17227:x1875336022397952:12345-0@lo:104: 00010000:00010000:0.0:1788460227.914430:0:17195:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.206.105@tcp lock: ffff8c4bc2bd5c00/0x5dfa74784542c25d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542c264 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460227.914478:0:17195:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788460227.914484:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3838e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c482be18-c056-4068-8a37-ed5038fc364a+3:17227:x1875336022397952:12345-0@lo:104: Request processed in 64us (4000us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460227.914499:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1788460227.914712:0:18366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788460227.914718:0:18366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0200/0x5dfa74784542c2aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542c2b1 expref: -99 pid: 19532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460227.914726:0:18366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc14f0200 already unused, calling callback (ffffffffc125ae00) 10000000:00010000:0.0:1788460227.914730:0:18366:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0200/0x5dfa74784542c2aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5dfa74784542c2b1 expref: -99 pid: 19532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460227.914739:0:18366:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0200/0x5dfa74784542c2aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5dfa74784542c2b1 expref: -99 pid: 19532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788460227.914746:0:18366:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0200/0x5dfa74784542c2aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5dfa74784542c2b1 expref: -99 pid: 19532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788460227.914752:0:18366:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788460227.914789:0:18366:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0200/0x5dfa74784542c2aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542c2b1 expref: -99 pid: 19532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460227.914796:0:18366:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788460227.914813:0:18366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0200/0x5dfa74784542c2aa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542c2b1 expref: -99 pid: 19532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460227.914820:0:18366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0200/0x5dfa74784542c2aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542c2b1 expref: -99 pid: 19532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460227.914831:0:18366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788460227.914835:0:18366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: ffff8c4bc2bd5c00/0x5dfa74784542c25d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542c264 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460227.914851:0:18366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc2bd5c00 already unused, calling callback (ffffffffc125ae00) 10000000:00010000:0.0:1788460227.914855:0:18366:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: ffff8c4bc2bd5c00/0x5dfa74784542c25d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5dfa74784542c264 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460227.914861:0:18366:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: ffff8c4bc2bd5c00/0x5dfa74784542c25d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5dfa74784542c264 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788460227.914867:0:18366:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: ffff8c4bc2bd5c00/0x5dfa74784542c25d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5dfa74784542c264 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788460227.914872:0:18366:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788460227.914898:0:18366:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.206.105@tcp lock: ffff8c4bc2bd5c00/0x5dfa74784542c25d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542c264 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460227.914904:0:18366:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788460227.914917:0:18366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: ffff8c4bc2bd5c00/0x5dfa74784542c25d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542c264 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460227.914923:0:18366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: ffff8c4bc2bd5c00/0x5dfa74784542c25d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542c264 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460227.914931:0:18366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460227.914933:0:18366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460227.914934:0:18366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460227.914939:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788460227.914969:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc532df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c482be18-c056-4068-8a37-ed5038fc364a:3662:1875336022398208:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788460227.915004:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460227.915045:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc532e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c482be18-c056-4068-8a37-ed5038fc364a:3659:1875336022398336:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788460227.915078:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460227.915122:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022398208 00000100:00100000:0.0:1788460227.915127:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022398208 00010000:00010000:0.0:1788460227.915145:0:17198:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4bfadc7a00/0x5dfa74784542c2b1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542c2aa expref: 29 pid: 17206 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460227.915165:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022398336 00000100:00100000:0.0:1788460227.915168:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022398336 00010000:00010000:0.0:1788460227.915178:0:17198:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4ac3677800/0x5dfa74784542c264 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542c25d expref: 30 pid: 17205 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460227.915190:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788460227.915197:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc532f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c482be18-c056-4068-8a37-ed5038fc364a+30:3662:x1875336022398208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788460227.915207:0:17198:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788460227.915212:0:17198:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4bfadc7a00/0x5dfa74784542c2b1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542c2aa expref: 30 pid: 17206 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460227.915222:0:17198:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4bfadc7a00/0x5dfa74784542c2b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5dfa74784542c2aa expref: 30 pid: 17206 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460227.915240:0:17198:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788460227.915267:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc532f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c482be18-c056-4068-8a37-ed5038fc364a+30:3662:x1875336022398208:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460227.915273:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788460227.915285:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788460227.915291:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc532ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c482be18-c056-4068-8a37-ed5038fc364a+29:3659:x1875336022398336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788460227.915298:0:17198:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788460227.915302:0:17198:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4ac3677800/0x5dfa74784542c264 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542c25d expref: 29 pid: 17205 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460227.915321:0:17198:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4ac3677800/0x5dfa74784542c264 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5dfa74784542c25d expref: 29 pid: 17205 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460227.915331:0:17198:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788460227.915356:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc532ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c482be18-c056-4068-8a37-ed5038fc364a+29:3659:x1875336022398336:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460227.915363:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788460227.915397:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc532df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c482be18-c056-4068-8a37-ed5038fc364a:3662:1875336022398208:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788460227.915419:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc532e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c482be18-c056-4068-8a37-ed5038fc364a:3659:1875336022398336:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788460227.916016:0:17227:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4bc2bd4400/0x5dfa74784542c248 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5dfa74784542c241 expref: 28 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460227.916028:0:17227:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c4bc2bd4400/0x5dfa74784542c248 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5dfa74784542c241 expref: 28 pid: 17206 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460227.916038:0:17227:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac383b480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17227:1875336022398464:0@lo:104: 00000100:00100000:1.0:1788460227.916067:0:17227:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460227.916077:0:17227:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac42cdc00 going to sleep for 11 seconds 00010000:00010000:1.0:1788460227.916091:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4bfadc7a00/0x5dfa74784542c2b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5dfa74784542c2aa expref: 28 pid: 17206 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460227.916100:0:17227:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac383bb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17227:1875336022397824:0@lo:104: 00010000:00010000:1.0:1788460227.916109:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4ac3677800/0x5dfa74784542c264 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5dfa74784542c25d expref: 27 pid: 17205 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460227.916128:0:17227:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac383aa00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17227:1875336022397952:0@lo:104: 00000100:00100000:0.0:1788460227.916275:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022398080 00000100:00100000:0.0:1788460227.916281:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022398080 00000100:00100000:0.0:1788460227.916304:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022398464 00000100:00100000:0.0:1788460227.916307:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022398464 00000100:00100000:0.0:1788460227.916318:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788460227.916324:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac383a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c482be18-c056-4068-8a37-ed5038fc364a+4:17227:x1875336022398080:12345-0@lo:104: 00010000:00010000:0.0:1788460227.916335:0:17195:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7200/0x5dfa74784542c24f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542c256 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460227.916389:0:17195:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788460227.916394:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac383a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c482be18-c056-4068-8a37-ed5038fc364a+4:17227:x1875336022398080:12345-0@lo:104: Request processed in 71us (5126us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460227.916400:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788460227.916414:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788460227.916420:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3838a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c482be18-c056-4068-8a37-ed5038fc364a+3:17227:x1875336022398464:12345-0@lo:104: 00010000:00010000:0.0:1788460227.916427:0:17195:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7800/0x5dfa74784542c241 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542c248 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460227.916472:0:17195:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788460227.916478:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3838a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c482be18-c056-4068-8a37-ed5038fc364a+3:17227:x1875336022398464:12345-0@lo:104: Request processed in 58us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460227.916484:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1788460227.916500:0:17201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788460227.916505:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7200/0x5dfa74784542c24f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542c256 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460227.916511:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bfadc7200 already unused, calling callback (ffffffffc125ae00) 10000000:00010000:0.0:1788460227.916515:0:17201:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7200/0x5dfa74784542c24f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5dfa74784542c256 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460227.916523:0:17201:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7200/0x5dfa74784542c24f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5dfa74784542c256 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788460227.916530:0:17201:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7200/0x5dfa74784542c24f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5dfa74784542c256 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788460227.916536:0:17201:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788460227.916559:0:17201:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7200/0x5dfa74784542c24f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542c256 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460227.916565:0:17201:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788460227.916579:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7200/0x5dfa74784542c24f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542c256 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460227.916585:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7200/0x5dfa74784542c24f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542c256 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460227.916605:0:17201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788460227.916607:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7800/0x5dfa74784542c241 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542c248 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460227.916614:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bfadc7800 already unused, calling callback (ffffffffc125ae00) 10000000:00010000:0.0:1788460227.916617:0:17201:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7800/0x5dfa74784542c241 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5dfa74784542c248 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460227.916622:0:17201:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7800/0x5dfa74784542c241 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5dfa74784542c248 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788460227.916628:0:17201:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7800/0x5dfa74784542c241 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5dfa74784542c248 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788460227.916632:0:17201:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788460227.916645:0:17201:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7800/0x5dfa74784542c241 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542c248 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460227.916650:0:17201:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788460227.916661:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7800/0x5dfa74784542c241 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542c248 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460227.916667:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc7800/0x5dfa74784542c241 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542c248 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460227.916679:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460227.916681:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460227.916683:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460227.916688:0:18366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788460227.916701:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788460227.916712:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc532e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c482be18-c056-4068-8a37-ed5038fc364a:3659:1875336022398592:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788460227.916739:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460227.916759:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788460227.916766:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc532df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c482be18-c056-4068-8a37-ed5038fc364a:3662:1875336022398720:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788460227.916787:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460227.916920:0:17227:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac383a300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17227:1875336022398080:0@lo:104: 00000100:00100000:1.0:1788460227.916928:0:17227:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac383b480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17227:1875336022398464:0@lo:104: 00010000:00010000:1.0:1788460227.916979:0:17227:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c4ac3677e00/0x5dfa74784542c2fe lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460227.917032:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022398592 00000100:00100000:0.0:1788460227.917037:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022398592 00010000:00010000:0.0:1788460227.917053:0:17198:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4ac3677a00/0x5dfa74784542c256 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542c24f expref: 27 pid: 17205 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460227.917108:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022398720 00000100:00100000:0.0:1788460227.917111:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022398720 00010000:00010000:0.0:1788460227.917123:0:17198:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4bc2bd4400/0x5dfa74784542c248 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542c241 expref: 28 pid: 17206 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460227.917473:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788460227.917481:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc532c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c482be18-c056-4068-8a37-ed5038fc364a+28:3659:x1875336022398592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788460227.917492:0:17199:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788460227.917497:0:17199:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4ac3677a00/0x5dfa74784542c256 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542c24f expref: 28 pid: 17205 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460227.917508:0:17199:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4ac3677a00/0x5dfa74784542c256 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5dfa74784542c24f expref: 28 pid: 17205 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460227.917520:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4ac3677a00/0x5dfa74784542c256 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5dfa74784542c24f expref: 28 pid: 17205 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460227.917530:0:17199:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788460227.917599:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc532c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c482be18-c056-4068-8a37-ed5038fc364a+27:3659:x1875336022398592:12345-0@lo:103:ldlm_bl.0 Request processed in 119us (859us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460227.917606:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788460227.917620:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788460227.917626:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc532fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c482be18-c056-4068-8a37-ed5038fc364a+26:3662:x1875336022398720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788460227.917633:0:17199:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788460227.917636:0:17199:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4bc2bd4400/0x5dfa74784542c248 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542c241 expref: 26 pid: 17206 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460227.917651:0:17199:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4bc2bd4400/0x5dfa74784542c248 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5dfa74784542c241 expref: 26 pid: 17206 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460227.917661:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4bc2bd4400/0x5dfa74784542c248 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5dfa74784542c241 expref: 26 pid: 17206 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460227.917671:0:17199:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c4ac3677e00/0x5dfa74784542c2fe lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460227.917679:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4ac3677e00/0x5dfa74784542c2fe lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788460227.917691:0:17199:0:(mgs_nids.c:715:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007558880s 00010000:00010000:1.0:1788460227.917695:0:17199:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c4ac3677e00/0x5dfa74784542c2fe lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460227.917702:0:17199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c4ac3677e00/0x5dfa74784542c2fe lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460227.917708:0:17199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c4ac3677e00/0x5dfa74784542c2fe lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460227.917715:0:17199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c4ac3677e00/0x5dfa74784542c2fe lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460227.917720:0:17199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac3677e00 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:1.0:1788460227.917724:0:17199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c4ac3677e00/0x5dfa74784542c2fe lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460227.917731:0:17199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c4ac3677e00/0x5dfa74784542c2fe lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460227.917750:0:17199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c4ac3677e00/0x5dfa74784542c2fe lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460227.917758:0:17199:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788460227.917786:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc532fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c482be18-c056-4068-8a37-ed5038fc364a+25:3662:x1875336022398720:12345-0@lo:103:ldlm_bl.0 Request processed in 160us (998us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460227.917792:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788460227.917922:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc532df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c482be18-c056-4068-8a37-ed5038fc364a:3662:1875336022398720:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788460227.918159:0:17227:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c4ac3677e00/0x5dfa74784542c2fe lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460227.918167:0:17227:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c4ac3677e00/0x5dfa74784542c2fe lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460227.918173:0:17227:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4ac3677e00/0x5dfa74784542c2fe lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17227 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460227.918416:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc532e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c482be18-c056-4068-8a37-ed5038fc364a:3659:1875336022398592:0@lo:103:ldlm_bl.0 00000001:00000004:0.0:1788460227.919803:0:19532:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1788460227.921774:0:19532:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1788460227.921782:0:19532:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1788460227.921892:0:19532:0:(tgt_mount.c:2600:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1788460227.921910:0:19532:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1788460227.922688:0:19532:0:(tgt_mount.c:2486:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788460227.926066:0:19532:0:(tgt_mount.c:2501:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788460228.177212:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022398848:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788460228.177280:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460228.177439:0:18721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022398848 00000100:00100000:3.0:1788460228.177448:0:18721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022398848 00000100:00100000:3.0:1788460228.177501:0:18721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788460228.177511:0:18721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc532df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022398848:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788460228.177538:0:18721:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788460228.177583:0:18721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc532df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022398848:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460228.177590:0:18721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788460228.177847:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8c4bf75e3800 x1875336022398848/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460244 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460228.177866:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022398848:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788460228.498266:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788460228.842568:0:19598:0:(tgt_mount.c:2486:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788460228.843721:0:19598:0:(tgt_mount.c:2501:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:1.0:1788460229.074524:0:17208:0:(mgc_request.c:715:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788460229.074533:0:17208:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-mdtir-ffff8c4ac389b000 from 10 10000000:01000000:1.0:1788460229.074539:0:17208:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788460229.074582:0:17208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677c00/0x5dfa74784542c305 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460229.074595:0:17208:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677c00/0x5dfa74784542c305 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460229.074607:0:17208:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677c00/0x5dfa74784542c305 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460229.074633:0:17208:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac383b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022398976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788460229.074708:0:17208:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460229.074761:0:17208:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc5738e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788460229.074897:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022398976 00000100:00100000:0.0:1788460229.074905:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022398976 00000100:00100000:0.0:1788460229.075023:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788460229.075032:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4041450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+25:17208:x1875336022398976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788460229.075046:0:17205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460229.075059:0:17205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4bc2bd5c00/0x5dfa74784542c30c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542c305 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460229.075093:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bc2bd5c00/0x5dfa74784542c30c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542c305 expref: 26 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460229.075104:0:17205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4bc2bd5c00/0x5dfa74784542c30c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542c305 expref: 26 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460229.075114:0:17205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc2bd5c00, rc 0) 00000100:00100000:0.0:1788460229.075156:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4041450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+26:17208:x1875336022398976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460229.075163:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788460229.076329:0:17208:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac383b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022398976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788460229.076350:0:17208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677c00/0x5dfa74784542c305 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c30c expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460229.076362:0:17208:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677c00/0x5dfa74784542c305 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542c30c expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460229.076495:0:17208:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac383b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022399104:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788460229.076546:0:17208:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460229.076596:0:17208:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc5738e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788460229.076615:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022399104 00000100:00100000:1.0:1788460229.076621:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022399104 00000100:00100000:1.0:1788460229.076659:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788460229.077260:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4041c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+26:17208:x1875336022399104:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788460229.077283:0:17206:0:(mgs_nids.c:1209:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788460229.077299:0:17206:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788460229.077302:0:17206:0:(mgs_nids.c:325:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:1.0:1788460229.077484:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4041c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+26:17208:x1875336022399104:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 817us (937us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460229.077493:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788460229.077590:0:17208:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac383b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022399104:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788460229.077640:0:17208:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788460229.077648:0:17208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677c00/0x5dfa74784542c305 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c30c expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460229.077662:0:17208:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677c00/0x5dfa74784542c305 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c30c expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788460229.077677:0:17208:0:(mgc_request.c:715:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788460229.077680:0:17208:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-mdtir-ffff8c4c01993000 from 10 10000000:01000000:2.0:1788460229.077683:0:17208:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788460229.077708:0:17208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6400/0x5dfa74784542c313 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460229.077717:0:17208:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6400/0x5dfa74784542c313 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460229.077726:0:17208:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6400/0x5dfa74784542c313 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460229.077753:0:17208:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3673480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022399232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788460229.077793:0:17208:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460229.077811:0:17208:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc2ab3180 going to sleep for 11 seconds 00000100:00100000:1.0:1788460229.077855:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022399232 00000100:00100000:1.0:1788460229.077861:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022399232 00000100:00100000:1.0:1788460229.077910:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788460229.077918:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4042450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+26:17208:x1875336022399232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788460229.077927:0:17206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460229.077959:0:17206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4ac3677e00/0x5dfa74784542c31a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542c313 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460229.077981:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4ac3677e00/0x5dfa74784542c31a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542c313 expref: 27 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460229.077992:0:17206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4ac3677e00/0x5dfa74784542c31a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542c313 expref: 27 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460229.078000:0:17206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ac3677e00, rc 0) 00000100:00100000:1.0:1788460229.078035:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4042450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+27:17208:x1875336022399232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460229.078042:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788460229.078076:0:17208:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3673480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022399232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788460229.078086:0:17208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6400/0x5dfa74784542c313 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c31a expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460229.078094:0:17208:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6400/0x5dfa74784542c313 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542c31a expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460229.078136:0:17208:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac383a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022399360:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788460229.078165:0:17208:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460229.078182:0:17208:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc5738d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788460229.078193:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022399360 00000100:00100000:2.0:1788460229.078199:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022399360 00000100:00100000:2.0:1788460229.078232:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788460229.078238:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4043850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+27:17208:x1875336022399360:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788460229.078250:0:17204:0:(mgs_nids.c:1209:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788460229.078262:0:17204:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788460229.078265:0:17204:0:(mgs_nids.c:325:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:2.0:1788460229.078969:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4043850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+27:17208:x1875336022399360:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 704us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460229.078978:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788460229.079120:0:17208:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac383a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022399360:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788460229.079154:0:17208:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788460229.079161:0:17208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6400/0x5dfa74784542c313 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c31a expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460229.079180:0:17208:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4bfadc6400/0x5dfa74784542c313 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c31a expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788460229.079194:0:17208:0:(mgc_request.c:715:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788460229.079195:0:17208:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-mdtir-ffff8c4be0237800 from 10 10000000:01000000:1.0:1788460229.079198:0:17208:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788460229.079218:0:17208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677a00/0x5dfa74784542c321 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460229.079226:0:17208:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677a00/0x5dfa74784542c321 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460229.079234:0:17208:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677a00/0x5dfa74784542c321 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460229.079248:0:17208:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac383a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022399488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788460229.079278:0:17208:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460229.079305:0:17208:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc5738d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788460229.079456:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022399488 00000100:00100000:2.0:1788460229.079461:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022399488 00000100:00100000:2.0:1788460229.079504:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788460229.079512:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfc2e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+27:17208:x1875336022399488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788460229.079522:0:17206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460229.079531:0:17206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4bfadc7800/0x5dfa74784542c328 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542c321 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460229.079548:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bfadc7800/0x5dfa74784542c328 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542c321 expref: 28 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460229.079557:0:17206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4bfadc7800/0x5dfa74784542c328 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542c321 expref: 28 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460229.079575:0:17206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bfadc7800, rc 0) 00000100:00100000:2.0:1788460229.079604:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfc2e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+28:17208:x1875336022399488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 93us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460229.079611:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788460229.083439:0:17208:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac383a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022399488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788460229.083466:0:17208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677a00/0x5dfa74784542c321 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c328 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460229.083479:0:17208:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677a00/0x5dfa74784542c321 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542c328 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460229.083557:0:17208:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac383a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022399616:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788460229.083616:0:17208:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460229.083658:0:17208:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc5738d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788460229.083676:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022399616 00000100:00100000:1.0:1788460229.083682:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022399616 00000100:00100000:1.0:1788460229.083724:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788460229.083732:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfc2e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+28:17208:x1875336022399616:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788460229.083751:0:17204:0:(mgs_nids.c:1209:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788460229.083779:0:17204:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788460229.083783:0:17204:0:(mgs_nids.c:325:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:1.0:1788460229.083854:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfc2e6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+28:17208:x1875336022399616:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 121us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460229.083862:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788460229.083912:0:17208:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac383a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022399616:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788460229.084267:0:17208:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788460229.084275:0:17208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677a00/0x5dfa74784542c321 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c328 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460229.084285:0:17208:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677a00/0x5dfa74784542c321 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c328 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788460229.084298:0:17208:0:(mgc_request.c:715:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788460229.084300:0:17208:0:(mgc_request.c:2266:mgc_process_log()) Process log lustre-mdtir-ffff8c4ac428f800 from 10 10000000:01000000:1.0:1788460229.084303:0:17208:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788460229.084337:0:17208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677800/0x5dfa74784542c32f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460229.084345:0:17208:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677800/0x5dfa74784542c32f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460229.084354:0:17208:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677800/0x5dfa74784542c32f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460229.084374:0:17208:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac383a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022399744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788460229.084405:0:17208:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460229.084420:0:17208:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc5738d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788460229.084433:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022399744 00000100:00100000:1.0:1788460229.084437:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022399744 00000100:00100000:1.0:1788460229.084459:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788460229.084465:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4133450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+28:17208:x1875336022399744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788460229.084474:0:17204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460229.084607:0:17204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4bc6381c00/0x5dfa74784542c336 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542c32f expref: -99 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460229.084628:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bc6381c00/0x5dfa74784542c336 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542c32f expref: 29 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460229.084637:0:17204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4bc6381c00/0x5dfa74784542c336 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542c32f expref: 29 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460229.084646:0:17204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc6381c00, rc 0) 00000100:00100000:1.0:1788460229.084680:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4133450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+29:17208:x1875336022399744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 214us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460229.084686:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788460229.084720:0:17208:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac383a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022399744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788460229.084732:0:17208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677800/0x5dfa74784542c32f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c336 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460229.084741:0:17208:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677800/0x5dfa74784542c32f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542c336 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460229.085606:0:17208:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac383a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022399872:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788460229.085645:0:17208:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460229.085677:0:17208:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc5738d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788460229.085692:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022399872 00000100:00100000:1.0:1788460229.085697:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022399872 00000100:00100000:1.0:1788460229.085736:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788460229.085744:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4131c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+29:17208:x1875336022399872:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788460229.085760:0:17206:0:(mgs_nids.c:1209:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788460229.085906:0:17206:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788460229.085910:0:17206:0:(mgs_nids.c:325:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:1.0:1788460229.086071:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4131c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+29:17208:x1875336022399872:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 327us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460229.086079:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788460229.087166:0:17208:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac383a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022399872:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788460229.087224:0:17208:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788460229.087232:0:17208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677800/0x5dfa74784542c32f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c336 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460229.087241:0:17208:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677800/0x5dfa74784542c32f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c336 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460229.521174:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788460229.713131:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3671180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022400000:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788460229.713196:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460229.713284:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022400000 00000100:00100000:2.0:1788460229.713291:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022400000 00000100:00100000:2.0:1788460229.713342:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788460229.713352:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc532d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022400000:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788460229.713383:0:17217:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788460229.713434:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc532d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022400000:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460229.713441:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788460229.713476:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3671180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022400000:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788460229.714364:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022400128:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788460229.714414:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460229.714647:0:17952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022400128 00000100:00100000:2.0:1788460229.714653:0:17952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022400128 00000100:00100000:2.0:1788460229.714684:0:17952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788460229.714691:0:17952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc532f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022400128:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788460229.714723:0:17952:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788460229.715007:0:17952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc532f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022400128:12345-0@lo:41:osp-pre-0-1.0 Request processed in 315us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460229.715015:0:17952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788460229.715775:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022400128:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788460230.552270:0:18366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788460231.001038:0:3658:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788460210/real 1788460210] req@ffff8c4ac4284700 x1875336022384256/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788460230 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460231.001068:0:3658:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c4ac4284700 x1875336022384256/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788460230 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460231.001091:0:3658:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788460210/real 1788460210] req@ffff8c4ac4285880 x1875336022384384/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788460230 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460231.001104:0:3658:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8c4ac4285880 x1875336022384384/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788460230 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788460231.001122:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c4bc6b3a800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788460231.001136:0:3658:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788460231.001140:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4284700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1875336022384256:0@lo:8:kworker.0 00000100:00080000:1.0:1788460231.001146:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c4ac3abd000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788460231.001150:0:3658:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788460231.001153:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4285880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1875336022384384:0@lo:8:kworker.0 00000100:00080000:0.0:1788460231.002031:0:16617:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788460231.002036:0:16617:0:(pinger.c:244:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788460231.002045:0:16617:0:(import.c:65:import_set_state_nolock()) ffff8c4bc6b3a800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788460231.002051:0:16617:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 507 00000100:00080000:0.0:1788460231.002056:0:16617:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788460231.002062:0:16617:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8c4bc6b3a800 using connection 192.168.206.105@tcp/0@lo 00000100:00100000:0.0:1788460231.002081:0:16617:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4bc532c000 x1875336022400512/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788460231.002105:0:16617:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788460231.002107:0:16617:0:(pinger.c:244:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788460231.002109:0:16617:0:(import.c:65:import_set_state_nolock()) ffff8c4ac3abd000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788460231.002112:0:16617:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 507 00000100:00080000:0.0:1788460231.002114:0:16617:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788460231.002117:0:16617:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8c4ac3abd000 using connection 192.168.206.105@tcp/0@lo 00000100:00100000:0.0:1788460231.002125:0:16617:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4bc532d880 x1875336022400640/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788460231.002155:0:16617:0:(pinger.c:236:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788460231.002168:0:16617:0:(pinger.c:244:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788460231.002169:0:16617:0:(import.c:65:import_set_state_nolock()) ffff8c4ac1eca800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788460231.002173:0:16617:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8c4ac1eca800 using connection 192.168.206.105@tcp/0@lo 00000100:00100000:0.0:1788460231.002182:0:16617:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8c4bc532ed80 x1875336022401152/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788460231.002228:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc532c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022400384:0@lo:400:kworker.0 00000100:00100000:0.0:1788460231.002290:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460231.002318:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc532e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3662:1875336022401280:0@lo:400:kworker.0 00000100:00100000:0.0:1788460231.002341:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460231.002368:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4395f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1875336022401792:0@lo:400:kworker.0 00000100:00100000:0.0:1788460231.002393:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460231.002413:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788460231.002418:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc532e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c482be18-c056-4068-8a37-ed5038fc364a:3662:1875336022400256:0@lo:400:kworker.0 00000100:00100000:0.0:1788460231.002443:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460231.002466:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc532ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022401024:0@lo:400:kworker.0 00000100:00100000:0.0:1788460231.002489:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460231.002507:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4394e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3662:1875336022401664:0@lo:400:kworker.0 00000100:00100000:0.0:1788460231.002529:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460231.002555:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc532f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022400896:0@lo:400:kworker.0 00000100:00100000:0.0:1788460231.002576:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460231.002594:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4396d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3660:1875336022401536:0@lo:400:kworker.0 00000100:00100000:0.0:1788460231.002612:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460231.002639:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788460231.002645:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc532ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3660:1875336022400768:0@lo:400:kworker.0 00000100:00100000:0.0:1788460231.002665:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460231.002675:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc532dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3660:1875336022401408:0@lo:400:kworker.0 00000100:00100000:0.0:1788460231.002692:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460231.002715:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022400384 00000100:00100000:0.0:1788460231.002722:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022400384 00000100:00100000:0.0:1788460231.002758:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022400896 00000100:00100000:0.0:1788460231.002761:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022400896 00000100:00100000:0.0:1788460231.002776:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788460231.002784:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc4396a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1875336022400384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460231.002833:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc4396a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1875336022400384:12345-0@lo:400:kworker.0 Request processed in 50us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460231.002850:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788460231.002866:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788460231.002885:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4908700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022400896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460231.002920:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4908700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022400896:12345-0@lo:400:kworker.0 Request processed in 36us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460231.002926:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788460231.002972:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022401280 00000100:00100000:0.0:1788460231.002975:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022401280 00000100:00100000:0.0:1788460231.002993:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022401792 00000100:00100000:0.0:1788460231.002996:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022401792 00000100:00100000:0.0:1788460231.003017:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022401664 00000100:00100000:0.0:1788460231.003020:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022401664 00000100:00100000:0.0:1788460231.003030:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022401536 00000100:00100000:0.0:1788460231.003032:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022401536 00000100:00100000:0.0:1788460231.003042:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022400768 00000100:00100000:0.0:1788460231.003044:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022400768 00000100:00100000:0.0:1788460231.003053:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022401408 00000100:00100000:0.0:1788460231.003055:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022401408 00000100:00100000:0.0:1788460231.003068:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788460231.003073:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc4394000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1875336022401280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460231.003102:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc4394000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1875336022401280:12345-0@lo:400:kworker.0 Request processed in 28us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460231.003109:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788460231.003119:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788460231.003124:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc4396680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875336022401792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460231.003146:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc4396680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875336022401792:12345-0@lo:400:kworker.0 Request processed in 23us (754us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460231.003152:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788460231.003169:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788460231.003175:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc4394700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1875336022401664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460231.003202:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc4394700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1875336022401664:12345-0@lo:400:kworker.0 Request processed in 28us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460231.003208:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788460231.003218:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788460231.003223:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4909f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1875336022401536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460231.003248:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4909f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3660:x1875336022401536:12345-0@lo:400:kworker.0 Request processed in 25us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460231.003254:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788460231.003264:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788460231.003269:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4909880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1875336022400768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460231.003309:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4909880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1875336022400768:12345-0@lo:400:kworker.0 Request processed in 39us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460231.003315:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788460231.003326:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788460231.003332:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac490b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1875336022401408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460231.003357:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac490b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3660:x1875336022401408:12345-0@lo:400:kworker.0 Request processed in 25us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460231.003362:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788460231.003379:0:19273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022401024 00000100:00100000:0.0:1788460231.003382:0:19273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022401024 00000100:00100000:0.0:1788460231.003406:0:19273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788460231.003413:0:19273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc4397800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022401024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460231.003440:0:19273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc4397800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022401024:12345-0@lo:400:kworker.0 Request processed in 28us (949us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460231.003451:0:19273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1788460231.003477:0:17207:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788460231.003480:0:17207:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788460231.003483:0:17207:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788460231.003510:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bc532ca80 x1875336022400768/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460247 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460231.003523:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc532ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3660:1875336022400768:0@lo:400:kworker.0 00010000:00080000:0.0:1788460231.003534:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bc532dc00 x1875336022401408/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460247 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460231.003543:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc532dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3660:1875336022401408:0@lo:400:kworker.0 00000100:00100000:0.0:1788460231.003551:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc532f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022400896:0@lo:400:kworker.0 00010000:00080000:0.0:1788460231.003560:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bc4396d80 x1875336022401536/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460247 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460231.003569:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4396d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3660:1875336022401536:0@lo:400:kworker.0 00010000:00080000:0.0:1788460231.003600:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bc532ce00 x1875336022401024/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788460247 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460231.003609:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc532ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022401024:0@lo:400:kworker.0 00010000:00080000:0.0:1788460231.003618:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bc4394e00 x1875336022401664/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460247 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460231.003626:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4394e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3662:1875336022401664:0@lo:400:kworker.0 00000100:00100000:0.0:1788460231.003636:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc532c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022400384:0@lo:400:kworker.0 00010000:00080000:0.0:1788460231.003645:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bc532e300 x1875336022401280/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460247 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460231.003660:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc532e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3662:1875336022401280:0@lo:400:kworker.0 00010000:00080000:0.0:1788460231.003672:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bc4395f80 x1875336022401792/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460247 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460231.003680:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4395f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1875336022401792:0@lo:400:kworker.0 00000100:00100000:1.0:1788460231.004004:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022400256 00000100:00100000:1.0:1788460231.004010:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022400256 00000100:00100000:1.0:1788460231.004046:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788460231.004053:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4131850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+29:3662:x1875336022400256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460231.004102:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4131850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+29:3662:x1875336022400256:12345-0@lo:400:kworker.0 Request processed in 50us (1658us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460231.004109:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788460231.004148:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc532e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c482be18-c056-4068-8a37-ed5038fc364a:3662:1875336022400256:0@lo:400:kworker.0 00000100:00100000:3.0:1788460231.004636:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc532c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1875336022400512:0@lo:8:kworker.0 00000100:00100000:3.0:1788460231.004674:0:3658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460231.004720:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc532d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1875336022400640:0@lo:8:kworker.0 00000100:00100000:3.0:1788460231.004740:0:3658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460231.004753:0:3658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc532ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1875336022401152:0@lo:8:kworker.0 00000100:00100000:3.0:1788460231.004785:0:3658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460231.004824:0:19273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022400512 00000100:00100000:3.0:1788460231.004828:0:19273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022400512 00000100:00100000:3.0:1788460231.004847:0:19273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022400640 00000100:00100000:3.0:1788460231.004850:0:19273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022400640 00000100:00100000:3.0:1788460231.004857:0:19273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022401152 00000100:00100000:3.0:1788460231.004860:0:19273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022401152 00000100:00100000:3.0:1788460231.004882:0:19273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788460231.004887:0:19273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf75e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3658:x1875336022400512:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788460231.004913:0:19273:0:(ldlm_lib.c:1461:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 528 last 0 00000020:00000080:3.0:1788460231.004965:0:19273:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5dfa74784542c33d 00002000:00100000:3.0:1788460231.004979:0:19273:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8c4ac4225800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a07 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788460231.004983:0:19273:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1788460231.004986:0:19273:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788460231.005058:0:19273:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788460231.005081:0:19273:0:(import.c:65:import_set_state_nolock()) ffff8c4ac4220000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788460231.005121:0:19273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf75e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3658:x1875336022400512:12345-0@lo:8:kworker.0 Request processed in 232us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460231.005128:0:19273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788460231.005144:0:19273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788460231.005148:0:19273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf75e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3658:x1875336022400640:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788460231.005385:0:19273:0:(ldlm_lib.c:1461:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 528 last 0 00000020:00000080:3.0:1788460231.005405:0:19273:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5dfa74784542c344 00002000:00100000:3.0:1788460231.005412:0:19273:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8c4ac4223800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a07 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788460231.005416:0:19273:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1788460231.005418:0:19273:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788460231.005555:0:19273:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788460231.005569:0:19273:0:(import.c:65:import_set_state_nolock()) ffff8c4ac4223000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788460231.005599:0:19273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf75e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3658:x1875336022400640:12345-0@lo:8:kworker.0 Request processed in 450us (858us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460231.005606:0:19273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788460231.005631:0:19273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788460231.005637:0:19273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf75e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3658:x1875336022401152:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788460231.005652:0:19273:0:(ldlm_lib.c:1461:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 528 last 0 00000020:00000080:3.0:1788460231.005666:0:19273:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5dfa74784542c34b 00002000:00100000:3.0:1788460231.005672:0:19273:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8c4ac4227000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a07 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1788460231.005675:0:19273:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:3.0:1788460231.005677:0:19273:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788460231.005711:0:19273:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1788460231.005722:0:19273:0:(import.c:65:import_set_state_nolock()) ffff8c4ac4222800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788460231.005748:0:19273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf75e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3658:x1875336022401152:12345-0@lo:8:kworker.0 Request processed in 110us (962us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460231.005753:0:19273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1788460231.005790:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bc532c000 x1875336022400512/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788460256 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460231.005799:0:3658:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788460231.005806:0:3658:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788460231.005814:0:3658:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788460231.005818:0:3658:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788460231.005820:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c4bc6b3a800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788460231.005831:0:3658:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788460231.005835:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc532c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1875336022400512:0@lo:8:kworker.0 00010000:00080000:3.0:1788460231.005857:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bc532d880 x1875336022400640/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788460256 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460231.005863:0:3658:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788460231.005879:0:3658:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788460231.005884:0:3658:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788460231.005887:0:3658:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788460231.005889:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c4ac3abd000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788460231.005899:0:3658:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788460231.005903:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc532d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3658:1875336022400640:0@lo:8:kworker.0 00010000:00080000:3.0:1788460231.005914:0:3658:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bc532ed80 x1875336022401152/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788460256 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788460231.005922:0:3658:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1788460231.005926:0:3658:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788460231.005929:0:3658:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788460231.005931:0:3658:0:(import.c:65:import_set_state_nolock()) ffff8c4ac1eca800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788460231.005939:0:3658:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788460231.005961:0:3658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc532ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3658:1875336022401152:0@lo:8:kworker.0 00000004:00080000:3.0:1788460231.006011:0:17238:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00000100:00100000:3.0:1788460231.006027:0:17238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17238:1875336022402048:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788460231.006053:0:17238:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460231.006069:0:17238:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bf2fc56c0 going to sleep for 11 seconds 00000004:00080000:3.0:1788460231.006091:0:17956:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1788460231.006101:0:17956:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4285180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17956:1875336022402304:0@lo:7:osp-pre-1-1.0 00000100:00100000:3.0:1788460231.006120:0:17956:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460231.006133:0:17956:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bf2fc5180 going to sleep for 11 seconds 00000004:00080000:3.0:1788460231.006151:0:17955:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788460231.006421:0:17955:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 528109475680ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788460231.006429:0:17955:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1788460231.006588:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022401920:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788460231.006616:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460231.006735:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022402048 00000100:00100000:0.0:1788460231.006740:0:18719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022402048 00000100:00100000:0.0:1788460231.006773:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022402304 00000100:00100000:0.0:1788460231.006775:0:18719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022402304 00000100:00100000:0.0:1788460231.006793:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788460231.006801:0:18719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4285880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17238:x1875336022402048:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788460231.007006:0:17236:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:0.0:1788460231.007021:0:17236:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac490aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17236:1875336022402560:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788460231.007054:0:17236:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460231.007067:0:17236:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc2ab3840 going to sleep for 11 seconds 00000004:00080000:0.0:1788460231.007080:0:17237:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1788460231.007087:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022402560 00000100:00100000:1.0:1788460231.007092:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022402560 00000100:00100000:1.0:1788460231.007113:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788460231.007120:0:18720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4284a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17956:x1875336022402304:12345-0@lo:7:osp-pre-1-1.0 00000004:00080000:0.0:1788460231.007126:0:17237:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 528110181108ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788460231.007130:0:17237:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1788460231.007146:0:17235:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788460231.007185:0:17235:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 528110240236ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788460231.007189:0:17235:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1788460231.007202:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4908a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022402432:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788460231.007252:0:17207:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788460231.007256:0:17207:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788460231.008384:0:18721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022401920 00000100:00100000:3.0:1788460231.008386:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788460231.008392:0:18721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022401920 00000100:00100000:3.0:1788460231.008396:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4284700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022402176:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788460231.008431:0:18721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788460231.008432:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460231.008443:0:18721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4285c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3659:x1875336022401920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788460231.008466:0:18721:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788460231.008518:0:18721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4285c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3659:x1875336022401920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (1900us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460231.008526:0:18721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788460231.008551:0:18721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022402176 00000100:00100000:0.0:1788460231.008556:0:18721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022402176 00000100:00100000:0.0:1788460231.008573:0:18721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788460231.008579:0:18721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4284380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3659:x1875336022402176:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788460231.008581:0:18722:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:3.0:1788460231.008590:0:18722:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:0.0:1788460231.008591:0:18721:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788460231.008624:0:18721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4284380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3659:x1875336022402176:12345-0@lo:13:osp-pre-1-1.0 Request processed in 44us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460231.008631:0:18721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788460231.008636:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bf75e3800 x1875336022401920/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460247 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460231.008656:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022401920:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1788460231.008678:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac4284700 x1875336022402176/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460247 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788460231.008751:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460231.009352:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4284700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022402176:0@lo:13:osp-pre-1-1.0 00000004:00080000:0.0:1788460231.009357:0:17192:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:3.0:1788460231.009404:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022402432 00000100:00100000:3.0:1788460231.009409:0:18722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022402432 00000100:00100000:3.0:1788460231.009433:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788460231.009442:0:18722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4908000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3661:x1875336022402432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788460231.009460:0:18722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788460231.009506:0:18722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4908000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3661:x1875336022402432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460231.009512:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788460231.009545:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac4908a80 x1875336022402432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788460247 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460231.009571:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4908a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022402432:0@lo:13:osp-pre-0-0.0 00002000:00080000:3.0:1788460231.010347:0:18719:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1788460231.010355:0:18719:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1788460231.010361:0:18719:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:33) 00000004:00080000:0.0:1788460231.010819:0:17192:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:0.0:1788460231.014551:0:18720:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:0.0:1788460231.014562:0:18720:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1788460231.014653:0:18720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4284a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17956:x1875336022402304:12345-0@lo:7:osp-pre-1-1.0 Request processed in 7529us (8527us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460231.014664:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788460231.014697:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788460231.014708:0:18720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac490a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17236:x1875336022402560:12345-0@lo:5:osp-pre-0-0.0 00010000:00080000:1.0:1788460231.014977:0:17956:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac4285180 x1875336022402304/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788460247 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460231.014994:0:17956:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4285180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17956:1875336022402304:0@lo:7:osp-pre-1-1.0 00000004:00080000:1.0:1788460231.015008:0:17956:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1788460231.015045:0:17956:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac383a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17956:1875336022402688:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1788460231.015083:0:17956:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460231.015110:0:17956:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc57380c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788460231.015127:0:18717:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1788460231.015134:0:18717:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:1.0:1788460231.015781:0:18717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022402688 00000100:00100000:1.0:1788460231.015789:0:18717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022402688 00000100:00100000:1.0:1788460231.015907:0:19708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788460231.015916:0:19708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac383aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:17956:x1875336022402688:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1788460231.015939:0:19708:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:1.0:1788460231.016011:0:19708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac383aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:17956:x1875336022402688:12345-0@lo:5:osp-pre-1-1.0 Request processed in 96us (928us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460231.016018:0:19708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1788460231.016051:0:17956:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac383a300 x1875336022402688/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788460247 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460231.016062:0:17956:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac383a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17956:1875336022402688:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1788460231.016071:0:17956:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1788460231.016108:0:17956:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac383a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17956:1875336022402816:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1788460231.016132:0:17956:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460231.016148:0:17956:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc57380c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788460231.016230:0:18717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022402816 00000100:00100000:1.0:1788460231.016235:0:18717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022402816 00000100:00100000:1.0:1788460231.016255:0:18717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788460231.016260:0:18717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac383bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17956:x1875336022402816:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1788460231.016417:0:18717:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00002000:00080000:0.0:1788460231.017145:0:18720:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:0.0:1788460231.017152:0:18720:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1788460231.017157:0:18720:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:33) 00000004:00080000:1.0:1788460231.028894:0:17944:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00002000:00010000:3.0:1788460231.029498:0:18719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788460231.029507:0:18719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000850e7ff4/0x5dfa74784542c352 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.029524:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=528s v=(0 0) 00010000:00010000:3.0:1788460231.029529:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788460231.029536:0:18719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000850e7ff4/0x5dfa74784542c352 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.029555:0:18719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000850e7ff4/0x5dfa74784542c352 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.029566:0:18719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000850e7ff4/0x5dfa74784542c352 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.029574:0:18719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000850e7ff4/0x5dfa74784542c352 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.029592:0:18719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788460231.029603:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788460231.029609:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000850e7ff4/0x5dfa74784542c352 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.029629:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc14f0800 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:3.0:1788460231.029634:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000850e7ff4/0x5dfa74784542c352 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.029643:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000850e7ff4/0x5dfa74784542c352 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.029661:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000850e7ff4/0x5dfa74784542c352 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.029669:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000850e7ff4/0x5dfa74784542c352 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.029686:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460231.029688:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460231.029690:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788460231.030329:0:18719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788460231.030336:0:18719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071850f1d/0x5dfa74784542c359 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.030347:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=528s v=(0 0) 00010000:00010000:3.0:1788460231.030350:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788460231.030355:0:18719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071850f1d/0x5dfa74784542c359 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.030365:0:18719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000071850f1d/0x5dfa74784542c359 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.030380:0:18719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071850f1d/0x5dfa74784542c359 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.030388:0:18719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000071850f1d/0x5dfa74784542c359 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.030405:0:18719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788460231.030414:0:17201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788460231.030419:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000071850f1d/0x5dfa74784542c359 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.030426:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc14f1c00 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:3.0:1788460231.030430:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000071850f1d/0x5dfa74784542c359 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.030439:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000071850f1d/0x5dfa74784542c359 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.030453:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000071850f1d/0x5dfa74784542c359 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.030460:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000071850f1d/0x5dfa74784542c359 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.030475:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460231.030482:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460231.030484:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788460231.031603:0:18719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788460231.031613:0:18719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc8a9b50/0x5dfa74784542c360 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460231.031639:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=528s v=(0 0) 00010000:00010000:2.0:1788460231.031643:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788460231.031648:0:18719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc8a9b50/0x5dfa74784542c360 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460231.031661:0:18719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fc8a9b50/0x5dfa74784542c360 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460231.031670:0:18719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc8a9b50/0x5dfa74784542c360 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460231.031678:0:18719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fc8a9b50/0x5dfa74784542c360 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460231.031749:0:18719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788460231.031902:0:18366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788460231.031910:0:18366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fc8a9b50/0x5dfa74784542c360 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.031917:0:18366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bfadc7400 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:1.0:1788460231.031921:0:18366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc8a9b50/0x5dfa74784542c360 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.031929:0:18366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc8a9b50/0x5dfa74784542c360 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.032007:0:18366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fc8a9b50/0x5dfa74784542c360 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.032015:0:18366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc8a9b50/0x5dfa74784542c360 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.032043:0:18366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460231.032045:0:18366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460231.032047:0:18366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788460231.034159:0:18719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788460231.034169:0:18719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a403bfd/0x5dfa74784542c367 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.034184:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=528s v=(0 0) 00010000:00010000:3.0:1788460231.034188:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788460231.034194:0:18719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a403bfd/0x5dfa74784542c367 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.034207:0:18719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002a403bfd/0x5dfa74784542c367 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.034217:0:18719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a403bfd/0x5dfa74784542c367 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.034225:0:18719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002a403bfd/0x5dfa74784542c367 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.034244:0:18719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788460231.034520:0:18719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788460231.034526:0:18719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004da08286/0x5dfa74784542c36e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.034535:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=528s v=(0 0) 00010000:00010000:3.0:1788460231.034538:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788460231.034543:0:18719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004da08286/0x5dfa74784542c36e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.034558:0:18719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004da08286/0x5dfa74784542c36e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.034567:0:18719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004da08286/0x5dfa74784542c36e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.034574:0:18719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004da08286/0x5dfa74784542c36e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.034590:0:18719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788460231.034601:0:17201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788460231.034606:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002a403bfd/0x5dfa74784542c367 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.034614:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc14f0600 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:3.0:1788460231.034618:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002a403bfd/0x5dfa74784542c367 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.034627:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002a403bfd/0x5dfa74784542c367 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.034642:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002a403bfd/0x5dfa74784542c367 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.034650:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a403bfd/0x5dfa74784542c367 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.034675:0:17201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788460231.034679:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004da08286/0x5dfa74784542c36e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.034686:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc14f1e00 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:3.0:1788460231.034689:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004da08286/0x5dfa74784542c36e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.034697:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004da08286/0x5dfa74784542c36e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.034707:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004da08286/0x5dfa74784542c36e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.034715:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004da08286/0x5dfa74784542c36e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.034726:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460231.034728:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460231.034730:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788460231.035639:0:18719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788460231.035648:0:18719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007051c647/0x5dfa74784542c375 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.035658:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=528s v=(0 0) 00010000:00010000:3.0:1788460231.035668:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788460231.035673:0:18719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007051c647/0x5dfa74784542c375 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.035684:0:18719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007051c647/0x5dfa74784542c375 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.035692:0:18719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007051c647/0x5dfa74784542c375 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.035699:0:18719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007051c647/0x5dfa74784542c375 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.035717:0:18719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788460231.035728:0:18366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788460231.035732:0:18366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007051c647/0x5dfa74784542c375 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.035739:0:18366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc14f0200 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:3.0:1788460231.035742:0:18366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007051c647/0x5dfa74784542c375 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.035749:0:18366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007051c647/0x5dfa74784542c375 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.035761:0:18366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007051c647/0x5dfa74784542c375 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.035778:0:18366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007051c647/0x5dfa74784542c375 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460231.036125:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460231.036199:0:18366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460231.036202:0:18366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460231.036204:0:18366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788460231.037608:0:18719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788460231.037618:0:18719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005fc6d9b8/0x5dfa74784542c37c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460231.037632:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=528s v=(0 0) 00010000:00010000:2.0:1788460231.037636:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788460231.037643:0:18719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005fc6d9b8/0x5dfa74784542c37c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460231.037656:0:18719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005fc6d9b8/0x5dfa74784542c37c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460231.037673:0:18719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005fc6d9b8/0x5dfa74784542c37c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460231.037681:0:18719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005fc6d9b8/0x5dfa74784542c37c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460231.037704:0:18719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788460231.037776:0:17201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788460231.037783:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005fc6d9b8/0x5dfa74784542c37c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.037801:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bfadc7200 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:3.0:1788460231.037805:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005fc6d9b8/0x5dfa74784542c37c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.037814:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005fc6d9b8/0x5dfa74784542c37c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.037831:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005fc6d9b8/0x5dfa74784542c37c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.037838:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005fc6d9b8/0x5dfa74784542c37c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.037854:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460231.037856:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460231.037857:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788460231.038268:0:18719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788460231.038275:0:18719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047091879/0x5dfa74784542c383 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460231.038284:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=528s v=(0 0) 00010000:00010000:2.0:1788460231.038287:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788460231.038292:0:18719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000047091879/0x5dfa74784542c383 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460231.038303:0:18719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000047091879/0x5dfa74784542c383 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460231.038311:0:18719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000047091879/0x5dfa74784542c383 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460231.038319:0:18719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000047091879/0x5dfa74784542c383 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460231.038356:0:18719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788460231.038481:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788460231.038488:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000047091879/0x5dfa74784542c383 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.038496:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bfadc7a00 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:1.0:1788460231.038500:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000047091879/0x5dfa74784542c383 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.038508:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000047091879/0x5dfa74784542c383 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.038521:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000047091879/0x5dfa74784542c383 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.038527:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000047091879/0x5dfa74784542c383 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.038542:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460231.038543:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460231.038545:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788460231.038634:0:18719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788460231.038640:0:18719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006386c8a8/0x5dfa74784542c38a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460231.038649:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=528s v=(0 0) 00010000:00010000:2.0:1788460231.038652:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788460231.038656:0:18719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006386c8a8/0x5dfa74784542c38a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460231.038666:0:18719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006386c8a8/0x5dfa74784542c38a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460231.038673:0:18719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006386c8a8/0x5dfa74784542c38a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460231.038681:0:18719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006386c8a8/0x5dfa74784542c38a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460231.038705:0:18719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788460231.038811:0:18366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788460231.038817:0:18366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006386c8a8/0x5dfa74784542c38a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.038835:0:18366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac395fa00 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:1.0:1788460231.038839:0:18366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006386c8a8/0x5dfa74784542c38a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.038847:0:18366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006386c8a8/0x5dfa74784542c38a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.038859:0:18366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006386c8a8/0x5dfa74784542c38a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.038882:0:18366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006386c8a8/0x5dfa74784542c38a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.038897:0:18366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460231.038898:0:18366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460231.038900:0:18366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788460231.039738:0:18719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788460231.039747:0:18719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4c6f478/0x5dfa74784542c391 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.039759:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=528s v=(0 0) 00010000:00010000:3.0:1788460231.039763:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788460231.039768:0:18719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4c6f478/0x5dfa74784542c391 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.039779:0:18719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e4c6f478/0x5dfa74784542c391 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.039788:0:18719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4c6f478/0x5dfa74784542c391 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.039811:0:18719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e4c6f478/0x5dfa74784542c391 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.039829:0:18719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788460231.039839:0:17201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788460231.039843:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e4c6f478/0x5dfa74784542c391 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.039850:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc6ca6600 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:3.0:1788460231.039854:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4c6f478/0x5dfa74784542c391 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.039884:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4c6f478/0x5dfa74784542c391 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.039900:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e4c6f478/0x5dfa74784542c391 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.039909:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e4c6f478/0x5dfa74784542c391 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.039926:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460231.039928:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460231.039930:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788460231.041252:0:18719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788460231.041264:0:18719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000872557d4/0x5dfa74784542c398 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.041277:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=528s v=(0 0) 00010000:00010000:3.0:1788460231.041281:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788460231.041286:0:18719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000872557d4/0x5dfa74784542c398 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.041299:0:18719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000872557d4/0x5dfa74784542c398 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.041308:0:18719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000872557d4/0x5dfa74784542c398 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.041322:0:18719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000872557d4/0x5dfa74784542c398 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.041340:0:18719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788460231.041521:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788460231.041529:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000872557d4/0x5dfa74784542c398 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.041538:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc6ca6800 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:1.0:1788460231.041543:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000872557d4/0x5dfa74784542c398 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.041551:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000872557d4/0x5dfa74784542c398 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.041575:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000872557d4/0x5dfa74784542c398 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.041583:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000872557d4/0x5dfa74784542c398 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.041599:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460231.041601:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460231.041603:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788460231.042298:0:18719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788460231.042305:0:18719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005306a076/0x5dfa74784542c39f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.042315:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=528s v=(0 0) 00010000:00010000:1.0:1788460231.042319:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460231.042323:0:18719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005306a076/0x5dfa74784542c39f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.042332:0:18719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005306a076/0x5dfa74784542c39f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.042340:0:18719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005306a076/0x5dfa74784542c39f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.042346:0:18719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005306a076/0x5dfa74784542c39f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.042388:0:18719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788460231.043988:0:18366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788460231.044000:0:18366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005306a076/0x5dfa74784542c39f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.044012:0:18366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc6381400 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:3.0:1788460231.044018:0:18366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005306a076/0x5dfa74784542c39f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.044028:0:18366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005306a076/0x5dfa74784542c39f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.044046:0:18366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005306a076/0x5dfa74784542c39f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.044054:0:18366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005306a076/0x5dfa74784542c39f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.044076:0:18366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460231.044078:0:18366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460231.044079:0:18366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788460231.045226:0:18719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788460231.045244:0:18719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5fdbf5f/0x5dfa74784542c3a6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.045258:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=528s v=(0 0) 00010000:00010000:3.0:1788460231.045263:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788460231.045269:0:18719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5fdbf5f/0x5dfa74784542c3a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.045283:0:18719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5fdbf5f/0x5dfa74784542c3a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.045293:0:18719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5fdbf5f/0x5dfa74784542c3a6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.045302:0:18719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f5fdbf5f/0x5dfa74784542c3a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.045321:0:18719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788460231.045348:0:17201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788460231.045356:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5fdbf5f/0x5dfa74784542c3a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460231.045367:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc6ca7200 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:2.0:1788460231.045376:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5fdbf5f/0x5dfa74784542c3a6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460231.045387:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5fdbf5f/0x5dfa74784542c3a6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460231.045403:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5fdbf5f/0x5dfa74784542c3a6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460231.045412:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5fdbf5f/0x5dfa74784542c3a6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460231.045431:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460231.045433:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460231.045435:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788460231.049334:0:18719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788460231.049347:0:18719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dee93afb/0x5dfa74784542c3ad lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.049369:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=528s v=(0 0) 00010000:00010000:1.0:1788460231.049374:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460231.049380:0:18719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dee93afb/0x5dfa74784542c3ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.049394:0:18719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dee93afb/0x5dfa74784542c3ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.049405:0:18719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dee93afb/0x5dfa74784542c3ad lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.049414:0:18719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dee93afb/0x5dfa74784542c3ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.049441:0:18719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788460231.050055:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788460231.050063:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dee93afb/0x5dfa74784542c3ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.050073:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc6381800 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:3.0:1788460231.050077:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dee93afb/0x5dfa74784542c3ad lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.050086:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dee93afb/0x5dfa74784542c3ad lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.050110:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dee93afb/0x5dfa74784542c3ad lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.050118:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dee93afb/0x5dfa74784542c3ad lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.050136:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460231.050139:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460231.050140:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788460231.051662:0:18719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788460231.051672:0:18719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003583f3e3/0x5dfa74784542c3b4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.051686:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=528s v=(0 0) 00010000:00010000:3.0:1788460231.051691:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788460231.051701:0:18719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003583f3e3/0x5dfa74784542c3b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.051714:0:18719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003583f3e3/0x5dfa74784542c3b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.051722:0:18719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003583f3e3/0x5dfa74784542c3b4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.051730:0:18719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003583f3e3/0x5dfa74784542c3b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.051759:0:18719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788460231.051960:0:18366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788460231.051976:0:18366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003583f3e3/0x5dfa74784542c3b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.051984:0:18366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc6ca6400 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:3.0:1788460231.051988:0:18366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003583f3e3/0x5dfa74784542c3b4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.051996:0:18366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003583f3e3/0x5dfa74784542c3b4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.052011:0:18366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003583f3e3/0x5dfa74784542c3b4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.052018:0:18366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003583f3e3/0x5dfa74784542c3b4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.052033:0:18366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460231.052034:0:18366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460231.052036:0:18366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788460231.053127:0:18720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788460231.053136:0:18720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b4a22ed/0x5dfa74784542c3bb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.053149:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=528s v=(0 0) 00010000:00010000:1.0:1788460231.053162:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460231.053168:0:18720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b4a22ed/0x5dfa74784542c3bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.053184:0:18720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b4a22ed/0x5dfa74784542c3bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.053193:0:18720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b4a22ed/0x5dfa74784542c3bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.053202:0:18720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001b4a22ed/0x5dfa74784542c3bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.053220:0:18720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788460231.053230:0:17201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788460231.053236:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001b4a22ed/0x5dfa74784542c3bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.053243:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc6380a00 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:1.0:1788460231.053246:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001b4a22ed/0x5dfa74784542c3bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.053254:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001b4a22ed/0x5dfa74784542c3bb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.053268:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001b4a22ed/0x5dfa74784542c3bb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.053287:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b4a22ed/0x5dfa74784542c3bb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.053306:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460231.053309:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460231.053312:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788460231.053515:0:18719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788460231.053521:0:18719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000494bf4c2/0x5dfa74784542c3c2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.053530:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=528s v=(0 0) 00010000:00010000:1.0:1788460231.053534:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460231.053538:0:18719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000494bf4c2/0x5dfa74784542c3c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.053550:0:18719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000494bf4c2/0x5dfa74784542c3c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.053559:0:18719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000494bf4c2/0x5dfa74784542c3c2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.053566:0:18719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000494bf4c2/0x5dfa74784542c3c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.053582:0:18719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788460231.053707:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788460231.053719:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000494bf4c2/0x5dfa74784542c3c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.053727:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc6380e00 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:1.0:1788460231.053729:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000494bf4c2/0x5dfa74784542c3c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.053737:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000494bf4c2/0x5dfa74784542c3c2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.053749:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000494bf4c2/0x5dfa74784542c3c2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.053756:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000494bf4c2/0x5dfa74784542c3c2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.053771:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460231.053773:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460231.053775:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788460231.057076:0:18719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788460231.057088:0:18719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d77c189/0x5dfa74784542c3c9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.057105:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=528s v=(0 0) 00010000:00010000:1.0:1788460231.057110:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460231.057116:0:18719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d77c189/0x5dfa74784542c3c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.057143:0:18719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009d77c189/0x5dfa74784542c3c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.057153:0:18719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d77c189/0x5dfa74784542c3c9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.057160:0:18719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009d77c189/0x5dfa74784542c3c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.057185:0:18719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788460231.057216:0:18366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788460231.057224:0:18366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009d77c189/0x5dfa74784542c3c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.057234:0:18366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc6380000 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:3.0:1788460231.057245:0:18366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009d77c189/0x5dfa74784542c3c9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.057255:0:18366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009d77c189/0x5dfa74784542c3c9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.057274:0:18366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009d77c189/0x5dfa74784542c3c9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.057282:0:18366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d77c189/0x5dfa74784542c3c9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.057302:0:18366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460231.057305:0:18366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460231.057307:0:18366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788460231.057431:0:18720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788460231.057438:0:18720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca5ac227/0x5dfa74784542c3d0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.057446:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=528s v=(0 0) 00010000:00010000:0.0:1788460231.057449:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460231.057453:0:18720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca5ac227/0x5dfa74784542c3d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.057470:0:18720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ca5ac227/0x5dfa74784542c3d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.057478:0:18720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca5ac227/0x5dfa74784542c3d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.057485:0:18720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ca5ac227/0x5dfa74784542c3d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.057505:0:18720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788460231.058203:0:18720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788460231.058210:0:18720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eab84463/0x5dfa74784542c3d7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.058221:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=528s v=(0 0) 00010000:00010000:0.0:1788460231.058224:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460231.058228:0:18720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eab84463/0x5dfa74784542c3d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.058238:0:18720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eab84463/0x5dfa74784542c3d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.058247:0:18720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eab84463/0x5dfa74784542c3d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.058266:0:18720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eab84463/0x5dfa74784542c3d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.058289:0:18720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788460231.058326:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788460231.058334:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ca5ac227/0x5dfa74784542c3d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.058342:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc2bd5e00 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:3.0:1788460231.058345:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca5ac227/0x5dfa74784542c3d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.058354:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca5ac227/0x5dfa74784542c3d0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.058375:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ca5ac227/0x5dfa74784542c3d0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.058390:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ca5ac227/0x5dfa74784542c3d0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.058409:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788460231.058413:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eab84463/0x5dfa74784542c3d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.058419:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc2bd5200 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:3.0:1788460231.058422:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eab84463/0x5dfa74784542c3d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.058431:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eab84463/0x5dfa74784542c3d7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.058442:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eab84463/0x5dfa74784542c3d7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.058450:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eab84463/0x5dfa74784542c3d7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.058462:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460231.058464:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460231.058466:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460231.058659:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788460231.058714:0:18719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788460231.058720:0:18719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000918dc5cd/0x5dfa74784542c3de lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.058735:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=528s v=(0 0) 00010000:00010000:3.0:1788460231.058739:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788460231.058744:0:18719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000918dc5cd/0x5dfa74784542c3de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.058755:0:18719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000918dc5cd/0x5dfa74784542c3de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.058764:0:18719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000918dc5cd/0x5dfa74784542c3de lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.058773:0:18719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000918dc5cd/0x5dfa74784542c3de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.058788:0:18719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788460231.059030:0:18719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788460231.059037:0:18719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ff9272d/0x5dfa74784542c3e5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.059046:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=528s v=(0 0) 00010000:00010000:3.0:1788460231.059050:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788460231.059054:0:18719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ff9272d/0x5dfa74784542c3e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.059064:0:18719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003ff9272d/0x5dfa74784542c3e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.059161:0:18719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ff9272d/0x5dfa74784542c3e5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.059170:0:18719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003ff9272d/0x5dfa74784542c3e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.059195:0:18719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788460231.059493:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788460231.059501:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000918dc5cd/0x5dfa74784542c3de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.059509:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc6ca7000 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:1.0:1788460231.059513:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000918dc5cd/0x5dfa74784542c3de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.059523:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000918dc5cd/0x5dfa74784542c3de lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.059538:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000918dc5cd/0x5dfa74784542c3de lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.059555:0:18366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788460231.059557:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000918dc5cd/0x5dfa74784542c3de lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.059562:0:18366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003ff9272d/0x5dfa74784542c3e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.059575:0:18366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc6ca7c00 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:0.0:1788460231.059578:0:18366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003ff9272d/0x5dfa74784542c3e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.059582:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460231.059587:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460231.059589:0:18366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003ff9272d/0x5dfa74784542c3e5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.059590:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460231.059607:0:18366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003ff9272d/0x5dfa74784542c3e5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.059614:0:18366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ff9272d/0x5dfa74784542c3e5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.059629:0:18366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460231.059631:0:18366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460231.059632:0:18366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788460231.059674:0:18720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788460231.059687:0:18720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090cef8b9/0x5dfa74784542c3ec lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.059696:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=528s v=(0 0) 00010000:00010000:0.0:1788460231.059699:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460231.059704:0:18720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090cef8b9/0x5dfa74784542c3ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.059714:0:18720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000090cef8b9/0x5dfa74784542c3ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.059722:0:18720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090cef8b9/0x5dfa74784542c3ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.059728:0:18720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000090cef8b9/0x5dfa74784542c3ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.059742:0:18720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788460231.060171:0:17201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788460231.060177:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000090cef8b9/0x5dfa74784542c3ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.060187:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc2bd4000 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:1.0:1788460231.060191:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000090cef8b9/0x5dfa74784542c3ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.060201:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000090cef8b9/0x5dfa74784542c3ec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.060214:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000090cef8b9/0x5dfa74784542c3ec lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.060222:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000090cef8b9/0x5dfa74784542c3ec lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.060238:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460231.060240:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460231.060242:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788460231.060484:0:18719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788460231.060490:0:18719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc96185f/0x5dfa74784542c3f3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.060498:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=528s v=(0 0) 00010000:00010000:0.0:1788460231.060501:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460231.060506:0:18719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc96185f/0x5dfa74784542c3f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.060514:0:18719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cc96185f/0x5dfa74784542c3f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.060529:0:18719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc96185f/0x5dfa74784542c3f3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.060537:0:18719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cc96185f/0x5dfa74784542c3f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.060557:0:18719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788460231.062016:0:18719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788460231.062024:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788460231.062026:0:18719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b06a6a8/0x5dfa74784542c3fa lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.062033:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cc96185f/0x5dfa74784542c3f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.062044:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=528s v=(0 0) 00010000:00010000:1.0:1788460231.062046:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc2bd4a00 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:1.0:1788460231.062052:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc96185f/0x5dfa74784542c3f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.062053:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460231.062065:0:18719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b06a6a8/0x5dfa74784542c3fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.062068:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc96185f/0x5dfa74784542c3f3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.062089:0:18719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b06a6a8/0x5dfa74784542c3fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.062095:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cc96185f/0x5dfa74784542c3f3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.062103:0:18719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b06a6a8/0x5dfa74784542c3fa lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.062106:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cc96185f/0x5dfa74784542c3f3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.062125:0:18719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008b06a6a8/0x5dfa74784542c3fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.062134:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460231.062137:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460231.062139:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460231.062159:0:18719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788460231.062195:0:18366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788460231.062201:0:18366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008b06a6a8/0x5dfa74784542c3fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788460231.062204:0:18720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788460231.062215:0:18720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000494bf4c2/0x5dfa74784542c401 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.062215:0:18366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc2bd5400 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:0.0:1788460231.062221:0:18366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008b06a6a8/0x5dfa74784542c3fa lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.062231:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=528s v=(0 0) 00010000:00010000:0.0:1788460231.062236:0:18366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008b06a6a8/0x5dfa74784542c3fa lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.062237:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460231.062246:0:18720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000494bf4c2/0x5dfa74784542c401 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.062257:0:18366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008b06a6a8/0x5dfa74784542c3fa lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.062279:0:18366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b06a6a8/0x5dfa74784542c3fa lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.062282:0:18720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000494bf4c2/0x5dfa74784542c401 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.062296:0:18720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000494bf4c2/0x5dfa74784542c401 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.062297:0:18366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460231.062301:0:18366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460231.062304:0:18366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460231.062310:0:18720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000494bf4c2/0x5dfa74784542c401 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.062604:0:18720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788460231.063207:0:18720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788460231.063215:0:18720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b4a22ed/0x5dfa74784542c408 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.063228:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=528s v=(0 0) 00010000:00010000:1.0:1788460231.063232:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460231.063237:0:18720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b4a22ed/0x5dfa74784542c408 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.063247:0:18720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b4a22ed/0x5dfa74784542c408 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.063256:0:18720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b4a22ed/0x5dfa74784542c408 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.063276:0:18720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001b4a22ed/0x5dfa74784542c408 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.063292:0:18720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788460231.063301:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788460231.063306:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000494bf4c2/0x5dfa74784542c401 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.063314:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc6380e00 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:1.0:1788460231.063319:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000494bf4c2/0x5dfa74784542c401 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.063329:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000494bf4c2/0x5dfa74784542c401 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.063344:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000494bf4c2/0x5dfa74784542c401 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.063353:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000494bf4c2/0x5dfa74784542c401 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.063370:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788460231.063374:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001b4a22ed/0x5dfa74784542c408 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.063394:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc6380a00 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:1.0:1788460231.063398:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001b4a22ed/0x5dfa74784542c408 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.063407:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001b4a22ed/0x5dfa74784542c408 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.063419:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001b4a22ed/0x5dfa74784542c408 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.063427:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b4a22ed/0x5dfa74784542c408 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.063445:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460231.063447:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460231.063450:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788460231.064144:0:18719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788460231.064151:0:18719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f084e7fc/0x5dfa74784542c40f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.064161:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=528s v=(0 0) 00010000:00010000:1.0:1788460231.064165:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460231.064169:0:18719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f084e7fc/0x5dfa74784542c40f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.064179:0:18719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f084e7fc/0x5dfa74784542c40f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.064194:0:18719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f084e7fc/0x5dfa74784542c40f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.064201:0:18719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f084e7fc/0x5dfa74784542c40f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.064216:0:18719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788460231.064243:0:18366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788460231.064248:0:18366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f084e7fc/0x5dfa74784542c40f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.064256:0:18366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc6380c00 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:1.0:1788460231.064260:0:18366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f084e7fc/0x5dfa74784542c40f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.064267:0:18366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f084e7fc/0x5dfa74784542c40f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.064280:0:18366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f084e7fc/0x5dfa74784542c40f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.064286:0:18366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f084e7fc/0x5dfa74784542c40f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.064300:0:18366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460231.064308:0:18366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460231.064310:0:18366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788460231.064346:0:18720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788460231.064352:0:18720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001386db2d/0x5dfa74784542c416 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.064359:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=528s v=(0 0) 00010000:00010000:1.0:1788460231.064362:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460231.064366:0:18720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001386db2d/0x5dfa74784542c416 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.064375:0:18720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001386db2d/0x5dfa74784542c416 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.064383:0:18720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001386db2d/0x5dfa74784542c416 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.064390:0:18720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001386db2d/0x5dfa74784542c416 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.064404:0:18720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788460231.064410:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788460231.064414:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001386db2d/0x5dfa74784542c416 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.064421:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc6381e00 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:1.0:1788460231.064424:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001386db2d/0x5dfa74784542c416 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.064442:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001386db2d/0x5dfa74784542c416 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.064452:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001386db2d/0x5dfa74784542c416 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.064459:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001386db2d/0x5dfa74784542c416 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.064472:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460231.064473:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460231.064475:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460231.066148:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788460231.066653:0:18720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788460231.066663:0:18720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f737b230/0x5dfa74784542c41d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.066691:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=528s v=(0 0) 00010000:00010000:0.0:1788460231.066696:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460231.066701:0:18720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f737b230/0x5dfa74784542c41d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.066715:0:18720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f737b230/0x5dfa74784542c41d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.066725:0:18720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f737b230/0x5dfa74784542c41d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.066733:0:18720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f737b230/0x5dfa74784542c41d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.066786:0:18720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788460231.067292:0:18720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788460231.067299:0:18720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7e9326d/0x5dfa74784542c424 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.067308:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=528s v=(0 0) 00010000:00010000:0.0:1788460231.067311:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460231.067315:0:18720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7e9326d/0x5dfa74784542c424 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.067325:0:18720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7e9326d/0x5dfa74784542c424 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.067345:0:18720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7e9326d/0x5dfa74784542c424 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.067352:0:18720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f7e9326d/0x5dfa74784542c424 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.067398:0:18366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788460231.067406:0:18366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f737b230/0x5dfa74784542c41d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.067414:0:18366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc2bd4400 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:1.0:1788460231.067419:0:18366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f737b230/0x5dfa74784542c41d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.067428:0:18366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f737b230/0x5dfa74784542c41d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.067445:0:18366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f737b230/0x5dfa74784542c41d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.067463:0:18366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f737b230/0x5dfa74784542c41d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.067479:0:18366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788460231.067482:0:18366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f7e9326d/0x5dfa74784542c424 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.067489:0:18366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc2bd4800 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:1.0:1788460231.067492:0:18366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7e9326d/0x5dfa74784542c424 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.067500:0:18366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7e9326d/0x5dfa74784542c424 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.067520:0:18366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f7e9326d/0x5dfa74784542c424 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.067536:0:18366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460231.067538:0:18366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460231.067541:0:18366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460231.067712:0:18720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788460231.067718:0:18720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7e9326d/0x5dfa74784542c424 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788460231.068963:0:18720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788460231.068971:0:18720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2354787/0x5dfa74784542c42b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.068984:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=528s v=(0 0) 00010000:00010000:0.0:1788460231.068988:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460231.068993:0:18720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2354787/0x5dfa74784542c42b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.069004:0:18720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2354787/0x5dfa74784542c42b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.069013:0:18720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2354787/0x5dfa74784542c42b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.069032:0:18720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2354787/0x5dfa74784542c42b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.069369:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788460231.069377:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2354787/0x5dfa74784542c42b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.069385:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc2bd4600 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:1.0:1788460231.069396:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2354787/0x5dfa74784542c42b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.069405:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2354787/0x5dfa74784542c42b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.069420:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2354787/0x5dfa74784542c42b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.069429:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460231.069431:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460231.069432:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460231.069527:0:18720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788460231.069541:0:18720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2354787/0x5dfa74784542c42b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788460231.069920:0:18719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788460231.069927:0:18719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009086f0a5/0x5dfa74784542c432 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460231.069937:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=528s v=(0 0) 00010000:00010000:2.0:1788460231.069968:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788460231.069975:0:18719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009086f0a5/0x5dfa74784542c432 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460231.069988:0:18719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009086f0a5/0x5dfa74784542c432 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460231.069998:0:18719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009086f0a5/0x5dfa74784542c432 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460231.070014:0:18719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009086f0a5/0x5dfa74784542c432 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788460231.070529:0:18720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000001:00080000:3.0:1788460231.070537:0:19533:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00010000:00010000:0.0:1788460231.070538:0:18720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b06a6a8/0x5dfa74784542c439 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.070551:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=528s v=(0 0) 00010000:00010000:0.0:1788460231.070555:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460231.070560:0:18720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b06a6a8/0x5dfa74784542c439 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:3.0:1788460231.070566:0:19533:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00010000:00010000:0.0:1788460231.070571:0:18720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b06a6a8/0x5dfa74784542c439 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:3.0:1788460231.070572:0:19533:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1788460231.070584:0:18720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b06a6a8/0x5dfa74784542c439 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.070593:0:18720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b06a6a8/0x5dfa74784542c439 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.070763:0:17201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788460231.070770:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009086f0a5/0x5dfa74784542c432 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.070778:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac395e600 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:1.0:1788460231.070782:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009086f0a5/0x5dfa74784542c432 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.070803:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009086f0a5/0x5dfa74784542c432 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.070818:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009086f0a5/0x5dfa74784542c432 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.070827:0:17201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788460231.070879:0:18719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788460231.070885:0:18719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009086f0a5/0x5dfa74784542c432 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460231.070908:0:18366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460231.071041:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b06a6a8/0x5dfa74784542c439 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.071049:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc2bd5400 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:1.0:1788460231.071053:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b06a6a8/0x5dfa74784542c439 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.071062:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b06a6a8/0x5dfa74784542c439 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.071075:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b06a6a8/0x5dfa74784542c439 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.071083:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460231.071086:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460231.071089:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460231.071272:0:18720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00002000:00010000:2.0:1788460231.071278:0:18719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788460231.071278:0:18720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b06a6a8/0x5dfa74784542c439 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460231.071290:0:18719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000788ebb20/0x5dfa74784542c440 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460231.071302:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=528s v=(0 0) 00010000:00010000:2.0:1788460231.071305:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788460231.071310:0:18719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000788ebb20/0x5dfa74784542c440 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460231.071323:0:18719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000788ebb20/0x5dfa74784542c440 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460231.071332:0:18719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000788ebb20/0x5dfa74784542c440 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460231.071341:0:18719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000788ebb20/0x5dfa74784542c440 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460231.071368:0:18719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788460231.071452:0:18366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788460231.071458:0:18366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000788ebb20/0x5dfa74784542c440 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460231.071466:0:18366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac395fc00 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:2.0:1788460231.071469:0:18366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000788ebb20/0x5dfa74784542c440 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460231.071478:0:18366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000788ebb20/0x5dfa74784542c440 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460231.071489:0:18366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000788ebb20/0x5dfa74784542c440 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460231.071497:0:18366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000788ebb20/0x5dfa74784542c440 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460231.071510:0:18366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460231.071512:0:18366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460231.071514:0:18366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460231.071704:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460231.071715:0:18717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac383bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:17956:x1875336022402816:12345-0@lo:5:osp-pre-1-1.0 Request processed in 55449us (55576us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788460231.071726:0:18717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788460231.071778:0:17956:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00002000:00010000:0.0:1788460231.071785:0:18720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00100000:3.0:1788460231.071787:0:17956:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac383a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17956:1875336022402816:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1788460231.071875:0:17956:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1788460231.071921:0:17956:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4284700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17956:1875336022402944:0@lo:900:osp-pre-1-1.0 00000100:00100000:3.0:1788460231.071973:0:17956:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460231.071998:0:17956:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc52c19c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788460231.072061:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022402944 00000100:00100000:1.0:1788460231.072068:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022402944 00000100:00100000:1.0:1788460231.072106:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788460231.072113:0:17222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4286680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17956:x1875336022402944:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1788460231.072163:0:17222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4286680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17956:x1875336022402944:12345-0@lo:900:osp-pre-1-1.0 Request processed in 50us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460231.072170:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1788460231.072244:0:18720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc96185f/0x5dfa74784542c447 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.072254:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=528s v=(0 0) 00010000:00010000:0.0:1788460231.072257:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460231.072263:0:18720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc96185f/0x5dfa74784542c447 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.072273:0:18720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc96185f/0x5dfa74784542c447 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.072282:0:18720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc96185f/0x5dfa74784542c447 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.072290:0:18720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cc96185f/0x5dfa74784542c447 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.072347:0:18720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:3.0:1788460231.072390:0:17956:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac4284700 x1875336022402944/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788460247 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460231.072402:0:17956:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4284700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17956:1875336022402944:0@lo:900:osp-pre-1-1.0 00002000:00010000:0.0:1788460231.072820:0:18720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788460231.072827:0:18720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090cef8b9/0x5dfa74784542c44e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.072853:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=528s v=(0 0) 00010000:00010000:0.0:1788460231.072856:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460231.072860:0:18720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090cef8b9/0x5dfa74784542c44e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.072881:0:18720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000090cef8b9/0x5dfa74784542c44e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.072890:0:18720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090cef8b9/0x5dfa74784542c44e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.072897:0:18720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000090cef8b9/0x5dfa74784542c44e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.073244:0:17201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788460231.073251:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cc96185f/0x5dfa74784542c447 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.073270:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc2bd4a00 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:1.0:1788460231.073274:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc96185f/0x5dfa74784542c447 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.073282:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc96185f/0x5dfa74784542c447 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.073298:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cc96185f/0x5dfa74784542c447 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.073304:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc96185f/0x5dfa74784542c447 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.073319:0:17201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788460231.073322:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000090cef8b9/0x5dfa74784542c44e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.073328:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc2bd4000 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:1.0:1788460231.073331:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000090cef8b9/0x5dfa74784542c44e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.073339:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000090cef8b9/0x5dfa74784542c44e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.073349:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000090cef8b9/0x5dfa74784542c44e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.073364:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460231.073366:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460231.073368:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460231.073424:0:18720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788460231.073429:0:18720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000090cef8b9/0x5dfa74784542c44e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788460231.073961:0:18719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788460231.073969:0:18719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c8b0b18/0x5dfa74784542c455 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460231.073981:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=528s v=(0 0) 00010000:00010000:2.0:1788460231.073990:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788460231.073996:0:18719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c8b0b18/0x5dfa74784542c455 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460231.074008:0:18719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c8b0b18/0x5dfa74784542c455 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460231.074018:0:18719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c8b0b18/0x5dfa74784542c455 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460231.074026:0:18719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c8b0b18/0x5dfa74784542c455 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460231.074043:0:18719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788460231.074185:0:18366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788460231.074191:0:18366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c8b0b18/0x5dfa74784542c455 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460231.074200:0:18366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac395ee00 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:2.0:1788460231.074204:0:18366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c8b0b18/0x5dfa74784542c455 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460231.074213:0:18366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c8b0b18/0x5dfa74784542c455 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460231.074227:0:18366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c8b0b18/0x5dfa74784542c455 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460231.074247:0:18366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c8b0b18/0x5dfa74784542c455 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460231.074265:0:18366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460231.074267:0:18366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460231.074268:0:18366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460231.074693:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788460231.075683:0:18720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788460231.075693:0:18720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7e9326d/0x5dfa74784542c45c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.075709:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=528s v=(0 0) 00010000:00010000:0.0:1788460231.075713:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460231.075719:0:18720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7e9326d/0x5dfa74784542c45c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.075743:0:18720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7e9326d/0x5dfa74784542c45c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.075753:0:18720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7e9326d/0x5dfa74784542c45c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.075761:0:18720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f7e9326d/0x5dfa74784542c45c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.076042:0:18720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788460231.076399:0:18720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788460231.076406:0:18720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eab84463/0x5dfa74784542c463 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.076416:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=528s v=(0 0) 00010000:00010000:0.0:1788460231.076419:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460231.076424:0:18720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eab84463/0x5dfa74784542c463 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.076434:0:18720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eab84463/0x5dfa74784542c463 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.076442:0:18720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eab84463/0x5dfa74784542c463 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.076460:0:18720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eab84463/0x5dfa74784542c463 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.076637:0:17201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788460231.076646:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f7e9326d/0x5dfa74784542c45c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.076656:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc2bd4800 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:1.0:1788460231.076661:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7e9326d/0x5dfa74784542c45c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.076671:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7e9326d/0x5dfa74784542c45c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.076690:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f7e9326d/0x5dfa74784542c45c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.076699:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7e9326d/0x5dfa74784542c45c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.076718:0:17201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788460231.076722:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eab84463/0x5dfa74784542c463 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.076729:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc2bd5200 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:1.0:1788460231.076743:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eab84463/0x5dfa74784542c463 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.076752:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eab84463/0x5dfa74784542c463 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.076764:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eab84463/0x5dfa74784542c463 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.076772:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460231.076774:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460231.076777:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460231.077070:0:18366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460231.077124:0:18720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788460231.077131:0:18720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eab84463/0x5dfa74784542c463 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788460231.077506:0:18720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788460231.077525:0:18720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca5ac227/0x5dfa74784542c46a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.077544:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=528s v=(0 0) 00010000:00010000:0.0:1788460231.077548:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460231.077554:0:18720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca5ac227/0x5dfa74784542c46a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.077565:0:18720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ca5ac227/0x5dfa74784542c46a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.077574:0:18720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca5ac227/0x5dfa74784542c46a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.077582:0:18720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ca5ac227/0x5dfa74784542c46a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.077611:0:18720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788460231.077962:0:18719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788460231.077974:0:18719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003583f3e3/0x5dfa74784542c471 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.077984:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=528s v=(0 0) 00010000:00010000:3.0:1788460231.077988:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788460231.077992:0:18719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003583f3e3/0x5dfa74784542c471 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.078003:0:18719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003583f3e3/0x5dfa74784542c471 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.078012:0:18719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003583f3e3/0x5dfa74784542c471 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.078020:0:18719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003583f3e3/0x5dfa74784542c471 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.078036:0:18719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788460231.078105:0:17201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788460231.078111:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ca5ac227/0x5dfa74784542c46a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.078120:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc2bd5e00 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:0.0:1788460231.078124:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca5ac227/0x5dfa74784542c46a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.078133:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca5ac227/0x5dfa74784542c46a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.078148:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ca5ac227/0x5dfa74784542c46a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.078157:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ca5ac227/0x5dfa74784542c46a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.078173:0:17201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788460231.078177:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003583f3e3/0x5dfa74784542c471 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.078184:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc6ca6400 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:0.0:1788460231.078188:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003583f3e3/0x5dfa74784542c471 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.078210:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003583f3e3/0x5dfa74784542c471 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.078222:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003583f3e3/0x5dfa74784542c471 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.078230:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003583f3e3/0x5dfa74784542c471 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.078246:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460231.078247:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460231.078250:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788460231.078300:0:18720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788460231.078307:0:18720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b97a320d/0x5dfa74784542c478 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.078316:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=528s v=(0 0) 00010000:00010000:0.0:1788460231.078319:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460231.078324:0:18720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b97a320d/0x5dfa74784542c478 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.078334:0:18720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b97a320d/0x5dfa74784542c478 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.078342:0:18720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b97a320d/0x5dfa74784542c478 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.078358:0:18720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b97a320d/0x5dfa74784542c478 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.078381:0:18720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788460231.078907:0:18366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788460231.078913:0:18366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b97a320d/0x5dfa74784542c478 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.078922:0:18366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc2bd4200 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:3.0:1788460231.078926:0:18366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b97a320d/0x5dfa74784542c478 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.078935:0:18366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b97a320d/0x5dfa74784542c478 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788460231.079061:0:18720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788460231.079068:0:18720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ecd5c5d2/0x5dfa74784542c47f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.079077:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=528s v=(0 0) 00010000:00010000:0.0:1788460231.079080:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460231.079085:0:18720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ecd5c5d2/0x5dfa74784542c47f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.079095:0:18720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ecd5c5d2/0x5dfa74784542c47f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.079102:0:18720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ecd5c5d2/0x5dfa74784542c47f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.079108:0:18720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ecd5c5d2/0x5dfa74784542c47f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.079122:0:18720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788460231.079129:0:17201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788460231.079133:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ecd5c5d2/0x5dfa74784542c47f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.079146:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc2bd5000 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:0.0:1788460231.079149:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ecd5c5d2/0x5dfa74784542c47f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.079158:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ecd5c5d2/0x5dfa74784542c47f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.079171:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ecd5c5d2/0x5dfa74784542c47f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.079178:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ecd5c5d2/0x5dfa74784542c47f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.079192:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460231.079194:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460231.079196:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788460231.079476:0:18720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788460231.079482:0:18720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2eb596f/0x5dfa74784542c486 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.079491:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=528s v=(0 0) 00010000:00010000:0.0:1788460231.079494:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460231.079498:0:18720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2eb596f/0x5dfa74784542c486 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.079632:0:18720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f2eb596f/0x5dfa74784542c486 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.079648:0:18720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2eb596f/0x5dfa74784542c486 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.079656:0:18720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f2eb596f/0x5dfa74784542c486 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.079671:0:18720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788460231.079680:0:17201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788460231.079684:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f2eb596f/0x5dfa74784542c486 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.079691:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bef209200 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:0.0:1788460231.079695:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2eb596f/0x5dfa74784542c486 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.079704:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2eb596f/0x5dfa74784542c486 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.079716:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f2eb596f/0x5dfa74784542c486 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.079724:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f2eb596f/0x5dfa74784542c486 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.079739:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460231.079748:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460231.079751:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460231.079843:0:18366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b97a320d/0x5dfa74784542c478 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.079851:0:18366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b97a320d/0x5dfa74784542c478 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.079878:0:18366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460231.079880:0:18366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460231.079881:0:18366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788460231.079930:0:18719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788460231.079937:0:18719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4c6f478/0x5dfa74784542c48d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.079964:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=528s v=(0 0) 00010000:00010000:3.0:1788460231.079968:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788460231.079973:0:18719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e4c6f478/0x5dfa74784542c48d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.079984:0:18719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e4c6f478/0x5dfa74784542c48d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.079993:0:18719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e4c6f478/0x5dfa74784542c48d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.080001:0:18719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e4c6f478/0x5dfa74784542c48d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.080027:0:18719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788460231.080126:0:17201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788460231.080131:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e4c6f478/0x5dfa74784542c48d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.080138:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc6ca6600 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:3.0:1788460231.080141:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4c6f478/0x5dfa74784542c48d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.080150:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e4c6f478/0x5dfa74784542c48d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.080162:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e4c6f478/0x5dfa74784542c48d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.080169:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e4c6f478/0x5dfa74784542c48d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.080182:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460231.080184:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460231.080185:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788460231.080247:0:18719:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788460231.080254:0:18719:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa4589e5/0x5dfa74784542c494 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.080263:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=528s v=(0 0) 00010000:00010000:3.0:1788460231.080272:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00002000:00010000:0.0:1788460231.080273:0:18720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788460231.080280:0:18719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa4589e5/0x5dfa74784542c494 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.080283:0:18720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000041f2c757/0x5dfa74784542c49b lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.080302:0:18719:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aa4589e5/0x5dfa74784542c494 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.080302:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=528s v=(0 0) 00010000:00010000:0.0:1788460231.080310:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460231.080320:0:18720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000041f2c757/0x5dfa74784542c49b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.080322:0:18719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa4589e5/0x5dfa74784542c494 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.080335:0:18720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000041f2c757/0x5dfa74784542c49b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.080350:0:18719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aa4589e5/0x5dfa74784542c494 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.080353:0:18720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000041f2c757/0x5dfa74784542c49b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460231.080371:0:18720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000041f2c757/0x5dfa74784542c49b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.080377:0:18719:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788460231.080387:0:18720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00080000:3.0:1788460231.080414:0:18719:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00000100:00100000:3.0:1788460231.080500:0:18719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4285880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:17238:x1875336022402048:12345-0@lo:5:osp-pre-1-0.0 Request processed in 73696us (74441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460231.080510:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788460231.080567:0:17238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e0000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17238:1875336022402048:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788460231.080582:0:17238:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:3.0:1788460231.080623:0:17238:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4284700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17238:1875336022403072:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788460231.080654:0:17238:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460231.080686:0:17238:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bd1c90180 going to sleep for 11 seconds 00010000:00010000:1.0:1788460231.080699:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788460231.080701:0:17201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788460231.080708:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aa4589e5/0x5dfa74784542c494 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.080709:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000041f2c757/0x5dfa74784542c49b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.080730:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc6ca7600 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:1.0:1788460231.080734:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa4589e5/0x5dfa74784542c494 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.080754:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bef208800 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:1.0:1788460231.080757:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa4589e5/0x5dfa74784542c494 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.080760:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000041f2c757/0x5dfa74784542c49b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.080782:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000041f2c757/0x5dfa74784542c49b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.080783:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aa4589e5/0x5dfa74784542c494 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.080799:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000041f2c757/0x5dfa74784542c49b lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.080805:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aa4589e5/0x5dfa74784542c494 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.080810:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000041f2c757/0x5dfa74784542c49b lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.080840:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460231.080843:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460231.080845:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460231.080850:0:18366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460231.081178:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460231.081181:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460231.081183:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788460231.081305:0:19708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022403072 00000100:00100000:0.0:1788460231.081313:0:19708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022403072 00000100:00100000:0.0:1788460231.081362:0:19708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788460231.081372:0:19708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4287100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:17238:x1875336022403072:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1788460231.081416:0:19708:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00002000:00010000:1.0:1788460231.085756:0:18720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788460231.085768:0:18720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001386db2d/0x5dfa74784542c4a2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.085784:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=528s v=(0 0) 00010000:00010000:1.0:1788460231.085789:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460231.085795:0:18720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001386db2d/0x5dfa74784542c4a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.085809:0:18720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001386db2d/0x5dfa74784542c4a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.085819:0:18720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001386db2d/0x5dfa74784542c4a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.085828:0:18720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001386db2d/0x5dfa74784542c4a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.085876:0:18720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788460231.085918:0:17201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788460231.085928:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001386db2d/0x5dfa74784542c4a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.085937:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc6381e00 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:3.0:1788460231.085963:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001386db2d/0x5dfa74784542c4a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.085974:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001386db2d/0x5dfa74784542c4a2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.086001:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001386db2d/0x5dfa74784542c4a2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.086021:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001386db2d/0x5dfa74784542c4a2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.086041:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460231.086043:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460231.086045:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788460231.087516:0:19708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4287100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:17238:x1875336022403072:12345-0@lo:5:osp-pre-1-0.0 Request processed in 6133us (6849us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1788460231.087537:0:19708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788460231.087767:0:17238:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4284700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17238:1875336022403072:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788460231.087784:0:17238:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00002000:00010000:1.0:1788460231.087917:0:18720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788460231.087925:0:18720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f084e7fc/0x5dfa74784542c4a9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.087979:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=528s v=(0 0) 00010000:00010000:1.0:1788460231.087983:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460231.087989:0:18720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f084e7fc/0x5dfa74784542c4a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.088001:0:18720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f084e7fc/0x5dfa74784542c4a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.088011:0:18720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f084e7fc/0x5dfa74784542c4a9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.088018:0:18720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f084e7fc/0x5dfa74784542c4a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.088037:0:18720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788460231.088312:0:18366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788460231.088318:0:18366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f084e7fc/0x5dfa74784542c4a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.088327:0:18366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc6380c00 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:3.0:1788460231.088331:0:18366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f084e7fc/0x5dfa74784542c4a9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.088340:0:18366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f084e7fc/0x5dfa74784542c4a9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.088355:0:18366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f084e7fc/0x5dfa74784542c4a9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.088374:0:18366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f084e7fc/0x5dfa74784542c4a9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.088389:0:18366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460231.088391:0:18366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460231.088393:0:18366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788460231.088653:0:18720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788460231.088659:0:18720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b4a22ed/0x5dfa74784542c4b0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.088668:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=528s v=(0 0) 00010000:00010000:1.0:1788460231.088671:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460231.088676:0:18720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b4a22ed/0x5dfa74784542c4b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.088685:0:18720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b4a22ed/0x5dfa74784542c4b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.088705:0:18720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b4a22ed/0x5dfa74784542c4b0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.088713:0:18720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001b4a22ed/0x5dfa74784542c4b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.088728:0:18720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788460231.088810:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788460231.088816:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001b4a22ed/0x5dfa74784542c4b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.088824:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc6380a00 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:3.0:1788460231.088828:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001b4a22ed/0x5dfa74784542c4b0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.088836:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001b4a22ed/0x5dfa74784542c4b0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.088848:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001b4a22ed/0x5dfa74784542c4b0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.088855:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b4a22ed/0x5dfa74784542c4b0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.088879:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460231.088881:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460231.088883:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788460231.089164:0:18720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788460231.089170:0:18720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000494bf4c2/0x5dfa74784542c4b7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.089179:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=528s v=(0 0) 00010000:00010000:1.0:1788460231.089182:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460231.089186:0:18720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000494bf4c2/0x5dfa74784542c4b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.089195:0:18720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000494bf4c2/0x5dfa74784542c4b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.089203:0:18720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000494bf4c2/0x5dfa74784542c4b7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.089210:0:18720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000494bf4c2/0x5dfa74784542c4b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.089340:0:18720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788460231.089661:0:18720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788460231.089666:0:18720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000218a9fe5/0x5dfa74784542c4be lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.089676:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=528s v=(0 0) 00010000:00010000:3.0:1788460231.089678:0:17201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788460231.089679:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788460231.089687:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000494bf4c2/0x5dfa74784542c4b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.089688:0:18720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000218a9fe5/0x5dfa74784542c4be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.089698:0:18720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000218a9fe5/0x5dfa74784542c4be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.089719:0:18720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000218a9fe5/0x5dfa74784542c4be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.089720:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc6380e00 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:3.0:1788460231.089726:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000494bf4c2/0x5dfa74784542c4b7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.089732:0:18720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000218a9fe5/0x5dfa74784542c4be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.089740:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000494bf4c2/0x5dfa74784542c4b7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.089754:0:18720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788460231.089756:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000494bf4c2/0x5dfa74784542c4b7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.089764:0:18366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788460231.089767:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000494bf4c2/0x5dfa74784542c4b7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.089770:0:18366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000218a9fe5/0x5dfa74784542c4be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.089786:0:18366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc6380200 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:3.0:1788460231.089794:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460231.089797:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460231.089799:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460231.090193:0:18366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000218a9fe5/0x5dfa74784542c4be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.090201:0:18366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000218a9fe5/0x5dfa74784542c4be lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.090213:0:18366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000218a9fe5/0x5dfa74784542c4be lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.090220:0:18366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000218a9fe5/0x5dfa74784542c4be lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.090235:0:18366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460231.090236:0:18366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460231.090238:0:18366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788460231.090566:0:18720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788460231.090572:0:18720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ea1a3ba/0x5dfa74784542c4c5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.090581:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=528s v=(0 0) 00010000:00010000:1.0:1788460231.090585:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460231.090590:0:18720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ea1a3ba/0x5dfa74784542c4c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.090601:0:18720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ea1a3ba/0x5dfa74784542c4c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.090610:0:18720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ea1a3ba/0x5dfa74784542c4c5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.090626:0:18720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005ea1a3ba/0x5dfa74784542c4c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460231.090647:0:18720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788460231.090855:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788460231.090861:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005ea1a3ba/0x5dfa74784542c4c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.090880:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc6381a00 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:3.0:1788460231.090883:0:17200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005ea1a3ba/0x5dfa74784542c4c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.090901:0:17200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005ea1a3ba/0x5dfa74784542c4c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.090912:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005ea1a3ba/0x5dfa74784542c4c5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.090919:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ea1a3ba/0x5dfa74784542c4c5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.091017:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460231.091019:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460231.091021:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788460231.091542:0:18720:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788460231.091550:0:18720:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4c6f478/0x5dfa74784542c4cc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.091560:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=528s v=(0 0) 00010000:00010000:3.0:1788460231.091564:0:18720:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788460231.091569:0:18720:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4c6f478/0x5dfa74784542c4cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.091579:0:18720:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4c6f478/0x5dfa74784542c4cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.091589:0:18720:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4c6f478/0x5dfa74784542c4cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.091608:0:18720:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4c6f478/0x5dfa74784542c4cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460231.091633:0:18720:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1788460231.091689:0:18720:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00000100:00100000:3.0:1788460231.091798:0:18720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac490a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17236:x1875336022402560:12345-0@lo:5:osp-pre-0-0.0 Request processed in 77089us (84744us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460231.091808:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1788460231.091884:0:17201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788460231.091890:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4c6f478/0x5dfa74784542c4cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460231.091898:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc6ca6600 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:2.0:1788460231.091902:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4c6f478/0x5dfa74784542c4cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460231.091911:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4c6f478/0x5dfa74784542c4cc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460231.091928:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4c6f478/0x5dfa74784542c4cc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460231.091935:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4c6f478/0x5dfa74784542c4cc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18720 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460231.091977:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460231.091979:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460231.091986:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788460231.094890:0:17236:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac490aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17236:1875336022402560:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788460231.094914:0:17236:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:1.0:1788460231.095001:0:17236:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3838000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17236:1875336022403200:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788460231.095065:0:17236:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460231.095104:0:17236:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bcec75840 going to sleep for 11 seconds 00000100:00100000:3.0:1788460231.095148:0:18717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022403200 00000100:00100000:3.0:1788460231.095156:0:18717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022403200 00000100:00100000:3.0:1788460231.095215:0:18717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788460231.095224:0:18717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac383b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17236:x1875336022403200:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1788460231.095265:0:18717:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00000001:00080000:3.0:1788460231.104470:0:18714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:3.0:1788460231.104527:0:18714:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788460231.104805:0:18717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac383b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:17236:x1875336022403200:12345-0@lo:5:osp-pre-0-0.0 Request processed in 9577us (9736us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788460231.104819:0:18717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788460231.106124:0:17236:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:0.0:1788460231.106135:0:17236:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3838000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17236:1875336022403200:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788460231.106151:0:17236:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00010000:00010000:3.0:1788460231.578136:0:18366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788460231.762354:0:17965:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788460232.593105:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788460233.297291:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4285180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022403328:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788460233.297360:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460233.297415:0:19707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022403328 00000100:00100000:0.0:1788460233.297422:0:19707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022403328 00000100:00100000:0.0:1788460233.297475:0:19707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788460233.297499:0:19707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4909180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022403328:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788460233.297529:0:19707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788460233.297573:0:19707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4909180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022403328:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460233.297580:0:19707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1788460233.297602:0:17207:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788460233.297638:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4285180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022403328:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788460233.617096:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788460234.195679:0:19890:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg605-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788460234.641921:0:18366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788460234.834213:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788460234.834234:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3671180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022403456:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788460234.834448:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460234.834543:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022403456 00000100:00100000:3.0:1788460234.834552:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022403456 00000100:00100000:3.0:1788460234.834602:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788460234.834610:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3673480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022403456:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788460234.834641:0:17216:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788460234.834683:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3673480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022403456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 74us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460234.834701:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788460234.835158:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3671180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022403456:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788460234.842191:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788460234.842212:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac4285180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022403584:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788460234.842422:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460234.842521:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022403584 00000100:00100000:2.0:1788460234.842527:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022403584 00000100:00100000:2.0:1788460234.842574:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788460234.842583:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf75e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022403584:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788460234.842616:0:17217:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788460234.842663:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf75e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022403584:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460234.842670:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788460234.842713:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac4285180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022403584:0@lo:41:osp-pre-0-1.0 00000020:00000004:3.0:1788460235.078447:0:19942:0:(tgt_mount.c:2486:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788460235.078914:0:19942:0:(tgt_mount.c:2501:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788460235.667092:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788460235.964619:0:19992:0:(tgt_mount.c:2486:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788460235.964894:0:19992:0:(tgt_mount.c:2501:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788460236.251440:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460236.251527:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003440000 00000100:00100000:1.0:1788460236.251537:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003440000 00000100:00100000:1.0:1788460236.251595:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 131 00000100:00100000:1.0:1788460236.251603:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4130c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2392:x1875336003440000:12345-192.168.206.5@tcp:250:mount.lustre.0 00010000:00080000:1.0:1788460236.251629:0:17206:0:(ldlm_lib.c:1461:target_handle_connect()) MGS: connection from 051c7034-18a2-40f3-ae82-fb4fdf9e0800@192.168.206.5@tcp t0 exp 0000000000000000 cur 533 last 0 00000020:00000080:1.0:1788460236.251658:0:17206:0:(genops.c:1385:class_connect()) connect: client 051c7034-18a2-40f3-ae82-fb4fdf9e0800, cookie 0x5dfa74784542c4d3 00000100:00080000:1.0:1788460236.251799:0:17206:0:(import.c:65:import_set_state_nolock()) ffff8c4ac3722800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788460236.251871:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4130c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:051c7034-18a2-40f3-ae82-fb4fdf9e0800+5:2392:x1875336003440000:12345-192.168.206.5@tcp:250:mount.lustre.0 Request processed in 267us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460236.251879:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 131 00000100:00100000:0.0:1788460236.259679:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460236.259780:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003440128 00000100:00100000:1.0:1788460236.259789:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003440128 00000100:00100000:1.0:1788460236.259851:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 132 00000100:00100000:1.0:1788460236.259861:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4130050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:051c7034-18a2-40f3-ae82-fb4fdf9e0800+5:14886:x1875336003440128:12345-192.168.206.5@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788460236.259877:0:17204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460236.259893:0:17204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4bc6381a00/0x5dfa74784542c4da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a9cc expref: -99 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460236.259918:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bc6381a00/0x5dfa74784542c4da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a9cc expref: 6 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460236.259930:0:17204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4bc6381a00/0x5dfa74784542c4da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a9cc expref: 6 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460236.259940:0:17204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc6381a00, rc 0) 00000100:00100000:1.0:1788460236.260016:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4130050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:051c7034-18a2-40f3-ae82-fb4fdf9e0800+6:14886:x1875336003440128:12345-192.168.206.5@tcp:101:mount.lustre.0 Request processed in 156us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460236.260024:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 132 00000100:00100000:0.0:1788460236.265816:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460236.265917:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003440256 00000100:00100000:2.0:1788460236.265927:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003440256 00000100:00100000:2.0:1788460236.266017:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 133 00000100:00100000:2.0:1788460236.266027:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4133850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:051c7034-18a2-40f3-ae82-fb4fdf9e0800+6:14886:x1875336003440256:12345-192.168.206.5@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788460236.266129:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4133850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:051c7034-18a2-40f3-ae82-fb4fdf9e0800+6:14886:x1875336003440256:12345-192.168.206.5@tcp:501:mount.lustre.0 Request processed in 103us (321us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788460236.266138:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 133 00000100:00100000:0.0:1788460236.273446:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460236.277425:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003440384 00000100:00100000:2.0:1788460236.277462:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003440384 00000100:00100000:2.0:1788460236.277530:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 134 00000100:00100000:2.0:1788460236.277540:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4132450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:051c7034-18a2-40f3-ae82-fb4fdf9e0800+6:14886:x1875336003440384:12345-192.168.206.5@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788460236.277568:0:17206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460236.277584:0:17206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4ac395ec00/0x5dfa74784542c4e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794a9d3 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460236.277610:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4ac395ec00/0x5dfa74784542c4e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a9d3 expref: 7 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460236.277621:0:17206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4ac395ec00/0x5dfa74784542c4e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794a9d3 expref: 7 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460236.277630:0:17206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ac395ec00, rc 0) 00000100:00100000:2.0:1788460236.277685:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4132450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:051c7034-18a2-40f3-ae82-fb4fdf9e0800+7:14886:x1875336003440384:12345-192.168.206.5@tcp:101:mount.lustre.0 Request processed in 146us (4246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460236.277692:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 134 00000100:00100000:0.0:1788460236.279294:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460236.279417:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003440512 00000100:00100000:1.0:1788460236.279425:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003440512 00000100:00100000:1.0:1788460236.279468:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 135 00000100:00100000:1.0:1788460236.279477:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4132850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:051c7034-18a2-40f3-ae82-fb4fdf9e0800+7:14886:x1875336003440512:12345-192.168.206.5@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788460236.279612:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4132850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:051c7034-18a2-40f3-ae82-fb4fdf9e0800+8:14886:x1875336003440512:12345-192.168.206.5@tcp:501:mount.lustre.0 Request processed in 135us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460236.279620:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 135 00000100:00100000:0.0:1788460236.281153:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460236.281241:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003440640 00000100:00100000:1.0:1788460236.281250:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003440640 00000100:00100000:1.0:1788460236.281308:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 136 00000100:00100000:1.0:1788460236.281331:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4130850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:051c7034-18a2-40f3-ae82-fb4fdf9e0800+8:14886:x1875336003440640:12345-192.168.206.5@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788460236.281450:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4130850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:051c7034-18a2-40f3-ae82-fb4fdf9e0800+8:14886:x1875336003440640:12345-192.168.206.5@tcp:503:mount.lustre.0 Request processed in 120us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460236.281457:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 136 00000100:00100000:0.0:1788460236.287174:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460236.290605:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003440768 00000100:00100000:2.0:1788460236.290619:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003440768 00000100:00100000:2.0:1788460236.290704:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 137 00000100:00100000:2.0:1788460236.290713:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4132050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:051c7034-18a2-40f3-ae82-fb4fdf9e0800+8:14905:x1875336003440768:12345-192.168.206.5@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788460236.291095:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4132050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:051c7034-18a2-40f3-ae82-fb4fdf9e0800+8:14905:x1875336003440768:12345-192.168.206.5@tcp:502:llog_process_th.0 Request processed in 381us (3928us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460236.291105:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 137 00000100:00100000:2.0:1788460236.317893:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460236.318336:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003440896 00000100:00100000:0.0:1788460236.318350:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003440896 00000100:00100000:0.0:1788460236.318420:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 138 00000100:00100000:0.0:1788460236.318432:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4132c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:051c7034-18a2-40f3-ae82-fb4fdf9e0800+8:14905:x1875336003440896:12345-192.168.206.5@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788460236.319003:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4132c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:051c7034-18a2-40f3-ae82-fb4fdf9e0800+8:14905:x1875336003440896:12345-192.168.206.5@tcp:502:llog_process_th.0 Request processed in 570us (1122us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460236.319014:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 138 00000100:00100000:0.0:1788460236.324069:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460236.324477:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003441024 00000100:00100000:2.0:1788460236.324490:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003441024 00000100:00100000:2.0:1788460236.324554:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 139 00000100:00100000:2.0:1788460236.324565:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4131050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:051c7034-18a2-40f3-ae82-fb4fdf9e0800+8:14905:x1875336003441024:12345-192.168.206.5@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788460236.324775:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4131050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:051c7034-18a2-40f3-ae82-fb4fdf9e0800+8:14905:x1875336003441024:12345-192.168.206.5@tcp:502:llog_process_th.0 Request processed in 211us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460236.324792:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 139 00000100:00100000:3.0:1788460236.327292:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460236.327445:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003441152 00000100:00100000:1.0:1788460236.327470:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003441152 00000100:00100000:1.0:1788460236.327532:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 140 00000100:00100000:1.0:1788460236.327544:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4131450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:051c7034-18a2-40f3-ae82-fb4fdf9e0800+8:14886:x1875336003441152:12345-192.168.206.5@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788460236.327566:0:17204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460236.327588:0:17204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4bc6380e00/0x5dfa74784542c4e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794aa04 expref: -99 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460236.327623:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bc6380e00/0x5dfa74784542c4e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794aa04 expref: 9 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460236.327637:0:17204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4bc6380e00/0x5dfa74784542c4e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794aa04 expref: 9 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460236.327647:0:17204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc6380e00, rc 0) 00000100:00100000:1.0:1788460236.327717:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4131450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:051c7034-18a2-40f3-ae82-fb4fdf9e0800+9:14886:x1875336003441152:12345-192.168.206.5@tcp:101:mount.lustre.0 Request processed in 175us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460236.327725:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 140 00000100:00100000:0.0:1788460236.335802:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460236.335995:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003441280 00000100:00100000:2.0:1788460236.336008:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003441280 00000100:00100000:2.0:1788460236.336091:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 141 00000100:00100000:2.0:1788460236.336103:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4133050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:051c7034-18a2-40f3-ae82-fb4fdf9e0800+9:14886:x1875336003441280:12345-192.168.206.5@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788460236.336136:0:17206:0:(mgs_nids.c:1209:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788460236.336167:0:17206:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788460236.336172:0:17206:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788460236.336175:0:17206:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788460236.336178:0:17206:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1788460236.336181:0:17206:0:(mgs_nids.c:325:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:2.0:1788460236.344506:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4133050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:051c7034-18a2-40f3-ae82-fb4fdf9e0800+9:14886:x1875336003441280:12345-192.168.206.5@tcp:256:mount.lustre.0 Request processed in 8390us (8707us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460236.344526:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 141 00000100:00100000:3.0:1788460236.348621:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460236.352265:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003441408 00000100:00100000:1.0:1788460236.352286:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003441408 00000100:00100000:1.0:1788460236.353127:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 142 00000100:00100000:1.0:1788460236.353143:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4130450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:051c7034-18a2-40f3-ae82-fb4fdf9e0800+9:14886:x1875336003441408:12345-192.168.206.5@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788460236.353167:0:17205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460236.353207:0:17205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4bc6380a00/0x5dfa74784542c4ef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794aa0b expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460236.353244:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bc6380a00/0x5dfa74784542c4ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794aa0b expref: 10 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460236.353258:0:17205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4bc6380a00/0x5dfa74784542c4ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794aa0b expref: 10 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460236.353268:0:17205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc6380a00, rc 0) 00000100:00100000:1.0:1788460236.353607:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4130450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:051c7034-18a2-40f3-ae82-fb4fdf9e0800+10:14886:x1875336003441408:12345-192.168.206.5@tcp:101:mount.lustre.0 Request processed in 409us (4940us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460236.353682:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 142 00000100:00100000:0.0:1788460236.355508:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460236.355665:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003441536 00000100:00100000:2.0:1788460236.355678:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003441536 00000100:00100000:2.0:1788460236.355741:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 143 00000100:00100000:2.0:1788460236.355751:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac2b3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:051c7034-18a2-40f3-ae82-fb4fdf9e0800+10:14886:x1875336003441536:12345-192.168.206.5@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788460236.356657:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac2b3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:051c7034-18a2-40f3-ae82-fb4fdf9e0800+10:14886:x1875336003441536:12345-192.168.206.5@tcp:501:mount.lustre.0 Request processed in 900us (1154us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460236.356668:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 143 00000100:00100000:0.0:1788460236.362221:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460236.362487:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003441664 00000100:00100000:1.0:1788460236.362500:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003441664 00000100:00100000:1.0:1788460236.362569:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 144 00000100:00100000:1.0:1788460236.362581:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac2b3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:051c7034-18a2-40f3-ae82-fb4fdf9e0800+10:14886:x1875336003441664:12345-192.168.206.5@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788460236.364153:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac2b3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:051c7034-18a2-40f3-ae82-fb4fdf9e0800+10:14886:x1875336003441664:12345-192.168.206.5@tcp:503:mount.lustre.0 Request processed in 1559us (1931us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460236.364170:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 144 00000100:00100000:3.0:1788460236.369615:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c482be18-c056-4068-8a37-ed5038fc364a:3661:1875336022403712:0@lo:400:kworker.0 00000100:00100000:2.0:1788460236.369932:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac41b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022403968:0@lo:400:kworker.0 00000100:00100000:1.0:1788460236.370054:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac41bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022404096:0@lo:400:kworker.0 00000100:00100000:2.0:1788460236.373464:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460236.373978:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac41bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022404480:0@lo:400:kworker.0 00000100:00100000:3.0:1788460236.374005:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460236.374027:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460236.374080:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac41ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875336022404224:0@lo:400:kworker.0 00000100:00100000:3.0:1788460236.374140:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460236.374170:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac41bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875336022404736:0@lo:400:kworker.0 00000100:00100000:3.0:1788460236.374191:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460236.374211:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac41b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1875336022405248:0@lo:400:kworker.0 00000100:00100000:3.0:1788460236.374233:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460236.374284:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac41b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1875336022404992:0@lo:400:kworker.0 00000100:00100000:3.0:1788460236.374290:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1788460236.374303:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac41b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022403840:0@lo:400:kworker.0 00000100:00100000:2.0:1788460236.374328:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460236.374356:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460236.374361:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3671180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022405504:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788460236.374397:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac41bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022404352:0@lo:400:kworker.0 00000100:00100000:2.0:1788460236.374420:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460236.374439:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460236.374473:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788460236.374478:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac41bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3661:1875336022404864:0@lo:400:kworker.0 00000100:00100000:2.0:1788460236.374487:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac490b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022405632:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788460236.374508:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460236.374523:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3838380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022405376:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788460236.374583:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460236.374624:0:18741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022404224 00000100:00100000:3.0:1788460236.374632:0:18741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022404224 00000100:00100000:2.0:1788460236.374683:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460236.374750:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022403712 00000100:00100000:2.0:1788460236.374757:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022403712 00000100:00100000:2.0:1788460236.374970:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788460236.374980:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac2b39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+29:3661:x1875336022403712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460236.376010:0:18721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022405504 00000100:00100000:1.0:1788460236.376022:0:18721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022405504 00000100:00100000:1.0:1788460236.376076:0:18721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022405376 00000100:00100000:1.0:1788460236.376080:0:18721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022405376 00000100:00100000:1.0:1788460236.376096:0:18721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022405632 00000100:00100000:1.0:1788460236.376099:0:18721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022405632 00000100:00100000:1.0:1788460236.376119:0:18721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788460236.376128:0:18721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac42f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3659:x1875336022405504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788460236.376183:0:18721:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788460236.376279:0:18721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac42f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3659:x1875336022405504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 151us (1859us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460236.376288:0:18721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788460236.376306:0:18721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788460236.376311:0:18721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfaeab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022405376:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788460236.376322:0:18721:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788460236.378198:0:19273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022403968 00000100:00100000:0.0:1788460236.378217:0:19273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022403968 00000100:00100000:1.0:1788460236.380036:0:18721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfaeab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022405376:12345-0@lo:13:osp-pre-1-1.0 Request processed in 3710us (5437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460236.380053:0:18721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788460236.380100:0:18721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788460236.380120:0:18721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac42f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3659:x1875336022405632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788460236.380164:0:18721:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788460236.380254:0:18721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac42f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3659:x1875336022405632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (5559us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460236.380262:0:18721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788460236.380346:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460236.380411:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac2b39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+29:3661:x1875336022403712:12345-0@lo:400:kworker.0 Request processed in 5430us (6764us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460236.380422:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788460236.380491:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac490b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022405632:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788460236.380513:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3671180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022405504:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788460236.383642:0:18741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022404736 00000100:00100000:3.0:1788460236.383670:0:18741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022404736 00000100:00100000:3.0:1788460236.383692:0:18741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022405248 00000100:00100000:3.0:1788460236.383695:0:18741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022405248 00000100:00100000:3.0:1788460236.383710:0:18741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022404992 00000100:00100000:3.0:1788460236.383713:0:18741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022404992 00000100:00100000:3.0:1788460236.383725:0:18741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022404864 00000100:00100000:3.0:1788460236.383727:0:18741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022404864 00000100:00100000:3.0:1788460236.383742:0:18741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788460236.383751:0:18741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1875336022404224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460236.383835:0:18741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3661:x1875336022404224:12345-0@lo:400:kworker.0 Request processed in 85us (9693us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460236.383852:0:18741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788460236.383880:0:18741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788460236.383886:0:18741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1875336022404736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460236.383914:0:18741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3661:x1875336022404736:12345-0@lo:400:kworker.0 Request processed in 30us (9723us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460236.383920:0:18741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788460236.383930:0:18741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788460236.383936:0:18741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1875336022405248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460236.383978:0:18741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3661:x1875336022405248:12345-0@lo:400:kworker.0 Request processed in 43us (9744us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460236.383984:0:18741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788460236.383994:0:18741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788460236.384000:0:18741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac42f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1875336022404992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460236.384049:0:18741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac42f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1875336022404992:12345-0@lo:400:kworker.0 Request processed in 49us (9724us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460236.384055:0:18741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788460236.384067:0:18741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788460236.384073:0:18741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1875336022404864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460236.384097:0:18741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1875336022404864:12345-0@lo:400:kworker.0 Request processed in 25us (9591us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460236.384103:0:18741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788460236.384134:0:17952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022403840 00000100:00100000:3.0:1788460236.384138:0:17952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022403840 00000100:00100000:3.0:1788460236.384158:0:17952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022404352 00000100:00100000:3.0:1788460236.384161:0:17952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022404352 00000100:00100000:3.0:1788460236.384172:0:17952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788460236.384178:0:17952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1875336022403840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460236.384208:0:17952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1875336022403840:12345-0@lo:400:kworker.0 Request processed in 31us (9856us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460236.384214:0:17952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788460236.384225:0:17952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788460236.384230:0:17952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022404352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460236.384256:0:17952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022404352:12345-0@lo:400:kworker.0 Request processed in 26us (9818us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460236.384261:0:17952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:3.0:1788460236.384374:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac41b9880 x1875336022404992/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460236.384390:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac41b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1875336022404992:0@lo:400:kworker.0 00000100:00100000:3.0:1788460236.384434:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac41b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022403840:0@lo:400:kworker.0 00000100:00100000:3.0:1788460236.384446:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac41bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022404352:0@lo:400:kworker.0 00010000:00080000:3.0:1788460236.384456:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac41bad80 x1875336022404864/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460236.384465:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac41bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3661:1875336022404864:0@lo:400:kworker.0 00000100:00100000:3.0:1788460236.384485:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3838380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022405376:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788460236.384497:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c482be18-c056-4068-8a37-ed5038fc364a:3661:1875336022403712:0@lo:400:kworker.0 00010000:00080000:3.0:1788460236.384508:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac41ba680 x1875336022404224/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460236.384517:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac41ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3661:1875336022404224:0@lo:400:kworker.0 00010000:00080000:3.0:1788460236.384528:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac41bb480 x1875336022404736/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460236.384537:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac41bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3661:1875336022404736:0@lo:400:kworker.0 00010000:00080000:3.0:1788460236.384547:0:3661:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac41b9f80 x1875336022405248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460236.384556:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac41b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3661:1875336022405248:0@lo:400:kworker.0 00000100:00100000:3.0:1788460236.384677:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460236.390729:0:19273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022404480 00000100:00100000:0.0:1788460236.390751:0:19273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022404480 00000100:00100000:0.0:1788460236.390876:0:19273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022404096 00000100:00100000:0.0:1788460236.390881:0:19273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022404096 00000100:00100000:0.0:1788460236.390905:0:19273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788460236.390916:0:19273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3670e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022403968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460236.391314:0:19273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3670e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022403968:12345-0@lo:400:kworker.0 Request processed in 399us (17928us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460236.391323:0:19273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788460236.391344:0:19273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788460236.391351:0:19273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4285180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022404480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460236.391386:0:19273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4285180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022404480:12345-0@lo:400:kworker.0 Request processed in 36us (17361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460236.391392:0:19273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788460236.391421:0:19273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788460236.391428:0:19273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3839180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3660:x1875336022404096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460236.391462:0:19273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3839180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3660:x1875336022404096:12345-0@lo:400:kworker.0 Request processed in 34us (11116us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460236.391468:0:19273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1788460236.391496:0:17207:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788460236.391502:0:17207:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788460236.391506:0:17207:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788460236.391508:0:17207:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788460236.391612:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac41b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022403968:0@lo:400:kworker.0 00000100:00100000:0.0:1788460236.391630:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac41bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022404480:0@lo:400:kworker.0 00000100:00100000:1.0:1788460236.391739:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003441792 00000100:00100000:1.0:1788460236.391747:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003441792 00000100:00100000:1.0:1788460236.391874:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 146 00000100:00100000:1.0:1788460236.391883:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac2b38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:051c7034-18a2-40f3-ae82-fb4fdf9e0800+10:14910:x1875336003441792:12345-192.168.206.5@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788460236.392214:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac2b38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:051c7034-18a2-40f3-ae82-fb4fdf9e0800+10:14910:x1875336003441792:12345-192.168.206.5@tcp:502:llog_process_th.0 Request processed in 330us (7536us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460236.392222:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 146 00000100:00100000:1.0:1788460236.393132:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac41bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022404096:0@lo:400:kworker.0 00000100:00100000:1.0:1788460236.393165:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac41ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022404608:0@lo:400:kworker.0 00000100:00100000:1.0:1788460236.393685:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460236.393732:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac41b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3660:1875336022405120:0@lo:400:kworker.0 00000100:00100000:1.0:1788460236.393773:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460236.393995:0:18741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022405120 00000100:00100000:2.0:1788460236.394005:0:18741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022405120 00000100:00100000:2.0:1788460236.394072:0:18741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788460236.394082:0:18741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3839f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1875336022405120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460236.394145:0:18741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3839f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3660:x1875336022405120:12345-0@lo:400:kworker.0 Request processed in 64us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460236.394151:0:19273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022404608 00000100:00100000:2.0:1788460236.394156:0:18741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788460236.394158:0:19273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022404608 00000100:00100000:0.0:1788460236.394192:0:19273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788460236.394201:0:19273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3838700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022404608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788460236.394241:0:19273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3838700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022404608:12345-0@lo:400:kworker.0 Request processed in 42us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460236.394247:0:19273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1788460236.394337:0:17207:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788460236.394374:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac41ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022404608:0@lo:400:kworker.0 00010000:00080000:1.0:1788460236.394389:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac41b8a80 x1875336022405120/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460236.394400:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac41b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3660:1875336022405120:0@lo:400:kworker.0 00000100:00100000:0.0:1788460236.405289:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460236.405462:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003441920 00000100:00100000:3.0:1788460236.405476:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003441920 00000100:00100000:3.0:1788460236.405545:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 147 00000100:00100000:3.0:1788460236.405557:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac2b3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:051c7034-18a2-40f3-ae82-fb4fdf9e0800+10:14910:x1875336003441920:12345-192.168.206.5@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788460236.405781:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac2b3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:051c7034-18a2-40f3-ae82-fb4fdf9e0800+10:14910:x1875336003441920:12345-192.168.206.5@tcp:502:llog_process_th.0 Request processed in 224us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460236.405790:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 147 00000100:00100000:0.0:1788460236.419359:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460236.419488:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460236.419504:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003442048 00000100:00100000:3.0:1788460236.419517:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003442048 00000100:00100000:3.0:1788460236.419573:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003442304 00000100:00100000:3.0:1788460236.419576:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003442304 00000100:00100000:3.0:1788460236.419603:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 7 00000100:00100000:3.0:1788460236.419614:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4909500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2392:x1875336003442048:12345-192.168.206.5@tcp:38:mount.lustre.0 00000100:00100000:0.0:1788460236.419625:0:18741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 8 00000100:00100000:0.0:1788460236.419632:0:18741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac490b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2392:x1875336003442304:12345-192.168.206.5@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788460236.419652:0:17213:0:(ldlm_lib.c:1461:target_handle_connect()) lustre-MDT0000: connection from f3471709-a010-41d7-90bc-b8b3ea7c57b0@192.168.206.5@tcp t0 exp 0000000000000000 cur 533 last 0 00010000:00080000:0.0:1788460236.419675:0:18741:0:(ldlm_lib.c:1461:target_handle_connect()) lustre-MDT0001: connection from f3471709-a010-41d7-90bc-b8b3ea7c57b0@192.168.206.5@tcp t0 exp 0000000000000000 cur 533 last 0 00000020:00000080:3.0:1788460236.419712:0:17213:0:(genops.c:1385:class_connect()) connect: client f3471709-a010-41d7-90bc-b8b3ea7c57b0, cookie 0x5dfa74784542c4f6 00000020:00000080:0.0:1788460236.419712:0:18741:0:(genops.c:1385:class_connect()) connect: client f3471709-a010-41d7-90bc-b8b3ea7c57b0, cookie 0x5dfa74784542c4fd 00000004:00100000:0.0:1788460236.419742:0:18741:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788460236.420155:0:18741:0:(import.c:65:import_set_state_nolock()) ffff8c4ac37e3000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788460236.420235:0:18741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac490b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3471709-a010-41d7-90bc-b8b3ea7c57b0+6:2392:x1875336003442304:12345-192.168.206.5@tcp:38:mount.lustre.0 Request processed in 600us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460236.420246:0:18741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 8 00000004:00100000:1.0:1788460236.431677:0:17213:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788460236.432658:0:17213:0:(import.c:65:import_set_state_nolock()) ffff8c4ac3723800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788460236.432775:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4909500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3471709-a010-41d7-90bc-b8b3ea7c57b0+6:2392:x1875336003442048:12345-192.168.206.5@tcp:38:mount.lustre.0 Request processed in 13159us (13428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460236.432790:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 7 00000100:00100000:0.0:1788460236.434053:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460236.434138:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003442432 00000100:00100000:2.0:1788460236.434148:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003442432 00000100:00100000:2.0:1788460236.434230:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 9 00000100:00100000:2.0:1788460236.434254:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4908380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3471709-a010-41d7-90bc-b8b3ea7c57b0+6:0:x1875336003442432:12345-192.168.206.5@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788460236.434290:0:17211:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788460236.434472:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4908380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3471709-a010-41d7-90bc-b8b3ea7c57b0+6:0:x1875336003442432:12345-192.168.206.5@tcp:41:mount.lustre.0 Request processed in 221us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460236.434480:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 9 00000100:00080000:1.0:1788460236.438261:0:17207:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788460236.443581:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460236.445217:0:18741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003442176 00000100:00100000:0.0:1788460236.445238:0:18741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003442176 00000100:00100000:0.0:1788460236.445419:0:18741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 10 00000100:00100000:0.0:1788460236.445432:0:18741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac42f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3471709-a010-41d7-90bc-b8b3ea7c57b0+6:0:x1875336003442176:12345-192.168.206.5@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788460236.445487:0:18741:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788460236.445667:0:18741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac42f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3471709-a010-41d7-90bc-b8b3ea7c57b0+6:0:x1875336003442176:12345-192.168.206.5@tcp:41:mount.lustre.0 Request processed in 238us (2101us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460236.445675:0:18741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 10 00000100:00080000:1.0:1788460236.445753:0:17207:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788460236.455024:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460236.455212:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003442560 00000100:00100000:3.0:1788460236.455225:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003442560 00000100:00100000:3.0:1788460236.455294:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 11 00000100:00100000:3.0:1788460236.455305:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac42f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3471709-a010-41d7-90bc-b8b3ea7c57b0+6:14886:x1875336003442560:12345-192.168.206.5@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788460236.455347:0:17212:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788460236.455437:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac42f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3471709-a010-41d7-90bc-b8b3ea7c57b0+6:14886:x1875336003442560:12345-192.168.206.5@tcp:41:mount.lustre.0 Request processed in 133us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460236.455445:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 11 00000100:00100000:2.0:1788460236.458490:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460236.458594:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003442688 00000100:00100000:3.0:1788460236.458607:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003442688 00000100:00100000:3.0:1788460236.458724:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 12 00000100:00100000:3.0:1788460236.458736:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac42f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3471709-a010-41d7-90bc-b8b3ea7c57b0+6:14886:x1875336003442688:12345-192.168.206.5@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788460236.458894:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac42f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3471709-a010-41d7-90bc-b8b3ea7c57b0+6:14886:x1875336003442688:12345-192.168.206.5@tcp:40:mount.lustre.0 Request processed in 160us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460236.458912:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 12 00000100:00100000:2.0:1788460236.463698:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460236.463744:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460236.463870:0:18717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003442816 00000100:00100000:1.0:1788460236.463883:0:18717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003442816 00000100:00100000:1.0:1788460236.463961:0:18717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 16 00000100:00100000:1.0:1788460236.464128:0:18717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac42f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2392:x1875336003442816:12345-192.168.206.5@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788460236.464172:0:18717:0:(ldlm_lib.c:1461:target_handle_connect()) lustre-OST0000: connection from f3471709-a010-41d7-90bc-b8b3ea7c57b0@192.168.206.5@tcp t0 exp 0000000000000000 cur 533 last 0 00000020:00000080:1.0:1788460236.464214:0:18717:0:(genops.c:1385:class_connect()) connect: client f3471709-a010-41d7-90bc-b8b3ea7c57b0, cookie 0x5dfa74784542c504 00002000:00100000:1.0:1788460236.464230:0:18717:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f3471709-a010-41d7-90bc-b8b3ea7c57b0/ffff8c4ac3ae0000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a07 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788460236.464244:0:18717:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788460236.464500:0:18717:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788460236.464539:0:18717:0:(import.c:65:import_set_state_nolock()) ffff8c4ac36f9000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788460236.464621:0:18717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac42f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f3471709-a010-41d7-90bc-b8b3ea7c57b0+6:2392:x1875336003442816:12345-192.168.206.5@tcp:8:mount.lustre.0 Request processed in 495us (936us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460236.464908:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460236.464955:0:19273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003442944 00000100:00100000:2.0:1788460236.464961:0:19273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003442944 00000100:00100000:1.0:1788460236.466544:0:18717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 16 00000100:00100000:3.0:1788460236.467422:0:17223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003443072 00000100:00100000:3.0:1788460236.467436:0:17223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003443072 00000100:00100000:3.0:1788460236.467499:0:17223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 3 00000100:00100000:3.0:1788460236.467510:0:17223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac42f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f3471709-a010-41d7-90bc-b8b3ea7c57b0+6:14886:x1875336003443072:12345-192.168.206.5@tcp:900:mount.lustre.0 00000100:00100000:3.0:1788460236.467625:0:17223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac42f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f3471709-a010-41d7-90bc-b8b3ea7c57b0+6:14886:x1875336003443072:12345-192.168.206.5@tcp:900:mount.lustre.0 Request processed in 116us (3878us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460236.467632:0:17223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 3 00000100:00100000:2.0:1788460236.468328:0:19273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 17 00000100:00100000:2.0:1788460236.468339:0:19273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac42f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2392:x1875336003442944:12345-192.168.206.5@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788460236.468376:0:19273:0:(ldlm_lib.c:1461:target_handle_connect()) lustre-OST0001: connection from f3471709-a010-41d7-90bc-b8b3ea7c57b0@192.168.206.5@tcp t0 exp 0000000000000000 cur 533 last 0 00000020:00000080:2.0:1788460236.468414:0:19273:0:(genops.c:1385:class_connect()) connect: client f3471709-a010-41d7-90bc-b8b3ea7c57b0, cookie 0x5dfa74784542c50b 00002000:00100000:2.0:1788460236.468429:0:19273:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f3471709-a010-41d7-90bc-b8b3ea7c57b0/ffff8c4c0147c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a07 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788460236.468443:0:19273:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788460236.468653:0:19273:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788460236.468691:0:19273:0:(import.c:65:import_set_state_nolock()) ffff8c4c01478800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788460236.468757:0:19273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac42f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f3471709-a010-41d7-90bc-b8b3ea7c57b0+6:2392:x1875336003442944:12345-192.168.206.5@tcp:8:mount.lustre.0 Request processed in 418us (3849us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460236.468771:0:19273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 17 00000100:00100000:0.0:1788460236.480649:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460236.481117:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003443200 00000100:00100000:1.0:1788460236.481127:0:17214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003443200 00000100:00100000:1.0:1788460236.481204:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 0 00000100:00100000:1.0:1788460236.481213:0:17214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4908e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f3471709-a010-41d7-90bc-b8b3ea7c57b0+6:14886:x1875336003443200:12345-192.168.206.5@tcp:33:mount.lustre.0 00000001:00100000:3.0:1788460236.481397:0:18714:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f3471709-a010-41d7-90bc-b8b3ea7c57b0 00000001:00100000:3.0:1788460236.482608:0:19533:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f3471709-a010-41d7-90bc-b8b3ea7c57b0 00000001:00080000:3.0:1788460236.482625:0:19533:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000004:00080000:1.0:1788460236.486166:0:17214:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 4858us 00000004:00200000:2.0:1788460236.518778:0:17214:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788460236.518925:0:17214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4908e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f3471709-a010-41d7-90bc-b8b3ea7c57b0+6:14886:x1875336003443200:12345-192.168.206.5@tcp:33:mount.lustre.0 Request processed in 37708us (38281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460236.518940:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 0 00000100:00100000:0.0:1788460236.680596:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460236.680715:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003443328 00000100:00100000:3.0:1788460236.680726:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003443328 00000100:00100000:3.0:1788460236.680783:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 13 00000100:00100000:3.0:1788460236.680793:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac490bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3471709-a010-41d7-90bc-b8b3ea7c57b0+6:14933:x1875336003443328:12345-192.168.206.5@tcp:101:mkdir.0 00010000:00010000:3.0:1788460236.680813:0:17212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460236.680856:0:17212:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7800/0x5dfa74784542c512 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794aa3c expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460236.680914:0:17212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7400/0x5dfa74784542c519 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460236.680927:0:17212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7400/0x5dfa74784542c519 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460236.680985:0:17212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7400/0x5dfa74784542c519 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788460236.681051:0:17212:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788460236.681056:0:17212:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788460236.681089:0:17212:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7400/0x5dfa74784542c519 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460236.681126:0:17212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7800/0x5dfa74784542c512 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794aa3c expref: 8 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460236.681144:0:17212:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7400/0x5dfa74784542c519 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794aa3c expref: 7 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460236.681152:0:17212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4bef1fee00) 00010000:00010000:3.0:1788460236.681155:0:17212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788460236.681158:0:17212:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc6ca7400, rc 0) 00000100:00100000:3.0:1788460236.681215:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac490bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3471709-a010-41d7-90bc-b8b3ea7c57b0+7:14933:x1875336003443328:12345-192.168.206.5@tcp:101:mkdir.0 Request processed in 423us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460236.681222:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 13 00010000:00010000:2.0:1788460236.691815:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788460237.073658:0:17247:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788460237.713410:0:18366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788460238.419269:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfaeaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022405760:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788460238.419383:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460238.419517:0:18721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022405760 00000100:00100000:3.0:1788460238.419528:0:18721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022405760 00000100:00100000:3.0:1788460238.419603:0:18721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788460238.419616:0:18721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4909c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022405760:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788460238.419653:0:18721:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788460238.419721:0:18721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4909c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022405760:12345-0@lo:13:osp-pre-0-1.0 Request processed in 108us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460238.419729:0:18721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1788460238.419842:0:17207:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788460238.419974:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfaeaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022405760:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788460238.620252:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460238.621213:0:18741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003443456 00000100:00100000:0.0:1788460238.621226:0:18741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003443456 00000100:00100000:0.0:1788460238.621302:0:18741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 14 00000100:00100000:0.0:1788460238.621313:0:18741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfaea8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3471709-a010-41d7-90bc-b8b3ea7c57b0+7:14986:x1875336003443456:12345-192.168.206.5@tcp:41:lfs.0 00000004:00000024:0.0:1788460238.621361:0:18741:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788460238.621473:0:18741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfaea8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3471709-a010-41d7-90bc-b8b3ea7c57b0+7:14986:x1875336003443456:12345-192.168.206.5@tcp:41:lfs.0 Request processed in 162us (1228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460238.621481:0:18741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 14 00000100:00080000:1.0:1788460238.626089:0:17207:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788460238.627328:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460238.630404:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003443584 00000100:00100000:2.0:1788460238.630419:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003443584 00000100:00100000:2.0:1788460238.630501:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 15 00000100:00100000:2.0:1788460238.630515:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac490ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3471709-a010-41d7-90bc-b8b3ea7c57b0+6:14986:x1875336003443584:12345-192.168.206.5@tcp:41:lfs.0 00000004:00000024:2.0:1788460238.630573:0:17211:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788460238.630840:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac490ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3471709-a010-41d7-90bc-b8b3ea7c57b0+6:14986:x1875336003443584:12345-192.168.206.5@tcp:41:lfs.0 Request processed in 317us (3505us total) trans 0 rc 0/0 00000100:00080000:1.0:1788460238.630852:0:17207:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788460238.631157:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 15 00000100:00100000:2.0:1788460238.636584:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460238.639728:0:19707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003443712 00000100:00100000:0.0:1788460238.639794:0:19707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003443712 00000100:00100000:0.0:1788460238.640486:0:19707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 10 00000100:00100000:0.0:1788460238.640498:0:19707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3671180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f3471709-a010-41d7-90bc-b8b3ea7c57b0+5:14986:x1875336003443712:12345-192.168.206.5@tcp:13:lfs.0 00002000:00000024:0.0:1788460238.640524:0:19707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788460238.640671:0:19707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3671180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f3471709-a010-41d7-90bc-b8b3ea7c57b0+5:14986:x1875336003443712:12345-192.168.206.5@tcp:13:lfs.0 Request processed in 174us (4093us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460238.640679:0:19707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 10 00000100:00080000:1.0:1788460238.641489:0:17207:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788460238.644505:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460238.646286:0:18721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003443840 00000100:00100000:1.0:1788460238.646299:0:18721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003443840 00000100:00080000:0.0:1788460238.646516:0:17207:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788460238.646568:0:18721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 11 00000100:00100000:1.0:1788460238.646579:0:18721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfaeab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f3471709-a010-41d7-90bc-b8b3ea7c57b0+5:14986:x1875336003443840:12345-192.168.206.5@tcp:13:lfs.0 00002000:00000024:1.0:1788460238.646611:0:18721:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788460238.646740:0:18721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfaeab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f3471709-a010-41d7-90bc-b8b3ea7c57b0+5:14986:x1875336003443840:12345-192.168.206.5@tcp:13:lfs.0 Request processed in 163us (2242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460238.646757:0:18721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 11 00010000:00010000:0.0:1788460238.737176:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460238.845376:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460238.845467:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003443968 00000100:00100000:1.0:1788460238.845478:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003443968 00000100:00100000:1.0:1788460238.845533:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 148 00000100:00100000:1.0:1788460238.845542:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac2b39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:051c7034-18a2-40f3-ae82-fb4fdf9e0800+10:15021:x1875336003443968:12345-192.168.206.5@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788460238.845558:0:17205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460238.845586:0:17205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4bc6381e00/0x5dfa74784542c520 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794aa43 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460238.845614:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bc6381e00/0x5dfa74784542c520 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794aa43 expref: 11 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460238.845625:0:17205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4bc6381e00/0x5dfa74784542c520 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794aa43 expref: 11 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460238.845633:0:17205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc6381e00, rc 0) 00000100:00100000:1.0:1788460238.845696:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac2b39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:051c7034-18a2-40f3-ae82-fb4fdf9e0800+11:15021:x1875336003443968:12345-192.168.206.5@tcp:101:mount.lustre.0 Request processed in 155us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460238.845703:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 148 00000100:00100000:0.0:1788460238.848618:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460238.848710:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003444096 00000100:00100000:2.0:1788460238.848719:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003444096 00000100:00100000:2.0:1788460238.848788:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 149 00000100:00100000:2.0:1788460238.848798:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac2b3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:051c7034-18a2-40f3-ae82-fb4fdf9e0800+11:15021:x1875336003444096:12345-192.168.206.5@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788460238.849174:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac2b3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:051c7034-18a2-40f3-ae82-fb4fdf9e0800+11:15021:x1875336003444096:12345-192.168.206.5@tcp:501:mount.lustre.0 Request processed in 377us (563us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788460238.849183:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 149 00000100:00100000:2.0:1788460238.852665:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460238.852814:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003444224 00000100:00100000:3.0:1788460238.852933:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003444224 00000100:00100000:3.0:1788460238.853130:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 150 00000100:00100000:3.0:1788460238.853142:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac2b3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:051c7034-18a2-40f3-ae82-fb4fdf9e0800+11:15021:x1875336003444224:12345-192.168.206.5@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788460238.853159:0:17204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460238.853175:0:17204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4bc6ca7800/0x5dfa74784542c527 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794aa4a expref: -99 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460238.853205:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bc6ca7800/0x5dfa74784542c527 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x50000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794aa4a expref: 12 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460238.853217:0:17204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4bc6ca7800/0x5dfa74784542c527 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794aa4a expref: 12 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460238.853226:0:17204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc6ca7800, rc 0) 00000100:00100000:3.0:1788460238.853329:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac2b3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:051c7034-18a2-40f3-ae82-fb4fdf9e0800+12:15021:x1875336003444224:12345-192.168.206.5@tcp:101:mount.lustre.0 Request processed in 189us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460238.853335:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 150 00000100:00100000:3.0:1788460238.867522:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460238.868126:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003444352 00000100:00100000:2.0:1788460238.868140:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003444352 00000100:00100000:2.0:1788460238.868327:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 151 00000100:00100000:2.0:1788460238.868341:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac2b39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:051c7034-18a2-40f3-ae82-fb4fdf9e0800+12:15021:x1875336003444352:12345-192.168.206.5@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788460238.868807:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac2b39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:051c7034-18a2-40f3-ae82-fb4fdf9e0800+12:15021:x1875336003444352:12345-192.168.206.5@tcp:501:mount.lustre.0 Request processed in 467us (1361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460238.868817:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 151 00000100:00100000:3.0:1788460238.874353:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460238.878906:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003444480 00000100:00100000:1.0:1788460238.878928:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003444480 00000100:00100000:1.0:1788460238.879364:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 152 00000100:00100000:1.0:1788460238.879377:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac2b38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:051c7034-18a2-40f3-ae82-fb4fdf9e0800+12:15021:x1875336003444480:12345-192.168.206.5@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788460238.879722:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac2b38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:051c7034-18a2-40f3-ae82-fb4fdf9e0800+12:15021:x1875336003444480:12345-192.168.206.5@tcp:503:mount.lustre.0 Request processed in 338us (5375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460238.879736:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 152 00000100:00100000:3.0:1788460238.884099:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460238.884226:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003444608 00000100:00100000:2.0:1788460238.884363:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003444608 00000100:00100000:2.0:1788460238.884436:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 153 00000100:00100000:2.0:1788460238.884912:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac2b3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:051c7034-18a2-40f3-ae82-fb4fdf9e0800+12:15025:x1875336003444608:12345-192.168.206.5@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788460238.886457:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac2b3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:051c7034-18a2-40f3-ae82-fb4fdf9e0800+12:15025:x1875336003444608:12345-192.168.206.5@tcp:502:llog_process_th.0 Request processed in 1989us (2348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460238.886475:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 153 00000100:00100000:2.0:1788460238.916104:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460238.916296:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003444736 00000100:00100000:1.0:1788460238.916306:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003444736 00000100:00100000:1.0:1788460238.916366:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 154 00000100:00100000:1.0:1788460238.916386:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac2b39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:051c7034-18a2-40f3-ae82-fb4fdf9e0800+12:15025:x1875336003444736:12345-192.168.206.5@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788460238.916674:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac2b39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:051c7034-18a2-40f3-ae82-fb4fdf9e0800+12:15025:x1875336003444736:12345-192.168.206.5@tcp:502:llog_process_th.0 Request processed in 297us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460238.916683:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 154 00000100:00100000:0.0:1788460238.922699:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460238.926785:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003444864 00000100:00100000:2.0:1788460238.926799:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003444864 00000100:00100000:2.0:1788460238.926871:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 155 00000100:00100000:2.0:1788460238.926881:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4c02042450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:051c7034-18a2-40f3-ae82-fb4fdf9e0800+12:15025:x1875336003444864:12345-192.168.206.5@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788460238.927068:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4c02042450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:051c7034-18a2-40f3-ae82-fb4fdf9e0800+12:15025:x1875336003444864:12345-192.168.206.5@tcp:502:llog_process_th.0 Request processed in 187us (4376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460238.927076:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 155 00000100:00100000:2.0:1788460238.932988:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460238.933110:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003444992 00000100:00100000:3.0:1788460238.933120:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003444992 00000100:00100000:3.0:1788460238.933175:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 156 00000100:00100000:3.0:1788460238.933186:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4c02041450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:051c7034-18a2-40f3-ae82-fb4fdf9e0800+12:15021:x1875336003444992:12345-192.168.206.5@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788460238.933200:0:17205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460238.933216:0:17205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4bc6ca6a00/0x5dfa74784542c52e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794aa7b expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460238.933256:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bc6ca6a00/0x5dfa74784542c52e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794aa7b expref: 13 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460238.933268:0:17205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4bc6ca6a00/0x5dfa74784542c52e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794aa7b expref: 13 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460238.933277:0:17205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc6ca6a00, rc 0) 00000100:00100000:3.0:1788460238.933579:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4c02041450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:051c7034-18a2-40f3-ae82-fb4fdf9e0800+13:15021:x1875336003444992:12345-192.168.206.5@tcp:101:mount.lustre.0 Request processed in 392us (751us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460238.933587:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 156 00000100:00100000:0.0:1788460238.938592:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460238.939686:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003445120 00000100:00100000:1.0:1788460238.939699:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003445120 00000100:00100000:1.0:1788460238.939808:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 157 00000100:00100000:1.0:1788460238.939819:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4c02042850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:051c7034-18a2-40f3-ae82-fb4fdf9e0800+13:15021:x1875336003445120:12345-192.168.206.5@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788460238.939861:0:17204:0:(mgs_nids.c:1209:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788460238.939883:0:17204:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788460238.939887:0:17204:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788460238.939890:0:17204:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788460238.939893:0:17204:0:(mgs_nids.c:314:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1788460238.939895:0:17204:0:(mgs_nids.c:325:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:1.0:1788460238.946341:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4c02042850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:051c7034-18a2-40f3-ae82-fb4fdf9e0800+13:15021:x1875336003445120:12345-192.168.206.5@tcp:256:mount.lustre.0 Request processed in 6515us (7747us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460238.946355:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 157 00000100:00100000:3.0:1788460238.953567:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460238.953722:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003445248 00000100:00100000:1.0:1788460238.953734:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003445248 00000100:00100000:1.0:1788460238.953793:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 158 00000100:00100000:1.0:1788460238.953802:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfc2e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:051c7034-18a2-40f3-ae82-fb4fdf9e0800+13:15021:x1875336003445248:12345-192.168.206.5@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788460238.953838:0:17205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460238.953856:0:17205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4bc6380000/0x5dfa74784542c535 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794aa82 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460238.953884:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bc6380000/0x5dfa74784542c535 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794aa82 expref: 14 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460238.953895:0:17205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4bc6380000/0x5dfa74784542c535 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794aa82 expref: 14 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460238.953904:0:17205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc6380000, rc 0) 00000100:00100000:1.0:1788460238.954010:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfc2e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:051c7034-18a2-40f3-ae82-fb4fdf9e0800+14:15021:x1875336003445248:12345-192.168.206.5@tcp:101:mount.lustre.0 Request processed in 208us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460238.954018:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 158 00000100:00100000:0.0:1788460238.956554:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460238.956640:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003445376 00000100:00100000:1.0:1788460238.956650:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003445376 00000100:00100000:1.0:1788460238.956765:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 159 00000100:00100000:1.0:1788460238.956776:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfc2e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:051c7034-18a2-40f3-ae82-fb4fdf9e0800+14:15021:x1875336003445376:12345-192.168.206.5@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788460238.956976:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfc2e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:051c7034-18a2-40f3-ae82-fb4fdf9e0800+14:15021:x1875336003445376:12345-192.168.206.5@tcp:501:mount.lustre.0 Request processed in 170us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460238.956985:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 159 00000100:00100000:2.0:1788460238.961052:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460238.961151:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003445504 00000100:00100000:3.0:1788460238.961160:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003445504 00000100:00100000:3.0:1788460238.961250:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 160 00000100:00100000:3.0:1788460238.961260:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfc2e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:051c7034-18a2-40f3-ae82-fb4fdf9e0800+14:15021:x1875336003445504:12345-192.168.206.5@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788460238.961398:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfc2e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:051c7034-18a2-40f3-ae82-fb4fdf9e0800+14:15021:x1875336003445504:12345-192.168.206.5@tcp:503:mount.lustre.0 Request processed in 139us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460238.961418:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 160 00000100:00100000:2.0:1788460238.969817:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460238.969919:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003445632 00000100:00100000:0.0:1788460238.969929:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003445632 00000100:00100000:0.0:1788460238.970005:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 161 00000100:00100000:0.0:1788460238.970015:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfc2e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:051c7034-18a2-40f3-ae82-fb4fdf9e0800+14:15029:x1875336003445632:12345-192.168.206.5@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788460238.970182:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfc2e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:051c7034-18a2-40f3-ae82-fb4fdf9e0800+14:15029:x1875336003445632:12345-192.168.206.5@tcp:502:llog_process_th.0 Request processed in 167us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460238.970190:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 161 00000100:00100000:0.0:1788460238.975126:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460238.975309:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003445760 00000100:00100000:3.0:1788460238.975318:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003445760 00000100:00100000:3.0:1788460238.975375:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 162 00000100:00100000:3.0:1788460238.975385:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfc2e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:051c7034-18a2-40f3-ae82-fb4fdf9e0800+14:15029:x1875336003445760:12345-192.168.206.5@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788460238.975670:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfc2e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:051c7034-18a2-40f3-ae82-fb4fdf9e0800+14:15029:x1875336003445760:12345-192.168.206.5@tcp:502:llog_process_th.0 Request processed in 286us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460238.975679:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 162 00000100:00100000:2.0:1788460238.981729:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460238.981834:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460238.982128:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003445888 00000100:00100000:3.0:1788460238.982138:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003445888 00000100:00100000:3.0:1788460238.982185:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003446144 00000100:00100000:3.0:1788460238.982189:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003446144 00000100:00100000:3.0:1788460238.982213:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 16 00000100:00100000:3.0:1788460238.982219:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc43fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2392:x1875336003445888:12345-192.168.206.5@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788460238.982247:0:17213:0:(ldlm_lib.c:1461:target_handle_connect()) lustre-MDT0000: connection from b90b6ab2-35a4-41df-bd79-b1d2f118ec83@192.168.206.5@tcp t0 exp 0000000000000000 cur 536 last 0 00000020:00000080:3.0:1788460238.982282:0:17213:0:(genops.c:1385:class_connect()) connect: client b90b6ab2-35a4-41df-bd79-b1d2f118ec83, cookie 0x5dfa74784542c53c 00000004:00100000:3.0:1788460238.982305:0:17213:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788460238.982393:0:17213:0:(import.c:65:import_set_state_nolock()) ffff8c4ac38f1000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788460238.982453:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc43fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90b6ab2-35a4-41df-bd79-b1d2f118ec83+6:2392:x1875336003445888:12345-192.168.206.5@tcp:38:mount.lustre.0 Request processed in 232us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460238.982461:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 16 00000100:00100000:3.0:1788460238.982479:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 17 00000100:00100000:3.0:1788460238.982484:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc43f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2392:x1875336003446144:12345-192.168.206.5@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788460238.982500:0:17213:0:(ldlm_lib.c:1461:target_handle_connect()) lustre-MDT0001: connection from b90b6ab2-35a4-41df-bd79-b1d2f118ec83@192.168.206.5@tcp t0 exp 0000000000000000 cur 536 last 0 00000020:00000080:3.0:1788460238.982521:0:17213:0:(genops.c:1385:class_connect()) connect: client b90b6ab2-35a4-41df-bd79-b1d2f118ec83, cookie 0x5dfa74784542c543 00000004:00100000:3.0:1788460238.982533:0:17213:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788460238.982622:0:17213:0:(import.c:65:import_set_state_nolock()) ffff8c4ac38f6800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788460238.982649:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc43f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90b6ab2-35a4-41df-bd79-b1d2f118ec83+6:2392:x1875336003446144:12345-192.168.206.5@tcp:38:mount.lustre.0 Request processed in 162us (823us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460238.982655:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 17 00000100:00100000:2.0:1788460238.987042:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460238.987078:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460238.987262:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003446272 00000100:00100000:3.0:1788460238.987271:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003446272 00000100:00100000:3.0:1788460238.987337:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003446016 00000100:00100000:3.0:1788460238.987340:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003446016 00000100:00100000:3.0:1788460238.987364:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 18 00000100:00100000:3.0:1788460238.987382:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc43fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90b6ab2-35a4-41df-bd79-b1d2f118ec83+6:0:x1875336003446272:12345-192.168.206.5@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788460238.987429:0:17213:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788460238.987490:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc43fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90b6ab2-35a4-41df-bd79-b1d2f118ec83+6:0:x1875336003446272:12345-192.168.206.5@tcp:41:mount.lustre.0 Request processed in 110us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460238.987497:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 18 00000100:00100000:3.0:1788460238.987515:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 19 00000100:00100000:3.0:1788460238.987521:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc43fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90b6ab2-35a4-41df-bd79-b1d2f118ec83+6:0:x1875336003446016:12345-192.168.206.5@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788460238.987537:0:17213:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788460238.987563:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc43fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90b6ab2-35a4-41df-bd79-b1d2f118ec83+6:0:x1875336003446016:12345-192.168.206.5@tcp:41:mount.lustre.0 Request processed in 42us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460238.987569:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 19 00000100:00080000:0.0:1788460238.987638:0:17207:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788460238.987642:0:17207:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788460238.993266:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460238.993354:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003446400 00000100:00100000:3.0:1788460238.993365:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003446400 00000100:00100000:3.0:1788460238.993677:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 20 00000100:00100000:3.0:1788460238.993688:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac490a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90b6ab2-35a4-41df-bd79-b1d2f118ec83+6:15021:x1875336003446400:12345-192.168.206.5@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788460238.993718:0:17213:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788460238.993806:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac490a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90b6ab2-35a4-41df-bd79-b1d2f118ec83+6:15021:x1875336003446400:12345-192.168.206.5@tcp:41:mount.lustre.0 Request processed in 120us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460238.993814:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 20 00000100:00100000:2.0:1788460239.002064:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460239.002158:0:18741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003446528 00000100:00100000:0.0:1788460239.002177:0:18741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003446528 00000100:00100000:0.0:1788460239.002228:0:18741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 21 00000100:00100000:0.0:1788460239.002236:0:18741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc43f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90b6ab2-35a4-41df-bd79-b1d2f118ec83+6:15021:x1875336003446528:12345-192.168.206.5@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788460239.002320:0:18741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc43f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b90b6ab2-35a4-41df-bd79-b1d2f118ec83+6:15021:x1875336003446528:12345-192.168.206.5@tcp:40:mount.lustre.0 Request processed in 83us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460239.002327:0:18741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 21 00000100:00100000:2.0:1788460239.004810:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460239.004902:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003446656 00000100:00100000:3.0:1788460239.004911:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003446656 00000100:00100000:3.0:1788460239.004985:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 18 00000100:00100000:3.0:1788460239.004993:0:18720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc43f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2392:x1875336003446656:12345-192.168.206.5@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788460239.005029:0:18720:0:(ldlm_lib.c:1461:target_handle_connect()) lustre-OST0000: connection from b90b6ab2-35a4-41df-bd79-b1d2f118ec83@192.168.206.5@tcp t0 exp 0000000000000000 cur 536 last 0 00000020:00000080:3.0:1788460239.005058:0:18720:0:(genops.c:1385:class_connect()) connect: client b90b6ab2-35a4-41df-bd79-b1d2f118ec83, cookie 0x5dfa74784542c54a 00002000:00100000:3.0:1788460239.005085:0:18720:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli b90b6ab2-35a4-41df-bd79-b1d2f118ec83/ffff8c4ac38f1800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a07 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788460239.005094:0:18720:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788460239.005189:0:18720:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788460239.005217:0:18720:0:(import.c:65:import_set_state_nolock()) ffff8c4ac38f4800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788460239.005287:0:18720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc43f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b90b6ab2-35a4-41df-bd79-b1d2f118ec83+6:2392:x1875336003446656:12345-192.168.206.5@tcp:8:mount.lustre.0 Request processed in 293us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460239.005295:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 18 00000100:00100000:1.0:1788460239.006062:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460239.006098:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460239.006346:0:19281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003446912 00000100:00100000:2.0:1788460239.006479:0:18717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003446784 00000100:00100000:2.0:1788460239.006487:0:18717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003446784 00000100:00100000:2.0:1788460239.006525:0:18717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 19 00000100:00100000:2.0:1788460239.006533:0:18717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3838380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2392:x1875336003446784:12345-192.168.206.5@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788460239.006562:0:18717:0:(ldlm_lib.c:1461:target_handle_connect()) lustre-OST0001: connection from b90b6ab2-35a4-41df-bd79-b1d2f118ec83@192.168.206.5@tcp t0 exp 0000000000000000 cur 536 last 0 00000020:00000080:2.0:1788460239.006587:0:18717:0:(genops.c:1385:class_connect()) connect: client b90b6ab2-35a4-41df-bd79-b1d2f118ec83, cookie 0x5dfa74784542c551 00002000:00100000:2.0:1788460239.006598:0:18717:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli b90b6ab2-35a4-41df-bd79-b1d2f118ec83/ffff8c4c0147d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a07 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788460239.006607:0:18717:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788460239.006674:0:18717:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788460239.006698:0:18717:0:(import.c:65:import_set_state_nolock()) ffff8c4c0147b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788460239.006766:0:18717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3838380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b90b6ab2-35a4-41df-bd79-b1d2f118ec83+6:2392:x1875336003446784:12345-192.168.206.5@tcp:8:mount.lustre.0 Request processed in 231us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460239.006775:0:18717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 19 00000100:00100000:3.0:1788460239.006876:0:19281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003446912 00000100:00100000:3.0:1788460239.006918:0:19281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 4 00000100:00100000:3.0:1788460239.006926:0:19281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac383ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0002:b90b6ab2-35a4-41df-bd79-b1d2f118ec83+6:15021:x1875336003446912:12345-192.168.206.5@tcp:900:mount.lustre.0 00000100:00100000:3.0:1788460239.006978:0:19281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac383ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0002:b90b6ab2-35a4-41df-bd79-b1d2f118ec83+6:15021:x1875336003446912:12345-192.168.206.5@tcp:900:mount.lustre.0 Request processed in 53us (920us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460239.006985:0:19281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 4 00000100:00100000:2.0:1788460239.011844:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460239.012132:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003447040 00000100:00100000:0.0:1788460239.012142:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003447040 00000100:00100000:0.0:1788460239.012229:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 1 00000100:00100000:0.0:1788460239.012239:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc43f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b90b6ab2-35a4-41df-bd79-b1d2f118ec83+6:15021:x1875336003447040:12345-192.168.206.5@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788460239.012344:0:17215:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788460239.012418:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc43f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b90b6ab2-35a4-41df-bd79-b1d2f118ec83+6:15021:x1875336003447040:12345-192.168.206.5@tcp:33:mount.lustre.0 Request processed in 179us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460239.012426:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 1 00000100:00100000:1.0:1788460239.167006:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460239.167304:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003447168 00000100:00100000:3.0:1788460239.167318:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003447168 00000100:00100000:3.0:1788460239.167394:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 22 00000100:00100000:3.0:1788460239.167406:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3838000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90b6ab2-35a4-41df-bd79-b1d2f118ec83+6:15052:x1875336003447168:12345-192.168.206.5@tcp:101:mkdir.0 00010000:00010000:3.0:1788460239.167675:0:17212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460239.167704:0:17212:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca6e00/0x5dfa74784542c558 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794aab3 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460239.167790:0:17212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca6000/0x5dfa74784542c55f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460239.167808:0:17212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca6000/0x5dfa74784542c55f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460239.167867:0:17212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca6000/0x5dfa74784542c55f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788460239.167924:0:17212:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788460239.167929:0:17212:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788460239.167994:0:17212:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca6000/0x5dfa74784542c55f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460239.168027:0:17212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca6e00/0x5dfa74784542c558 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794aab3 expref: 8 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460239.168049:0:17212:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca6000/0x5dfa74784542c55f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794aab3 expref: 7 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460239.168058:0:17212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4bef1fee00) 00010000:00010000:3.0:1788460239.168061:0:17212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788460239.168065:0:17212:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc6ca6000, rc 0) 00000100:00100000:3.0:1788460239.168357:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3838000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90b6ab2-35a4-41df-bd79-b1d2f118ec83+7:15052:x1875336003447168:12345-192.168.206.5@tcp:101:mkdir.0 Request processed in 951us (1417us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460239.168367:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 22 00010000:00010000:2.0:1788460239.762350:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788460239.954526:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788460239.954548:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac490b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022405888:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788460239.954646:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460239.954803:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac383a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022406016:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788460239.954844:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460239.954937:0:17952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022405888 00000100:00100000:3.0:1788460239.954960:0:17952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022405888 00000100:00100000:3.0:1788460239.955002:0:17952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022406016 00000100:00100000:3.0:1788460239.955005:0:17952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022406016 00000100:00100000:3.0:1788460239.955032:0:17952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788460239.955041:0:17952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac490aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022405888:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788460239.955072:0:17952:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788460239.955119:0:17952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac490aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022405888:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460239.955137:0:17952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788460239.955156:0:17952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788460239.955163:0:17952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4908a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022406016:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788460239.955179:0:17952:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788460239.955212:0:17952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4908a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022406016:12345-0@lo:41:osp-pre-1-0.0 Request processed in 50us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460239.955218:0:17952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788460239.955256:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac490b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022405888:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788460239.955284:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac383a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022406016:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788460240.785165:0:18366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788460241.489153:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfaea9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022406528:0@lo:400:kworker.0 00000100:00100000:2.0:1788460241.489223:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460241.489229:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfaea9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022406400:0@lo:400:kworker.0 00000100:00100000:3.0:1788460241.489267:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460241.489290:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfaea8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022407040:0@lo:400:kworker.0 00000100:00100000:3.0:1788460241.489304:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfaea9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022406912:0@lo:400:kworker.0 00000100:00100000:2.0:1788460241.489317:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460241.489337:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460241.489341:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfaeaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1875336022407552:0@lo:400:kworker.0 00000100:00100000:3.0:1788460241.489362:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfaea8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3662:1875336022407424:0@lo:400:kworker.0 00000100:00100000:2.0:1788460241.489384:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460241.489403:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460241.489407:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1788460241.489415:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc43f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022406144:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788460241.489456:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460241.489475:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfaea8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022406656:0@lo:400:kworker.0 00000100:00100000:2.0:1788460241.489491:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460241.489503:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfaeaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022407168:0@lo:400:kworker.0 00000100:00100000:2.0:1788460241.489521:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460241.489536:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfaeabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1875336022407680:0@lo:400:kworker.0 00000100:00100000:3.0:1788460241.489546:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:3.0:1788460241.489556:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfaeaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c482be18-c056-4068-8a37-ed5038fc364a:3662:1875336022406272:0@lo:400:kworker.0 00000100:00100000:2.0:1788460241.489564:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460241.489591:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460241.489600:0:19273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022406528 00000100:00100000:2.0:1788460241.489607:0:19273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022406528 00000100:00100000:3.0:1788460241.489618:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfaea9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3662:1875336022406784:0@lo:400:kworker.0 00000100:00100000:2.0:1788460241.489654:0:19273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022407040 00000100:00100000:3.0:1788460241.489658:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460241.489658:0:19273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022407040 00000100:00100000:2.0:1788460241.489672:0:19273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022406656 00000100:00100000:2.0:1788460241.489676:0:19273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022406656 00000100:00100000:2.0:1788460241.489690:0:19273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022407168 00000100:00100000:3.0:1788460241.489691:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfaea8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3662:1875336022407296:0@lo:400:kworker.0 00000100:00100000:2.0:1788460241.489694:0:19273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022407168 00000100:00100000:2.0:1788460241.489716:0:19273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788460241.489720:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460241.489728:0:19273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc43f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022406528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460241.489774:0:19273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc43f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022406528:12345-0@lo:400:kworker.0 Request processed in 49us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460241.489781:0:19273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788460241.489807:0:19273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788460241.489823:0:19273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc43fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022407040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460241.489853:0:19273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc43fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022407040:12345-0@lo:400:kworker.0 Request processed in 41us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460241.489859:0:19273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788460241.489883:0:19273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788460241.489890:0:19273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc43f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022406656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460241.489926:0:19273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc43f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022406656:12345-0@lo:400:kworker.0 Request processed in 37us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460241.489932:0:19273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788460241.489975:0:19273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788460241.489982:0:19273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc43fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022407168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460241.490010:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfaeab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1875336022407808:0@lo:400:kworker.0 00000100:00100000:2.0:1788460241.490025:0:19273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc43fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022407168:12345-0@lo:400:kworker.0 Request processed in 43us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460241.490033:0:19273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788460241.490049:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460241.490060:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022406144 00000100:00100000:2.0:1788460241.490065:0:18722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022406144 00000100:00100000:3.0:1788460241.490082:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022406400 00000100:00100000:3.0:1788460241.490088:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022406400 00000100:00100000:2.0:1788460241.490095:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788460241.490103:0:18722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc43f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022406144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788460241.490123:0:18722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788460241.490151:0:18722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc43f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022406144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460241.490158:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788460241.490159:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022406912 00000100:00100000:3.0:1788460241.490164:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022406912 00000100:00100000:2.0:1788460241.490193:0:3659:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:2.0:1788460241.490211:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc43f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022406144:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788460241.490220:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfaea8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022406656:0@lo:400:kworker.0 00000100:00100000:2.0:1788460241.490228:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfaeaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022407168:0@lo:400:kworker.0 00000100:00100000:2.0:1788460241.490236:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfaea8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022407040:0@lo:400:kworker.0 00000100:00100000:2.0:1788460241.490244:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfaea9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022406528:0@lo:400:kworker.0 00000100:00100000:2.0:1788460241.490280:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022407552 00000100:00100000:2.0:1788460241.490289:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022407552 00000100:00100000:2.0:1788460241.490309:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022407424 00000100:00100000:2.0:1788460241.490311:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022407424 00000100:00100000:3.0:1788460241.490320:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788460241.490328:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022407680 00000100:00100000:3.0:1788460241.490330:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfaea9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1875336022406400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460241.490332:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022407680 00000100:00100000:2.0:1788460241.490346:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022406784 00000100:00100000:2.0:1788460241.490350:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022406784 00000100:00100000:2.0:1788460241.490361:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022407296 00000100:00100000:2.0:1788460241.490363:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022407296 00000100:00100000:2.0:1788460241.490375:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022407808 00000100:00100000:2.0:1788460241.490377:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022407808 00000100:00100000:3.0:1788460241.490383:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfaea9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3662:x1875336022406400:12345-0@lo:400:kworker.0 Request processed in 54us (1113us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460241.490392:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788460241.490393:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788460241.490402:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc43fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1875336022407552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460241.490415:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788460241.490438:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc43fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1875336022407552:12345-0@lo:400:kworker.0 Request processed in 38us (1054us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460241.490444:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788460241.490455:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788460241.490460:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf75e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1875336022407424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460241.490481:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf75e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3662:x1875336022407424:12345-0@lo:400:kworker.0 Request processed in 21us (1080us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460241.490487:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788460241.490495:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788460241.490501:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc43faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1875336022407680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460241.490522:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc43faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1875336022407680:12345-0@lo:400:kworker.0 Request processed in 22us (959us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460241.490528:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788460241.490538:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788460241.490545:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1875336022406784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460241.490571:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788460241.490580:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3662:x1875336022406784:12345-0@lo:400:kworker.0 Request processed in 36us (933us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460241.490584:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1875336022407296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460241.490590:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788460241.490604:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788460241.490611:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875336022407808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460241.490639:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1875336022407296:12345-0@lo:400:kworker.0 Request processed in 59us (919us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460241.490646:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875336022407808:12345-0@lo:400:kworker.0 Request processed in 34us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460241.490665:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788460241.490692:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022406272 00000100:00100000:1.0:1788460241.490695:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022406272 00000100:00100000:1.0:1788460241.490720:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788460241.490727:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfc2e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+29:3662:x1875336022406272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460241.490995:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfc2e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+29:3662:x1875336022406272:12345-0@lo:400:kworker.0 Request processed in 267us (1402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460241.491001:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788460241.491031:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788460241.491048:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac383b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022407936:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788460241.491083:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460241.491108:0:18721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022407936 00000100:00100000:1.0:1788460241.491112:0:18721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022407936 00000100:00100000:1.0:1788460241.491134:0:18721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788460241.491141:0:18721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3839c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022407936:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788460241.491152:0:18721:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788460241.491520:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfaeaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022406912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460241.491566:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfaeaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022406912:12345-0@lo:400:kworker.0 Request processed in 1143us (2229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460241.491573:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788460241.491686:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfaeaad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c482be18-c056-4068-8a37-ed5038fc364a:3662:1875336022406272:0@lo:400:kworker.0 00000100:00100000:3.0:1788460241.491701:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfaea9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3662:1875336022406784:0@lo:400:kworker.0 00000100:00100000:3.0:1788460241.491711:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfaea8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3662:1875336022407296:0@lo:400:kworker.0 00010000:00080000:3.0:1788460241.491722:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bfaeab100 x1875336022407808/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460241.491732:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfaeab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1875336022407808:0@lo:400:kworker.0 00000100:00100000:1.0:1788460241.491828:0:18721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3839c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022407936:12345-0@lo:13:osp-pre-1-1.0 Request processed in 687us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460241.491836:0:18721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788460241.491937:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac383b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022407936:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1788460241.492139:0:17207:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788460241.492145:0:17207:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788460241.492148:0:17207:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788460241.492151:0:17207:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788460241.492155:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788460241.492192:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac490b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022408064:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788460241.492229:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460241.492260:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfaeabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1875336022407680:0@lo:400:kworker.0 00000100:00100000:0.0:1788460241.492262:0:19707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022408064 00000100:00100000:0.0:1788460241.492268:0:19707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022408064 00010000:00080000:2.0:1788460241.492275:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bfaeaa680 x1875336022407552/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788460241.492285:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfaeaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1875336022407552:0@lo:400:kworker.0 00000100:00100000:0.0:1788460241.492301:0:19707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788460241.492309:0:19707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc43f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022408064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788460241.492339:0:19707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788460241.492385:0:19707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc43f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022408064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460241.492391:0:19707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788460241.492627:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac490b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022408064:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788460241.497301:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfaea9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022406400:0@lo:400:kworker.0 00000100:00100000:2.0:1788460241.497320:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfaea9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022406912:0@lo:400:kworker.0 00000100:00100000:2.0:1788460241.497334:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfaea8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3662:1875336022407424:0@lo:400:kworker.0 00000001:02000400:2.0:1788460241.685648:0:20090:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1788460241.810626:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788460242.001611:0:17965:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:0.0:1788460242.003496:0:17944:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of b90b6ab2-35a4-41df-bd79-b1d2f118ec83 00000001:00100000:0.0:1788460242.003576:0:17944:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of f3471709-a010-41d7-90bc-b8b3ea7c57b0 00000001:00100000:1.0:1788460242.005774:0:17192:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b90b6ab2-35a4-41df-bd79-b1d2f118ec83 00000001:00100000:1.0:1788460242.005784:0:17192:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f3471709-a010-41d7-90bc-b8b3ea7c57b0 00010000:00010000:0.0:1788460242.833203:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788460243.540066:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788460243.540090:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac41bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022408192:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788460243.540153:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460243.540537:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022408192 00000100:00100000:1.0:1788460243.540545:0:18722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022408192 00000100:00100000:1.0:1788460243.540604:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788460243.540613:0:18722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc43fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022408192:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788460243.540640:0:18722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788460243.540688:0:18722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc43fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022408192:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460243.540695:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788460243.540751:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac41bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022408192:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788460243.540865:0:17207:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788460243.857128:0:18366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460244.415413:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460244.415460:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460244.415485:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460244.415543:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460244.415584:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460244.415611:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460244.415632:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460244.415652:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460244.415672:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460244.415700:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003447424 00000100:00100000:3.0:1788460244.415709:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003447424 00000100:00100000:3.0:1788460244.415755:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003447936 00000100:00100000:3.0:1788460244.415758:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003447936 00000100:00100000:3.0:1788460244.415771:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003447552 00000100:00100000:3.0:1788460244.415773:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003447552 00000100:00100000:3.0:1788460244.415783:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003448064 00000100:00100000:3.0:1788460244.415785:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003448064 00000100:00100000:3.0:1788460244.415813:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 40 00000100:00100000:3.0:1788460244.415823:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3471709-a010-41d7-90bc-b8b3ea7c57b0+6:2395:x1875336003447424:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:3.0:1788460244.415894:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3471709-a010-41d7-90bc-b8b3ea7c57b0+6:2395:x1875336003447424:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 73us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460244.416203:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 40 00000100:00080000:0.0:1788460244.416591:0:17207:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788460244.416600:0:17207:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788460244.416615:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003447680 00000100:00100000:0.0:1788460244.416626:0:18719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003447680 00000100:00100000:0.0:1788460244.416687:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003448192 00000100:00100000:0.0:1788460244.416691:0:18719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003448192 00000100:00100000:0.0:1788460244.416707:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003447808 00000100:00100000:0.0:1788460244.416709:0:18719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003447808 00000100:00100000:0.0:1788460244.416781:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003448320 00000100:00100000:0.0:1788460244.416785:0:18719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003448320 00000100:00100000:0.0:1788460244.416816:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 10 00000100:00100000:0.0:1788460244.416826:0:18719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f3471709-a010-41d7-90bc-b8b3ea7c57b0+5:2395:x1875336003447680:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:0.0:1788460244.416899:0:18719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f3471709-a010-41d7-90bc-b8b3ea7c57b0+5:2395:x1875336003447680:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 75us (1439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460244.416907:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 10 00000100:00100000:0.0:1788460244.416923:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 11 00000100:00100000:0.0:1788460244.416929:0:18719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b90b6ab2-35a4-41df-bd79-b1d2f118ec83+6:2395:x1875336003448192:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:0.0:1788460244.416985:0:18719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b90b6ab2-35a4-41df-bd79-b1d2f118ec83+6:2395:x1875336003448192:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 55us (1454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460244.417367:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 11 00000100:00100000:0.0:1788460244.417401:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 12 00000100:00100000:0.0:1788460244.417409:0:18719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f3471709-a010-41d7-90bc-b8b3ea7c57b0+5:2395:x1875336003447808:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:0.0:1788460244.417438:0:18719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f3471709-a010-41d7-90bc-b8b3ea7c57b0+5:2395:x1875336003447808:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 31us (1806us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460244.417445:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 12 00000100:00100000:0.0:1788460244.417453:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 13 00000100:00100000:0.0:1788460244.417459:0:18719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b90b6ab2-35a4-41df-bd79-b1d2f118ec83+6:2395:x1875336003448320:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:0.0:1788460244.417476:0:18719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b90b6ab2-35a4-41df-bd79-b1d2f118ec83+6:2395:x1875336003448320:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 18us (1803us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460244.417482:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 13 00000100:00100000:1.0:1788460244.418444:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003447296 00000100:00100000:1.0:1788460244.418458:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003447296 00000100:00100000:1.0:1788460244.418508:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 164 00000100:00100000:1.0:1788460244.418531:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfc2e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:051c7034-18a2-40f3-ae82-fb4fdf9e0800+14:2395:x1875336003447296:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:1.0:1788460244.418591:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfc2e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:051c7034-18a2-40f3-ae82-fb4fdf9e0800+14:2395:x1875336003447296:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 63us (3009us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460244.418599:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 164 00000100:00080000:1.0:1788460244.418647:0:17207:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788460244.418653:0:17207:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788460244.423424:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 41 00000100:00100000:2.0:1788460244.423463:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90b6ab2-35a4-41df-bd79-b1d2f118ec83+6:2395:x1875336003447936:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:3.0:1788460244.423558:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 42 00000100:00100000:2.0:1788460244.423575:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90b6ab2-35a4-41df-bd79-b1d2f118ec83+6:2395:x1875336003447936:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 131us (8087us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460244.423588:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3471709-a010-41d7-90bc-b8b3ea7c57b0+5:2395:x1875336003447552:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:2.0:1788460244.423589:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 41 00000100:00100000:2.0:1788460244.423644:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 43 00000100:00100000:2.0:1788460244.423657:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90b6ab2-35a4-41df-bd79-b1d2f118ec83+5:2395:x1875336003448064:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:3.0:1788460244.423696:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3471709-a010-41d7-90bc-b8b3ea7c57b0+5:2395:x1875336003447552:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 120us (8080us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460244.423705:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 42 00000100:00100000:2.0:1788460244.425246:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90b6ab2-35a4-41df-bd79-b1d2f118ec83+5:2395:x1875336003448064:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 1583us (9583us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460244.425263:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 43 00000020:00000080:0.0:1788460244.833683:0:20237:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe6b4aff40 20000000:00000080:0.0:1788460244.833699:0:20237:0:(mgs_handler.c:1172:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8c4bc6256c00 uarg=0000000000000000 20000000:01000000:0.0:1788460244.833738:0:20237:0:(mgs_llog.c:6198:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788460244.833743:0:20237:0:(mgs_llog.c:4653:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788460244.833747:0:20237:0:(mgs_llog.c:1385:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788460244.834448:0:20238:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:0.0:1788460244.834662:0:20237:0:(mgs_llog.c:1456:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788460244.849430:0:20237:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788460244.849520:0:20237:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8c4bef209a00/0x5dfa74784542c566 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460244.849539:0:20237:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4bc29d3c00/0x5dfa74784542c192 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542c18b expref: 28 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460244.849547:0:20237:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4bc2bd5600/0x5dfa74784542c1a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542c199 expref: 28 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460244.849554:0:20237:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4bc29d2600/0x5dfa74784542c1fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542c1f4 expref: 28 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460244.849579:0:20237:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4bfadc7c00/0x5dfa74784542c2bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542c2b8 expref: 28 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460244.849589:0:20237:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4bc6380a00/0x5dfa74784542c4ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794aa0b expref: 13 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460244.849596:0:20237:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8c4bc6380000/0x5dfa74784542c535 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794aa82 expref: 13 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460244.849604:0:20237:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8c4bef209a00/0x5dfa74784542c566 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460244.849648:0:20237:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4bc6380000/0x5dfa74784542c535 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794aa82 expref: 13 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460244.849663:0:20237:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c4bc6380000/0x5dfa74784542c535 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794aa82 expref: 13 pid: 17205 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460244.849676:0:20237:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac490b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20237:1875336022408320:192.168.206.5@tcp:104: 00010000:00010000:0.0:1788460244.849785:0:20237:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4bc6380a00/0x5dfa74784542c4ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794aa0b expref: 13 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460244.849806:0:20237:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c4bc6380a00/0x5dfa74784542c4ef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794aa0b expref: 13 pid: 17205 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460244.849816:0:20237:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4395f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20237:1875336022408448:192.168.206.5@tcp:104: 00010000:00010000:0.0:1788460244.849850:0:20237:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4bfadc7c00/0x5dfa74784542c2bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5dfa74784542c2b8 expref: 28 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460244.849869:0:20237:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c4bfadc7c00/0x5dfa74784542c2bf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5dfa74784542c2b8 expref: 28 pid: 17206 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460244.849878:0:20237:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc4394e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20237:1875336022408576:0@lo:104: 00000100:00100000:0.0:1788460244.849916:0:20237:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460244.850058:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022408576 00000100:00100000:1.0:1788460244.850066:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022408576 00000100:00100000:1.0:1788460244.850111:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788460244.850119:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc4396d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c482be18-c056-4068-8a37-ed5038fc364a+3:20237:x1875336022408576:12345-0@lo:104: 00010000:00010000:1.0:1788460244.850131:0:17196:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0400/0x5dfa74784542c2b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542c2bf expref: -99 pid: 19532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460244.850176:0:17196:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788460244.850181:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc4396d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c482be18-c056-4068-8a37-ed5038fc364a+3:20237:x1875336022408576:12345-0@lo:104: Request processed in 63us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460244.850187:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1788460244.850453:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788460244.850466:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0400/0x5dfa74784542c2b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542c2bf expref: -99 pid: 19532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460244.850473:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc14f0400 already unused, calling callback (ffffffffc125ae00) 10000000:00010000:2.0:1788460244.850476:0:17200:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0400/0x5dfa74784542c2b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5dfa74784542c2bf expref: -99 pid: 19532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460244.850484:0:17200:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0400/0x5dfa74784542c2b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5dfa74784542c2bf expref: -99 pid: 19532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788460244.850491:0:17200:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0400/0x5dfa74784542c2b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5dfa74784542c2bf expref: -99 pid: 19532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788460244.850496:0:17200:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788460244.850532:0:17200:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0400/0x5dfa74784542c2b8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542c2bf expref: -99 pid: 19532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460244.850550:0:17200:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788460244.850580:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0400/0x5dfa74784542c2b8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542c2bf expref: -99 pid: 19532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460244.850587:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: ffff8c4bc14f0400/0x5dfa74784542c2b8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542c2bf expref: -99 pid: 19532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460244.850601:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460244.850603:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460244.850604:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788460244.851648:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc43f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c482be18-c056-4068-8a37-ed5038fc364a:3661:1875336022408704:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788460244.851703:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460244.851773:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022408704 00000100:00100000:1.0:1788460244.851800:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022408704 00010000:00010000:1.0:1788460244.851828:0:17197:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4bfadc7c00/0x5dfa74784542c2bf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542c2b8 expref: 29 pid: 17206 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460244.851866:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788460244.851874:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c482be18-c056-4068-8a37-ed5038fc364a+29:3661:x1875336022408704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788460244.851887:0:17197:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788460244.851892:0:17197:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4bfadc7c00/0x5dfa74784542c2bf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542c2b8 expref: 29 pid: 17206 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460244.851901:0:20237:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4bc29d2600/0x5dfa74784542c1fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5dfa74784542c1f4 expref: 29 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460244.851913:0:20237:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c4bc29d2600/0x5dfa74784542c1fb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5dfa74784542c1f4 expref: 29 pid: 17205 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460244.851922:0:17197:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4bfadc7c00/0x5dfa74784542c2bf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5dfa74784542c2b8 expref: 29 pid: 17206 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460244.851923:0:20237:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc532ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20237:1875336022408832:0@lo:104: 00010000:00010000:1.0:1788460244.851939:0:17197:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788460244.851963:0:20237:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460244.851993:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c482be18-c056-4068-8a37-ed5038fc364a+29:3661:x1875336022408704:12345-0@lo:103:ldlm_bl.0 Request processed in 120us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460244.852001:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788460244.852024:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022408832 00000100:00100000:1.0:1788460244.852028:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022408832 00000100:00100000:1.0:1788460244.852055:0:17196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788460244.852061:0:17196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc532d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c482be18-c056-4068-8a37-ed5038fc364a+3:20237:x1875336022408832:12345-0@lo:104: 00010000:00010000:1.0:1788460244.852071:0:17196:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677600/0x5dfa74784542c1f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542c1fb expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460244.852108:0:17196:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788460244.852112:0:17196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc532d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c482be18-c056-4068-8a37-ed5038fc364a+3:20237:x1875336022408832:12345-0@lo:104: Request processed in 52us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460244.852118:0:17196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1788460244.852133:0:17201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788460244.852138:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677600/0x5dfa74784542c1f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542c1fb expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460244.852144:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac3677600 already unused, calling callback (ffffffffc125ae00) 10000000:00010000:1.0:1788460244.852148:0:17201:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677600/0x5dfa74784542c1f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5dfa74784542c1fb expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460244.852156:0:17201:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677600/0x5dfa74784542c1f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5dfa74784542c1fb expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788460244.852174:0:17201:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677600/0x5dfa74784542c1f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5dfa74784542c1fb expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788460244.852179:0:17201:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788460244.852202:0:17201:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677600/0x5dfa74784542c1f4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542c1fb expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460244.852208:0:17201:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788460244.852217:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677600/0x5dfa74784542c1f4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542c1fb expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460244.852223:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677600/0x5dfa74784542c1f4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542c1fb expref: -99 pid: 18713 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460244.852233:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460244.852234:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788460244.852236:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788460244.853119:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac383b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c482be18-c056-4068-8a37-ed5038fc364a:3662:1875336022408960:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788460244.853163:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460244.853222:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022408960 00000100:00100000:0.0:1788460244.853227:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022408960 00010000:00010000:0.0:1788460244.853251:0:17198:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4bc29d2600/0x5dfa74784542c1fb lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542c1f4 expref: 29 pid: 17205 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460244.853283:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788460244.853290:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac1e67050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c482be18-c056-4068-8a37-ed5038fc364a+29:3662:x1875336022408960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788460244.853300:0:17198:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788460244.853304:0:17198:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4bc29d2600/0x5dfa74784542c1fb lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542c1f4 expref: 29 pid: 17205 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460244.853313:0:17198:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4bc29d2600/0x5dfa74784542c1fb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5dfa74784542c1f4 expref: 29 pid: 17205 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460244.853328:0:17198:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788460244.853375:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac1e67050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c482be18-c056-4068-8a37-ed5038fc364a+29:3662:x1875336022408960:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460244.853381:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788460244.853482:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc43f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c482be18-c056-4068-8a37-ed5038fc364a:3661:1875336022408704:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788460244.854240:0:20237:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4bc2bd5600/0x5dfa74784542c1a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5dfa74784542c199 expref: 28 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460244.854252:0:20237:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c4bc2bd5600/0x5dfa74784542c1a0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5dfa74784542c199 expref: 28 pid: 17204 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460244.854264:0:20237:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc532f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20237:1875336022409088:0@lo:104: 00000100:00100000:0.0:1788460244.854313:0:20237:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788460244.854356:0:20237:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8c4bc29d3c00/0x5dfa74784542c192 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5dfa74784542c18b expref: 28 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460244.854364:0:20237:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8c4bc29d3c00/0x5dfa74784542c192 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5dfa74784542c18b expref: 28 pid: 17205 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460244.854373:0:20237:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc532ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20237:1875336022409216:0@lo:104: 00000100:00100000:0.0:1788460244.854392:0:20237:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bfa392600 going to sleep for 11 seconds 00000100:00100000:0.0:1788460244.854409:0:20237:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac490b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20237:1875336022408320:192.168.206.5@tcp:104: 00000100:00100000:0.0:1788460244.854418:0:20237:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4395f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20237:1875336022408448:192.168.206.5@tcp:104: 00010000:00010000:0.0:1788460244.854427:0:20237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4bfadc7c00/0x5dfa74784542c2bf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5dfa74784542c2b8 expref: 28 pid: 17206 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460244.854437:0:20237:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc4394e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20237:1875336022408576:0@lo:104: 00010000:00010000:0.0:1788460244.854445:0:20237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4bc29d2600/0x5dfa74784542c1fb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5dfa74784542c1f4 expref: 27 pid: 17205 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460244.854452:0:20237:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc532ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20237:1875336022408832:0@lo:104: 00000100:00100000:2.0:1788460244.854537:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac383b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c482be18-c056-4068-8a37-ed5038fc364a:3662:1875336022408960:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788460244.856140:0:17196:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788460244.856171:0:17196:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460244.856206:0:17196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022409088 00000100:00100000:1.0:1788460244.856213:0:17196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022409088 00000100:00100000:0.0:1788460244.856215:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022409216 00000100:00100000:0.0:1788460244.856218:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022409216 00000100:00100000:0.0:1788460244.856249:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788460244.856262:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac2901450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c482be18-c056-4068-8a37-ed5038fc364a+4:20237:x1875336022409088:12345-0@lo:104: 00010000:00010000:0.0:1788460244.856278:0:17195:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677000/0x5dfa74784542c199 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542c1a0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460244.856349:0:17195:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788460244.856354:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac2901450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c482be18-c056-4068-8a37-ed5038fc364a+4:20237:x1875336022409088:12345-0@lo:104: Request processed in 98us (2042us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460244.856409:0:20237:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc532f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20237:1875336022409088:0@lo:104: 00010000:00010000:2.0:1788460244.857109:0:18366:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788460244.857115:0:18366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677000/0x5dfa74784542c199 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542c1a0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460244.857123:0:18366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac3677000 already unused, calling callback (ffffffffc125ae00) 10000000:00010000:2.0:1788460244.857127:0:18366:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677000/0x5dfa74784542c199 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5dfa74784542c1a0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460244.857134:0:18366:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677000/0x5dfa74784542c199 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5dfa74784542c1a0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788460244.857141:0:18366:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677000/0x5dfa74784542c199 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5dfa74784542c1a0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788460244.857163:0:18366:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788460244.857200:0:18366:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677000/0x5dfa74784542c199 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542c1a0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460244.857207:0:18366:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788460244.857227:0:18366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677000/0x5dfa74784542c199 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542c1a0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460244.857234:0:18366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: ffff8c4ac3677000/0x5dfa74784542c199 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542c1a0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460244.857246:0:18366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460244.857248:0:18366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460244.857250:0:18366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788460244.857258:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788460244.857270:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc43f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c482be18-c056-4068-8a37-ed5038fc364a:3660:1875336022409344:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788460244.857308:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460244.859615:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460244.859686:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022409344 00000100:00100000:3.0:1788460244.859696:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022409344 00010000:00010000:3.0:1788460244.859735:0:17197:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4bc2bd5600/0x5dfa74784542c1a0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542c199 expref: 27 pid: 17204 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460244.860114:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788460244.860155:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788460244.860166:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3839500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c482be18-c056-4068-8a37-ed5038fc364a+3:20237:x1875336022409216:12345-0@lo:104: 00010000:00010000:0.0:1788460244.860178:0:17195:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: mgc192.168.206.105@tcp lock: ffff8c4ac3676600/0x5dfa74784542c18b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542c192 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460244.860242:0:17195:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788460244.860248:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3839500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c482be18-c056-4068-8a37-ed5038fc364a+3:20237:x1875336022409216:12345-0@lo:104: Request processed in 86us (4076us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460244.860254:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:0.0:1788460244.860271:0:17200:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788460244.860277:0:17200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mgc192.168.206.105@tcp lock: ffff8c4ac3676600/0x5dfa74784542c18b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5dfa74784542c192 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460244.860284:0:17200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac3676600 already unused, calling callback (ffffffffc125ae00) 10000000:00010000:0.0:1788460244.860288:0:17200:0:(mgc_request.c:1209:mgc_blocking_ast()) ### MGC blocking CB ns: mgc192.168.206.105@tcp lock: ffff8c4ac3676600/0x5dfa74784542c18b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5dfa74784542c192 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460244.860312:0:17200:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: mgc192.168.206.105@tcp lock: ffff8c4ac3676600/0x5dfa74784542c18b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5dfa74784542c192 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788460244.860319:0:17200:0:(mgc_request.c:1215:mgc_blocking_ast()) ### MGC cancel CB ns: mgc192.168.206.105@tcp lock: ffff8c4ac3676600/0x5dfa74784542c18b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5dfa74784542c192 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788460244.860324:0:17200:0:(mgc_request.c:1219:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788460244.860351:0:17200:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: mgc192.168.206.105@tcp lock: ffff8c4ac3676600/0x5dfa74784542c18b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542c192 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460244.860357:0:17200:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788460244.860374:0:17200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mgc192.168.206.105@tcp lock: ffff8c4ac3676600/0x5dfa74784542c18b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542c192 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460244.860381:0:17200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mgc192.168.206.105@tcp lock: ffff8c4ac3676600/0x5dfa74784542c18b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5dfa74784542c192 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460244.860396:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460244.860397:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788460244.860399:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788460244.860405:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788460244.860416:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc532d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c482be18-c056-4068-8a37-ed5038fc364a:3659:1875336022409472:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788460244.860448:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460244.866927:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003448448 00000100:00100000:1.0:1788460244.866927:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022409472 00000100:00100000:3.0:1788460244.866940:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003448448 00000100:00100000:1.0:1788460244.866940:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022409472 00010000:00010000:1.0:1788460244.867053:0:17199:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4bc29d3c00/0x5dfa74784542c192 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542c18b expref: 28 pid: 17205 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460244.867083:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788460244.867152:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc43f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c482be18-c056-4068-8a37-ed5038fc364a+28:3660:x1875336022409344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788460244.867175:0:17197:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4bc6380000/0x5dfa74784542c535 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794aa82 expref: 14 pid: 17205 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460244.867193:0:17197:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1788460244.867201:0:17197:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:1.0:1788460244.867357:0:17199:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788460244.867375:0:17199:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4bc2bd5600/0x5dfa74784542c1a0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542c199 expref: 28 pid: 17204 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460244.867387:0:17199:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4bc2bd5600/0x5dfa74784542c1a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5dfa74784542c199 expref: 28 pid: 17204 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460244.867445:0:17198:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788460244.867458:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788460244.867471:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc532c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c482be18-c056-4068-8a37-ed5038fc364a+28:3659:x1875336022409472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788460244.867477:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4bc2bd5600/0x5dfa74784542c1a0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5dfa74784542c199 expref: 28 pid: 17204 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460244.867482:0:17198:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460244.867490:0:17198:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4bc29d3c00/0x5dfa74784542c192 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5dfa74784542c18b expref: 27 pid: 17205 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460244.867494:0:17199:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788460244.867504:0:17198:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4bc29d3c00/0x5dfa74784542c192 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5dfa74784542c18b expref: 27 pid: 17205 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460244.867529:0:17198:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788460244.867557:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc43f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c482be18-c056-4068-8a37-ed5038fc364a+27:3660:x1875336022409344:12345-0@lo:103:ldlm_bl.0 Request processed in 406us (10247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460244.867566:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788460244.867577:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc532c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c482be18-c056-4068-8a37-ed5038fc364a+27:3659:x1875336022409472:12345-0@lo:103:ldlm_bl.0 Request processed in 108us (7126us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460244.867586:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788460244.867589:0:17199:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788460244.867600:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 15 00000100:00100000:1.0:1788460244.867607:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfaea8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:051c7034-18a2-40f3-ae82-fb4fdf9e0800+14:2394:x1875336003448448:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788460244.867616:0:17199:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788460244.867621:0:17199:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4bc6380000/0x5dfa74784542c535 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794aa82 expref: 14 pid: 17205 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460244.867632:0:17199:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4bc6380000/0x5dfa74784542c535 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794aa82 expref: 14 pid: 17205 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460244.867643:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4bc6380000/0x5dfa74784542c535 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794aa82 expref: 14 pid: 17205 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460244.867652:0:20237:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4bc29d3c00/0x5dfa74784542c192 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5dfa74784542c18b expref: 25 pid: 17205 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460244.867653:0:17199:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788460244.867667:0:20237:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc532ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20237:1875336022409216:0@lo:104: 00000100:00100000:1.0:1788460244.867698:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfaea8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:051c7034-18a2-40f3-ae82-fb4fdf9e0800+13:2394:x1875336003448448:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 90us (8090us total) trans 0 rc 0/0 00010000:00010000:2.0:1788460244.867703:0:20237:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8c4bef209a00/0x5dfa74784542c566 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460244.867707:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 15 00000100:00100000:1.0:1788460244.868097:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc43f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c482be18-c056-4068-8a37-ed5038fc364a:3660:1875336022409344:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788460244.869971:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc532d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c482be18-c056-4068-8a37-ed5038fc364a:3659:1875336022409472:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788460244.874696:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460244.881085:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003448576 00000100:00100000:2.0:1788460244.881167:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003448576 00010000:00010000:2.0:1788460244.881213:0:17198:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8c4bc6380a00/0x5dfa74784542c4ef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794aa0b expref: 13 pid: 17205 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460244.881255:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 16 00000100:00100000:2.0:1788460244.881264:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3839880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:051c7034-18a2-40f3-ae82-fb4fdf9e0800+13:2395:x1875336003448576:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788460244.881278:0:17198:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460244.881283:0:17198:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8c4bc6380a00/0x5dfa74784542c4ef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794aa0b expref: 13 pid: 17205 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460244.881295:0:17198:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8c4bc6380a00/0x5dfa74784542c4ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794aa0b expref: 13 pid: 17205 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460244.881313:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4bc6380a00/0x5dfa74784542c4ef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794aa0b expref: 13 pid: 17205 timeout: 641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460244.881342:0:17198:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8c4bef209a00/0x5dfa74784542c566 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460244.881566:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788460244.881595:0:17198:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bef209a00/0x5dfa74784542c566 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460244.881613:0:17198:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c4bef209a00/0x5dfa74784542c566 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460244.881620:0:17198:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8c4bef209a00/0x5dfa74784542c566 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460244.881627:0:17198:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8c4bef209a00/0x5dfa74784542c566 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460244.881633:0:17198:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8c4bef209a00/0x5dfa74784542c566 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460244.881640:0:17198:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bef209a00 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:2.0:1788460244.881644:0:17198:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8c4bef209a00/0x5dfa74784542c566 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460244.881652:0:17198:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8c4bef209a00/0x5dfa74784542c566 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460244.882339:0:20237:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8c4bef209a00/0x5dfa74784542c566 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460244.882361:0:20237:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8c4bef209a00/0x5dfa74784542c566 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460244.886129:0:17198:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8c4bef209a00/0x5dfa74784542c566 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460244.886147:0:17198:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8c4bef209a00/0x5dfa74784542c566 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460244.886181:0:17198:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788460244.886761:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3839880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:051c7034-18a2-40f3-ae82-fb4fdf9e0800+12:2395:x1875336003448576:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 5491us (12067us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460244.886773:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 16 00000100:00100000:1.0:1788460245.073308:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788460245.073329:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3838e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022409600:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788460245.073392:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460245.073435:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022409600 00000100:00100000:1.0:1788460245.073442:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022409600 00000100:00100000:1.0:1788460245.073483:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788460245.073491:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac383a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1875336022409600:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788460245.073520:0:17217:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788460245.073561:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac383a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1875336022409600:12345-0@lo:41:osp-pre-1-0.0 Request processed in 70us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460245.073568:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788460245.073607:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3838e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022409600:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788460245.074038:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc532fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022409728:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788460245.074069:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460245.074582:0:17952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022409728 00000100:00100000:3.0:1788460245.074589:0:17952:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022409728 00000100:00100000:3.0:1788460245.074628:0:17952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788460245.074635:0:17952:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc532c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022409728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788460245.074657:0:17952:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788460245.074712:0:17952:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc532c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022409728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460245.074724:0:17952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788460245.074759:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc532fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022409728:0@lo:41:osp-pre-0-1.0 00000001:00100000:0.0:1788460245.078221:0:19533:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b90b6ab2-35a4-41df-bd79-b1d2f118ec83 00000001:00100000:2.0:1788460245.078592:0:18714:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b90b6ab2-35a4-41df-bd79-b1d2f118ec83 10000000:01000000:0.0:1788460245.905232:0:17208:0:(mgc_request.c:715:do_requeue()) updating log params 10000000:01000000:0.0:1788460245.905238:0:17208:0:(mgc_request.c:2266:mgc_process_log()) Process log params-ffff8c4ac389b000 from 13 10000000:01000000:0.0:1788460245.905243:0:17208:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788460245.905282:0:17208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bef209c00/0x5dfa74784542c56d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460245.905293:0:17208:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4bef209c00/0x5dfa74784542c56d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460245.905304:0:17208:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4bef209c00/0x5dfa74784542c56d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460245.905327:0:17208:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc532e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022409856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788460245.905389:0:17208:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460245.905435:0:17208:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bfa392c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788460245.906265:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022409856 00000100:00100000:2.0:1788460245.906274:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022409856 00000100:00100000:2.0:1788460245.906333:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788460245.906343:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfc2e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+25:17208:x1875336022409856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788460245.906357:0:17206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460245.906372:0:17206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4ac395e000/0x5dfa74784542c574 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542c56d expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460245.906395:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4ac395e000/0x5dfa74784542c574 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542c56d expref: 26 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460245.906406:0:17206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4ac395e000/0x5dfa74784542c574 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542c56d expref: 26 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460245.906415:0:17206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ac395e000, rc 0) 00000100:00100000:2.0:1788460245.906474:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfc2e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+26:17208:x1875336022409856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (1084us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460245.906481:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788460245.906678:0:17208:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc532e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022409856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788460245.906694:0:17208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4bef209c00/0x5dfa74784542c56d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c574 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460245.906704:0:17208:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4bef209c00/0x5dfa74784542c56d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542c574 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460245.906850:0:18366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788460245.906876:0:17208:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 13 count 13 00000040:00080000:0.0:1788460245.907814:0:17208:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788460245.908014:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].1, 224 off8416 00000040:00080000:0.0:1788460245.908044:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].2, 112 off8528 00000040:00080000:0.0:1788460245.908077:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].3, 224 off8752 00000040:00080000:0.0:1788460245.908097:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].4, 224 off8976 00000040:00080000:0.0:1788460245.908112:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].5, 112 off9088 00000040:00080000:0.0:1788460245.908138:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].6, 224 off9312 00000040:00080000:0.0:1788460245.908153:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].7, 224 off9536 00000040:00080000:0.0:1788460245.908166:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].8, 128 off9664 00000040:00080000:0.0:1788460245.908177:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].9, 224 off9888 00000040:00080000:0.0:1788460245.908189:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].10, 224 off10112 00000040:00080000:0.0:1788460245.908200:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].11, 128 off10240 00000040:00080000:0.0:1788460245.908215:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x15:0x0].12, 224 off10464 00000040:00080000:0.0:1788460245.908219:0:17208:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 12 count 13 00000100:00100000:0.0:1788460245.908282:0:17208:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc532e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022409984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788460245.908328:0:17208:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460245.908375:0:17208:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bfa392c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788460245.909279:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022409984 00000100:00100000:3.0:1788460245.909288:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022409984 00000100:00100000:3.0:1788460245.909337:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788460245.909347:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfc2e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+26:17208:x1875336022409984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788460245.909471:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfc2e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+26:17208:x1875336022409984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 125us (1141us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460245.909480:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788460245.909544:0:17208:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc532e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022409984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788460245.909588:0:17208:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc532e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022410112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788460245.909626:0:17208:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460245.909657:0:17208:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bfa392c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788460245.910264:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022410112 00000100:00100000:3.0:1788460245.910271:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022410112 00000100:00100000:3.0:1788460245.910305:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788460245.910312:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfc2e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+26:17208:x1875336022410112:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788460245.910397:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfc2e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+26:17208:x1875336022410112:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460245.910404:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788460245.910491:0:17208:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc532e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022410112:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788460245.910869:0:17208:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788460245.910937:0:17208:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc532e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022410240:0@lo:502:ll_cfg_requeue.0 00000100:00100000:0.0:1788460245.911001:0:17208:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460245.911035:0:17208:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bfa392c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788460245.911144:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022410240 00000100:00100000:1.0:1788460245.911149:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022410240 00000100:00100000:1.0:1788460245.911239:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788460245.911247:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfc2e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+26:17208:x1875336022410240:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788460245.911320:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfc2e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+26:17208:x1875336022410240:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 73us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460245.911327:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788460245.912197:0:17208:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc532e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022410240:0@lo:502:ll_cfg_requeue.0 00000040:00080000:0.0:1788460245.912370:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].1, 224 off8416 00000040:00080000:0.0:1788460245.912400:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].2, 112 off8528 00000040:00080000:0.0:1788460245.912416:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].3, 224 off8752 00000040:00080000:0.0:1788460245.912433:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].4, 224 off8976 00000040:00080000:0.0:1788460245.912450:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].5, 112 off9088 00000040:00080000:0.0:1788460245.912463:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].6, 224 off9312 00000040:00080000:0.0:1788460245.912489:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].7, 224 off9536 00000040:00080000:0.0:1788460245.912503:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].8, 128 off9664 00000040:00080000:0.0:1788460245.912518:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].9, 224 off9888 00000040:00080000:0.0:1788460245.912551:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].10, 224 off10112 00000040:00080000:0.0:1788460245.912569:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].11, 128 off10240 00000100:00100000:0.0:1788460245.912603:0:17208:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc532e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022410368:0@lo:502:ll_cfg_requeue.0 00000100:00100000:0.0:1788460245.912655:0:17208:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460245.912695:0:17208:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bfa392c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788460245.912798:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022410368 00000100:00100000:2.0:1788460245.912805:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022410368 00000100:00100000:2.0:1788460245.912848:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788460245.912857:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfc2e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+26:17208:x1875336022410368:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:2.0:1788460245.912985:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfc2e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+26:17208:x1875336022410368:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 129us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460245.912993:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788460245.913035:0:17208:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc532e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022410368:0@lo:502:ll_cfg_requeue.0 00000040:00080000:0.0:1788460245.913146:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x16:0x0].12, 224 off10464 00000040:00080000:0.0:1788460245.913155:0:17208:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000040:00080000:3.0:1788460245.915731:0:20290:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x16:0x0] index 64768 count 13 00000020:01000000:1.0:1788460245.915971:0:17208:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788460245.915986:0:17208:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788460245.915997:0:17208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bef209c00/0x5dfa74784542c56d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c574 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460245.916011:0:17208:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4bef209c00/0x5dfa74784542c56d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c574 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788460245.916038:0:17208:0:(mgc_request.c:715:do_requeue()) updating log params 10000000:01000000:1.0:1788460245.916040:0:17208:0:(mgc_request.c:2266:mgc_process_log()) Process log params-ffff8c4c01993000 from 13 10000000:01000000:1.0:1788460245.916044:0:17208:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788460245.916077:0:17208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bc6380c00/0x5dfa74784542c57b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460245.916085:0:17208:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4bc6380c00/0x5dfa74784542c57b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460245.916096:0:17208:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4bc6380c00/0x5dfa74784542c57b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460245.916119:0:17208:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3838e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022410496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788460245.916194:0:17208:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460245.916237:0:17208:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bd0b68d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788460245.916336:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022410496 00000100:00100000:0.0:1788460245.916344:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022410496 00000100:00100000:0.0:1788460245.916398:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788460245.916407:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfc2e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+26:17208:x1875336022410496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788460245.916419:0:17206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460245.916429:0:17206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4bef208000/0x5dfa74784542c582 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542c57b expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460245.916462:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bef208000/0x5dfa74784542c582 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542c57b expref: 27 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460245.916472:0:17206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4bef208000/0x5dfa74784542c582 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542c57b expref: 27 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460245.916480:0:17206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bef208000, rc 0) 00000100:00100000:0.0:1788460245.916521:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfc2e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+27:17208:x1875336022410496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460245.916527:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788460245.916646:0:17208:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3838e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022410496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788460245.916659:0:17208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4bc6380c00/0x5dfa74784542c57b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c582 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460245.916668:0:17208:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4bc6380c00/0x5dfa74784542c57b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542c582 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788460245.916795:0:17208:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x16:0x0] index 13 count 13 00000040:00080000:3.0:1788460245.917051:0:17208:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788460245.917378:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].1, 224 off8416 00000040:00080000:3.0:1788460245.917403:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].2, 112 off8528 00000040:00080000:3.0:1788460245.917415:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].3, 224 off8752 00000040:00080000:3.0:1788460245.917427:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].4, 224 off8976 00000040:00080000:3.0:1788460245.917451:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].5, 112 off9088 00000040:00080000:3.0:1788460245.917463:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].6, 224 off9312 00000040:00080000:3.0:1788460245.917474:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].7, 224 off9536 00000040:00080000:3.0:1788460245.917486:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].8, 128 off9664 00000040:00080000:3.0:1788460245.917498:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].9, 224 off9888 00000040:00080000:3.0:1788460245.917510:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].10, 224 off10112 00000040:00080000:3.0:1788460245.917524:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].11, 128 off10240 00000040:00080000:3.0:1788460245.917543:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x19:0x0].12, 224 off10464 00000040:00080000:3.0:1788460245.917548:0:17208:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x16:0x0] index 12 count 13 00000100:00100000:3.0:1788460245.917602:0:17208:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac41bb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022410624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788460245.917640:0:17208:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460245.917713:0:17208:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bedec2780 going to sleep for 11 seconds 00000100:00100000:1.0:1788460245.921584:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022410624 00000100:00100000:1.0:1788460245.921598:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022410624 00000100:00100000:1.0:1788460245.921691:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788460245.921701:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfc2e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+27:17208:x1875336022410624:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788460245.921863:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfc2e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+27:17208:x1875336022410624:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 164us (4221us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460245.921871:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788460245.922101:0:17208:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac41bb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022410624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788460245.922147:0:17208:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac41bb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022410752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788460245.922203:0:17208:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460245.922457:0:17208:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bedec2780 going to sleep for 11 seconds 00000100:00100000:0.0:1788460245.922512:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022410752 00000100:00100000:0.0:1788460245.922517:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022410752 00000100:00100000:0.0:1788460245.922542:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788460245.922548:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfc2e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+27:17208:x1875336022410752:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788460245.922676:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfc2e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+27:17208:x1875336022410752:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 127us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460245.922683:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788460245.925939:0:17208:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac41bb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022410752:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788460245.926493:0:17208:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788460245.926571:0:17208:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac41bb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022410880:0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788460245.926637:0:17208:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460245.926804:0:17208:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bedec2780 going to sleep for 11 seconds 00000100:00100000:2.0:1788460245.927853:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022410880 00000100:00100000:2.0:1788460245.927862:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022410880 00000100:00100000:1.0:1788460245.928211:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788460245.928224:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfc2e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+27:17208:x1875336022410880:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788460245.928372:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfc2e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+27:17208:x1875336022410880:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 150us (1734us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460245.928390:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788460245.928537:0:17208:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac41bb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022410880:0@lo:502:ll_cfg_requeue.0 00000040:00080000:0.0:1788460245.928718:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].1, 224 off8416 00000040:00080000:0.0:1788460245.928748:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].2, 112 off8528 00000040:00080000:0.0:1788460245.928764:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].3, 224 off8752 00000040:00080000:0.0:1788460245.928778:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].4, 224 off8976 00000040:00080000:0.0:1788460245.928802:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].5, 112 off9088 00000040:00080000:0.0:1788460245.928818:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].6, 224 off9312 00000040:00080000:0.0:1788460245.928833:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].7, 224 off9536 00000040:00080000:0.0:1788460245.928847:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].8, 128 off9664 00000040:00080000:0.0:1788460245.928858:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].9, 224 off9888 00000040:00080000:0.0:1788460245.928870:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].10, 224 off10112 00000040:00080000:0.0:1788460245.928884:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].11, 128 off10240 00000100:00100000:0.0:1788460245.928916:0:17208:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc532e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022411008:0@lo:502:ll_cfg_requeue.0 00000100:00100000:0.0:1788460245.928988:0:17208:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460245.929020:0:17208:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bfa392f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788460245.931363:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022411008 00000100:00100000:1.0:1788460245.931376:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022411008 00000100:00100000:1.0:1788460245.931422:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788460245.931430:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4040450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+27:17208:x1875336022411008:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788460245.931562:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4040450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+27:17208:x1875336022411008:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 132us (2574us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460245.931571:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788460245.931628:0:17208:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc532e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022411008:0@lo:502:ll_cfg_requeue.0 00000040:00080000:1.0:1788460245.931704:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x1a:0x0].12, 224 off10464 00000040:00080000:1.0:1788460245.931715:0:17208:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000040:00080000:1.0:1788460245.935092:0:20293:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x1a:0x0] index 64768 count 13 00000020:01000000:2.0:1788460245.943056:0:17208:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788460245.943079:0:17208:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788460245.943090:0:17208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bc6380c00/0x5dfa74784542c57b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c582 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460245.943103:0:17208:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4bc6380c00/0x5dfa74784542c57b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c582 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788460245.943322:0:17208:0:(mgc_request.c:715:do_requeue()) updating log params 10000000:01000000:2.0:1788460245.943326:0:17208:0:(mgc_request.c:2266:mgc_process_log()) Process log params-ffff8c4be0237800 from 13 10000000:01000000:2.0:1788460245.943330:0:17208:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788460245.943368:0:17208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac395f400/0x5dfa74784542c589 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460245.943377:0:17208:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4ac395f400/0x5dfa74784542c589 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460245.943388:0:17208:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4ac395f400/0x5dfa74784542c589 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460245.943412:0:17208:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfaea9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022411136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788460245.943475:0:17208:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460245.943557:0:17208:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac2869480 going to sleep for 11 seconds 00000100:00100000:1.0:1788460245.946033:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022411136 00000100:00100000:1.0:1788460245.946047:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022411136 00000100:00100000:1.0:1788460245.946104:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788460245.946113:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4040050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+27:17208:x1875336022411136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788460245.946129:0:17206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460245.946144:0:17206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4bc6380a00/0x5dfa74784542c590 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542c589 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460245.946168:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bc6380a00/0x5dfa74784542c590 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542c589 expref: 28 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460245.946284:0:17206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4bc6380a00/0x5dfa74784542c590 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542c589 expref: 28 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460245.946293:0:17206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc6380a00, rc 0) 00000100:00100000:1.0:1788460245.946784:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4040050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+28:17208:x1875336022411136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 669us (3306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460245.946803:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788460245.948074:0:17208:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfaea9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022411136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788460245.948103:0:17208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4ac395f400/0x5dfa74784542c589 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c590 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460245.948115:0:17208:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4ac395f400/0x5dfa74784542c589 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542c590 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788460245.948401:0:17208:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x22:0x0] index 13 count 13 00000040:00080000:1.0:1788460245.948639:0:17208:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788460245.948806:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].1, 224 off8416 00000040:00080000:1.0:1788460245.948832:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].2, 112 off8528 00000040:00080000:1.0:1788460245.948849:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].3, 224 off8752 00000040:00080000:1.0:1788460245.948878:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].4, 224 off8976 00000040:00080000:1.0:1788460245.948894:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].5, 112 off9088 00000040:00080000:1.0:1788460245.948906:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].6, 224 off9312 00000040:00080000:1.0:1788460245.948919:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].7, 224 off9536 00000040:00080000:1.0:1788460245.948933:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].8, 128 off9664 00000040:00080000:1.0:1788460245.949112:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].9, 224 off9888 00000040:00080000:1.0:1788460245.949131:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].10, 224 off10112 00000040:00080000:1.0:1788460245.949146:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].11, 128 off10240 00000040:00080000:1.0:1788460245.949165:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x23:0x0].12, 224 off10464 00000040:00080000:1.0:1788460245.949169:0:17208:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x22:0x0] index 12 count 13 00000100:00100000:1.0:1788460245.949312:0:17208:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3838a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022411264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788460245.949368:0:17208:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460245.949413:0:17208:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bd0b680c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788460245.949475:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022411264 00000100:00100000:2.0:1788460245.949481:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022411264 00000100:00100000:2.0:1788460245.949525:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788460245.949534:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4043050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+28:17208:x1875336022411264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788460245.949673:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4043050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+28:17208:x1875336022411264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 140us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460245.949681:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788460245.949742:0:17208:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3838a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022411264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788460245.949769:0:17208:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3838a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022411392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788460245.949817:0:17208:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460245.949877:0:17208:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bd0b680c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788460245.949906:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022411392 00000100:00100000:2.0:1788460245.949910:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022411392 00000100:00100000:2.0:1788460245.950035:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788460245.950044:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4041850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+28:17208:x1875336022411392:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788460245.950117:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4041850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+28:17208:x1875336022411392:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 74us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460245.950124:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788460245.950193:0:17208:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3838a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022411392:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788460245.950494:0:17208:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788460245.950544:0:17208:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3838a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022411520:0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788460245.950580:0:17208:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460245.950718:0:17208:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bd0b680c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788460245.950763:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022411520 00000100:00100000:3.0:1788460245.950768:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022411520 00000100:00100000:3.0:1788460245.950802:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788460245.950811:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4043450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+28:17208:x1875336022411520:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788460245.950928:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4043450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+28:17208:x1875336022411520:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 118us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460245.950986:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788460245.951254:0:17208:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3838a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022411520:0@lo:502:ll_cfg_requeue.0 00000040:00080000:1.0:1788460245.951396:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].1, 224 off8416 00000040:00080000:1.0:1788460245.951417:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].2, 112 off8528 00000040:00080000:1.0:1788460245.951427:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].3, 224 off8752 00000040:00080000:1.0:1788460245.951439:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].4, 224 off8976 00000040:00080000:1.0:1788460245.951450:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].5, 112 off9088 00000040:00080000:1.0:1788460245.951462:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].6, 224 off9312 00000040:00080000:1.0:1788460245.951492:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].7, 224 off9536 00000040:00080000:1.0:1788460245.951562:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].8, 128 off9664 00000040:00080000:1.0:1788460245.951579:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].9, 224 off9888 00000040:00080000:1.0:1788460245.951592:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].10, 224 off10112 00000040:00080000:1.0:1788460245.951603:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].11, 128 off10240 00000100:00100000:1.0:1788460245.951626:0:17208:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3838a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022411648:0@lo:502:ll_cfg_requeue.0 00000100:00100000:1.0:1788460245.951663:0:17208:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460245.951727:0:17208:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bd0b680c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788460245.951761:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022411648 00000100:00100000:3.0:1788460245.951766:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022411648 00000100:00100000:3.0:1788460245.951843:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788460245.951850:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4040850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+28:17208:x1875336022411648:12345-0@lo:502:ll_cfg_requeue.0 00000100:00100000:3.0:1788460245.951929:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4040850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+28:17208:x1875336022411648:12345-0@lo:502:ll_cfg_requeue.0 Request processed in 79us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460245.951936:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788460245.952028:0:17208:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3838a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022411648:0@lo:502:ll_cfg_requeue.0 00000040:00080000:1.0:1788460245.952065:0:17208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x24:0x0].12, 224 off10464 00000040:00080000:1.0:1788460245.952072:0:17208:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000040:00080000:2.0:1788460245.953369:0:20296:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x24:0x0] index 64768 count 13 00000020:01000000:1.0:1788460245.953701:0:17208:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788460245.953713:0:17208:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788460245.953723:0:17208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4ac395f400/0x5dfa74784542c589 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c590 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460245.953735:0:17208:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4ac395f400/0x5dfa74784542c589 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c590 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788460245.953758:0:17208:0:(mgc_request.c:715:do_requeue()) updating log params 10000000:01000000:1.0:1788460245.953760:0:17208:0:(mgc_request.c:2266:mgc_process_log()) Process log params-ffff8c4ac428f800 from 13 10000000:01000000:1.0:1788460245.953763:0:17208:0:(mgc_request.c:1301:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788460245.953802:0:17208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bc6380200/0x5dfa74784542c597 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460245.953810:0:17208:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: mgc192.168.206.105@tcp lock: ffff8c4bc6380200/0x5dfa74784542c597 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460245.953820:0:17208:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: mgc192.168.206.105@tcp lock: ffff8c4bc6380200/0x5dfa74784542c597 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460245.953841:0:17208:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3838a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022411776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788460245.953889:0:17208:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460245.954018:0:17208:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bd0b680c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788460245.954150:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022411776 00000100:00100000:2.0:1788460245.954157:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022411776 00000100:00100000:2.0:1788460245.954210:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788460245.954218:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4040c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+28:17208:x1875336022411776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788460245.954229:0:17205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460245.954240:0:17205:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4ac395f600/0x5dfa74784542c59e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5dfa74784542c597 expref: -99 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460245.954260:0:17205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4ac395f600/0x5dfa74784542c59e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5dfa74784542c597 expref: 29 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460245.954281:0:17205:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4ac395f600/0x5dfa74784542c59e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5dfa74784542c597 expref: 29 pid: 17205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460245.954289:0:17205:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ac395f600, rc 0) 00000100:00100000:2.0:1788460245.954326:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4040c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+29:17208:x1875336022411776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460245.954333:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788460245.954496:0:17208:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3838a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022411776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788460245.954510:0:17208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mgc192.168.206.105@tcp lock: ffff8c4bc6380200/0x5dfa74784542c597 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c59e expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460245.954519:0:17208:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: mgc192.168.206.105@tcp lock: ffff8c4bc6380200/0x5dfa74784542c597 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5dfa74784542c59e expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460245.954550:0:17208:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3838a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022411904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788460245.954575:0:17208:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460245.954629:0:17208:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bd0b680c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788460245.954657:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022411904 00000100:00100000:3.0:1788460245.954660:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022411904 00000100:00100000:3.0:1788460245.954689:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788460245.954694:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4043c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+29:17208:x1875336022411904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788460245.954876:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4043c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c482be18-c056-4068-8a37-ed5038fc364a+29:17208:x1875336022411904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 180us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460245.954883:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788460245.954931:0:17208:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3838a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022411904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788460245.955038:0:17208:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3838a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022412032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788460245.955080:0:17208:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460245.955238:0:17208:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bd0b680c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788460245.955267:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022412032 00000100:00100000:3.0:1788460245.955272:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022412032 00000100:00100000:3.0:1788460245.955338:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788460245.955346:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4042850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+29:17208:x1875336022412032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788460245.955427:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4042850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c482be18-c056-4068-8a37-ed5038fc364a+29:17208:x1875336022412032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 81us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460245.955434:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1788460245.955494:0:17208:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3838a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c482be18-c056-4068-8a37-ed5038fc364a:17208:1875336022412032:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788460245.956352:0:20297:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788460245.956674:0:17208:0:(obd_config.c:2143:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788460245.956682:0:17208:0:(mgc_request.c:2349:mgc_process_log()) mgc192.168.206.105@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788460245.956691:0:17208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mgc192.168.206.105@tcp lock: ffff8c4bc6380200/0x5dfa74784542c597 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c59e expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460245.956701:0:17208:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: mgc192.168.206.105@tcp lock: ffff8c4bc6380200/0x5dfa74784542c597 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5dfa74784542c59e expref: -99 pid: 17208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460246.590834:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460246.590928:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003448704 00000100:00100000:3.0:1788460246.590938:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003448704 00000100:00100000:3.0:1788460246.591028:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 183 00000100:00100000:3.0:1788460246.591039:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4042050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:051c7034-18a2-40f3-ae82-fb4fdf9e0800+12:14901:x1875336003448704:12345-192.168.206.5@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788460246.591069:0:17204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460246.591086:0:17204:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4bc6ca6e00/0x5dfa74784542c5a5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794aaba expref: -99 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460246.591113:0:17204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bc6ca6e00/0x5dfa74784542c5a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794aaba expref: 13 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460246.591126:0:17204:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4bc6ca6e00/0x5dfa74784542c5a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794aaba expref: 13 pid: 17204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460246.591135:0:17204:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc6ca6e00, rc 0) 00000100:00100000:3.0:1788460246.591198:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4042050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:051c7034-18a2-40f3-ae82-fb4fdf9e0800+13:14901:x1875336003448704:12345-192.168.206.5@tcp:101:ll_cfg_requeue.0 Request processed in 161us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460246.591205:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 183 00000100:00100000:2.0:1788460246.597161:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460246.601305:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003448832 00000100:00100000:3.0:1788460246.601320:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003448832 00000100:00100000:3.0:1788460246.601619:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 184 00000100:00100000:3.0:1788460246.601646:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4041050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:051c7034-18a2-40f3-ae82-fb4fdf9e0800+13:14901:x1875336003448832:12345-192.168.206.5@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788460246.601862:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4041050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:051c7034-18a2-40f3-ae82-fb4fdf9e0800+13:14901:x1875336003448832:12345-192.168.206.5@tcp:501:ll_cfg_requeue.0 Request processed in 233us (4710us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460246.601871:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 184 00000100:00100000:3.0:1788460246.608902:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460246.609068:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003448960 00000100:00100000:0.0:1788460246.609079:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003448960 00000100:00100000:0.0:1788460246.609131:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 185 00000100:00100000:0.0:1788460246.609140:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4042c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:051c7034-18a2-40f3-ae82-fb4fdf9e0800+13:14901:x1875336003448960:12345-192.168.206.5@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788460246.609272:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4042c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:051c7034-18a2-40f3-ae82-fb4fdf9e0800+13:14901:x1875336003448960:12345-192.168.206.5@tcp:503:ll_cfg_requeue.0 Request processed in 132us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460246.609289:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 185 00000100:00100000:2.0:1788460246.609589:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfaea9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022412160:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788460246.609626:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460246.609664:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788460246.609670:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc532e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022412288:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788460246.609692:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460246.609723:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022412160 00000100:00100000:2.0:1788460246.609727:0:18722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022412160 00000100:00100000:2.0:1788460246.609767:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022412288 00000100:00100000:2.0:1788460246.609771:0:18722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022412288 00000100:00100000:3.0:1788460246.609798:0:19707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788460246.609851:0:19707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfaea9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022412160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788460246.609873:0:19707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788460246.609913:0:19707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfaea9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022412160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460246.610059:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3838a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022412416:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788460246.610088:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460246.611768:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788460246.611803:0:18722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfaeab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022412288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788460246.611919:0:18722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788460246.611997:0:18722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfaeab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022412288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 217us (2303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460246.612006:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788460246.612030:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022412416 00000100:00100000:2.0:1788460246.612035:0:18722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022412416 00000100:00100000:2.0:1788460246.612159:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788460246.612167:0:18722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac383b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022412416:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788460246.612192:0:18722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788460246.612234:0:18722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac383b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022412416:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (2144us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460246.612241:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1788460246.612265:0:17207:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788460246.612269:0:17207:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788460246.613215:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc532e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022412288:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788460246.613232:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfaea9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022412160:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788460246.615350:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3838a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022412416:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788460246.617552:0:19707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788460246.622543:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac383a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1875336022412672:0@lo:400:kworker.0 00000100:00100000:1.0:1788460246.622604:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460246.622718:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1875336022413184:0@lo:400:kworker.0 00000100:00100000:1.0:1788460246.622746:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460246.622771:0:3659:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788460246.622777:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3838e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022412800:0@lo:400:kworker.0 00000100:00100000:1.0:1788460246.622810:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460246.622827:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1875336022413312:0@lo:400:kworker.0 00000100:00100000:1.0:1788460246.622845:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460246.622877:0:18741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022412672 00000100:00100000:1.0:1788460246.622884:0:18741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022412672 00000100:00100000:1.0:1788460246.622923:0:18741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022413184 00000100:00100000:1.0:1788460246.622926:0:18741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022413184 00000100:00100000:1.0:1788460246.622965:0:18741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022413312 00000100:00100000:1.0:1788460246.622968:0:18741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022413312 00000100:00100000:1.0:1788460246.622984:0:18741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788460246.622993:0:18741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf7712a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1875336022412672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460246.623048:0:18741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf7712a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3659:x1875336022412672:12345-0@lo:400:kworker.0 Request processed in 56us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460246.623056:0:18741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788460246.623072:0:18741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788460246.623078:0:18741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf7712680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1875336022413184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460246.623101:0:18741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf7712680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3659:x1875336022413184:12345-0@lo:400:kworker.0 Request processed in 24us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460246.623107:0:18741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788460246.623116:0:18741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788460246.623121:0:18741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf7712300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1875336022413312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460246.623143:0:18741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf7712300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3659:x1875336022413312:12345-0@lo:400:kworker.0 Request processed in 22us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460246.623148:0:18741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788460246.623163:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022412800 00000100:00100000:1.0:1788460246.623167:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022412800 00000100:00100000:2.0:1788460246.623362:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3838a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022412544:0@lo:400:kworker.0 00000100:00100000:2.0:1788460246.623391:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460246.623421:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac1e60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3662:1875336022413056:0@lo:400:kworker.0 00000100:00100000:2.0:1788460246.623441:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460246.623456:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf7712d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1875336022413568:0@lo:400:kworker.0 00000100:00100000:2.0:1788460246.623474:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460246.623486:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788460246.623491:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc43f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022412928:0@lo:400:kworker.0 00000100:00100000:2.0:1788460246.623510:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460246.623533:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf7710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3662:1875336022413440:0@lo:400:kworker.0 00000100:00100000:2.0:1788460246.623552:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460246.623571:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022412544 00000100:00100000:2.0:1788460246.623575:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022412544 00000100:00100000:2.0:1788460246.623592:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788460246.623598:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf7710700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022412800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460246.623628:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf7710700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022412800:12345-0@lo:400:kworker.0 Request processed in 30us (817us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460246.623634:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788460246.623646:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788460246.623652:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfaea9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1875336022412544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460246.623682:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfaea9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3662:x1875336022412544:12345-0@lo:400:kworker.0 Request processed in 30us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460246.623687:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788460246.623704:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022412928 00000100:00100000:2.0:1788460246.623707:0:18719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022412928 00000100:00100000:2.0:1788460246.623734:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788460246.623740:0:18719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfaeaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022412928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460246.623766:0:18719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfaeaad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022412928:12345-0@lo:400:kworker.0 Request processed in 27us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460246.623772:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788460246.623818:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc43f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022412928:0@lo:400:kworker.0 00000100:00100000:2.0:1788460246.623829:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3838a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022412544:0@lo:400:kworker.0 00000100:00100000:3.0:1788460246.624011:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022413056 00000100:00100000:3.0:1788460246.624016:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022413056 00000100:00100000:3.0:1788460246.624033:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022413568 00000100:00100000:3.0:1788460246.624035:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022413568 00000100:00100000:3.0:1788460246.624044:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022413440 00000100:00100000:3.0:1788460246.624046:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022413440 00000100:00100000:3.0:1788460246.624057:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788460246.624062:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfaea8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1875336022413056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460246.624096:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfaea8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3662:x1875336022413056:12345-0@lo:400:kworker.0 Request processed in 34us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460246.624101:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788460246.624112:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788460246.624117:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfaea9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875336022413568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460246.624138:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfaea9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3662:x1875336022413568:12345-0@lo:400:kworker.0 Request processed in 21us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460246.624143:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788460246.624152:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788460246.624157:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfaeaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1875336022413440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788460246.624177:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfaeaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3662:x1875336022413440:12345-0@lo:400:kworker.0 Request processed in 21us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460246.624464:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00080000:1.0:1788460246.624741:0:17207:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788460246.624746:0:17207:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788460246.624748:0:17207:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788460246.624777:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3838e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022412800:0@lo:400:kworker.0 00010000:00080000:1.0:1788460246.624801:0:3659:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac1e60000 x1875336022413312/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460246.624812:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3659:1875336022413312:0@lo:400:kworker.0 00000100:00100000:1.0:1788460246.624824:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac383a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3659:1875336022412672:0@lo:400:kworker.0 00000100:00100000:1.0:1788460246.624835:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3659:1875336022413184:0@lo:400:kworker.0 00000100:00100000:3.0:1788460246.624938:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788460246.625873:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf7710e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3662:1875336022413440:0@lo:400:kworker.0 00000100:00100000:3.0:1788460246.625885:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac1e60380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3662:1875336022413056:0@lo:400:kworker.0 00010000:00080000:3.0:1788460246.625896:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bf7712d80 x1875336022413568/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788460246.626428:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf7712d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3662:1875336022413568:0@lo:400:kworker.0 00000100:00100000:0.0:1788460246.628779:0:17206:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003449088 00000100:00100000:0.0:1788460246.628802:0:17206:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003449088 00000100:00100000:0.0:1788460246.628866:0:17206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 186 00000100:00100000:0.0:1788460246.628875:0:17206:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4041450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:051c7034-18a2-40f3-ae82-fb4fdf9e0800+13:14901:x1875336003449088:12345-192.168.206.5@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788460246.628891:0:17206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460246.628907:0:17206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8c4bef209000/0x5dfa74784542c5ac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794aac1 expref: -99 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460246.628932:0:17206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8c4bef209000/0x5dfa74784542c5ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794aac1 expref: 14 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460246.628960:0:17206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8c4bef209000/0x5dfa74784542c5ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794aac1 expref: 14 pid: 17206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460246.628970:0:17206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bef209000, rc 0) 00000100:00100000:0.0:1788460246.629023:0:17206:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4041450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:051c7034-18a2-40f3-ae82-fb4fdf9e0800+14:14901:x1875336003449088:12345-192.168.206.5@tcp:101:ll_cfg_requeue.0 Request processed in 149us (4560us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460246.629030:0:17206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 186 00000100:00100000:0.0:1788460246.634238:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460246.634295:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003449216 00000100:00100000:3.0:1788460246.634305:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003449216 00000100:00100000:3.0:1788460246.634356:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 187 00000100:00100000:3.0:1788460246.634366:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4041c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:051c7034-18a2-40f3-ae82-fb4fdf9e0800+14:14901:x1875336003449216:12345-192.168.206.5@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788460246.634508:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4041c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:051c7034-18a2-40f3-ae82-fb4fdf9e0800+14:14901:x1875336003449216:12345-192.168.206.5@tcp:501:ll_cfg_requeue.0 Request processed in 142us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460246.634516:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 187 00000100:00100000:3.0:1788460246.637446:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460246.637518:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003449344 00000100:00100000:1.0:1788460246.637527:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003449344 00000100:00100000:1.0:1788460246.637579:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 188 00000100:00100000:1.0:1788460246.637588:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4042450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:051c7034-18a2-40f3-ae82-fb4fdf9e0800+14:14901:x1875336003449344:12345-192.168.206.5@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788460246.637741:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4042450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:051c7034-18a2-40f3-ae82-fb4fdf9e0800+14:14901:x1875336003449344:12345-192.168.206.5@tcp:503:ll_cfg_requeue.0 Request processed in 153us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460246.637749:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 188 00010000:00010000:2.0:1788460246.929429:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788460247.314266:0:17247:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788460247.953329:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788460248.330862:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460248.331060:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003449472 00000100:00100000:2.0:1788460248.331083:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003449472 00000100:00100000:2.0:1788460248.331156:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 23 00000100:00100000:2.0:1788460248.331167:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf7713480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3471709-a010-41d7-90bc-b8b3ea7c57b0+6:15569:x1875336003449472:12345-192.168.206.5@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788460248.331186:0:17213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460248.331206:0:17213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395fe00/0x5dfa74784542c5b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794aac8 expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788460248.331297:0:17207:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788460248.331491:0:17213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f800/0x5dfa74784542c5ba lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.331505:0:17213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f800/0x5dfa74784542c5ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.331589:0:17213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f800/0x5dfa74784542c5ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.331652:0:17213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395ea00/0x5dfa74784542c5c1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.331660:0:17213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395ea00/0x5dfa74784542c5c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.331667:0:17213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395ea00/0x5dfa74784542c5c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.331742:0:17213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395e600/0x5dfa74784542c5c8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.331751:0:17213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395e600/0x5dfa74784542c5c8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.331758:0:17213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395e600/0x5dfa74784542c5c8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788460248.331805:0:17213:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788460248.331809:0:17213:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788460248.332611:0:17213:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395e600/0x5dfa74784542c5c8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.332626:0:17213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f800/0x5dfa74784542c5ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.332633:0:17213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f800/0x5dfa74784542c5ba lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.332640:0:17213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f800/0x5dfa74784542c5ba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.332645:0:17213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac395f800 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:2.0:1788460248.332649:0:17213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f800/0x5dfa74784542c5ba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.332656:0:17213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f800/0x5dfa74784542c5ba lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.332668:0:17213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4bef1fee00) 00010000:00010000:2.0:1788460248.332671:0:17213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460248.332676:0:17213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f800/0x5dfa74784542c5ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.332682:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f800/0x5dfa74784542c5ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.332699:0:17213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395ea00/0x5dfa74784542c5c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.332716:0:17213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395ea00/0x5dfa74784542c5c1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.332722:0:17213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395ea00/0x5dfa74784542c5c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.332726:0:17213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac395ea00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:2.0:1788460248.332729:0:17213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395ea00/0x5dfa74784542c5c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.332735:0:17213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395ea00/0x5dfa74784542c5c1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.332743:0:17213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8c4bfa9fe700) 00010000:00010000:2.0:1788460248.332746:0:17213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460248.332748:0:17213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395ea00/0x5dfa74784542c5c1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.332755:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395ea00/0x5dfa74784542c5c1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.332804:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395fe00/0x5dfa74784542c5b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794aac8 expref: 8 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.332818:0:17213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395e600/0x5dfa74784542c5c8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794aac8 expref: 7 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.332825:0:17213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8c4bfa9fec00) 00010000:00010000:2.0:1788460248.332828:0:17213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788460248.334015:0:17213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ac395e600, rc 0) 00000100:00100000:2.0:1788460248.334103:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf7713480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3471709-a010-41d7-90bc-b8b3ea7c57b0+7:15569:x1875336003449472:12345-192.168.206.5@tcp:101:lhsmtool_posix.0 Request processed in 2935us (3245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460248.334111:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 23 00000100:00100000:0.0:1788460248.338881:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460248.339027:0:19281:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003449600 00000100:00100000:3.0:1788460248.339036:0:19281:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003449600 00000100:00100000:3.0:1788460248.339093:0:19281:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 5 00000100:00100000:3.0:1788460248.339103:0:19281:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc532c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0002:f3471709-a010-41d7-90bc-b8b3ea7c57b0+7:15569:x1875336003449600:12345-192.168.206.5@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788460248.339187:0:19281:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc532c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0002:f3471709-a010-41d7-90bc-b8b3ea7c57b0+7:15569:x1875336003449600:12345-192.168.206.5@tcp:900:lhsmtool_posix.0 Request processed in 85us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460248.339194:0:19281:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 5 00000100:00100000:3.0:1788460248.343906:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460248.353840:0:18741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003449856 00000100:00100000:1.0:1788460248.353854:0:18741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003449856 00000100:00100000:1.0:1788460248.353936:0:18741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 24 00000100:00100000:1.0:1788460248.353961:0:18741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3471709-a010-41d7-90bc-b8b3ea7c57b0+7:15569:x1875336003449856:12345-192.168.206.5@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788460248.353983:0:18741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460248.354004:0:18741:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6381000/0x5dfa74784542c5cf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794aacf expref: -99 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460248.354074:0:18741:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6380400/0x5dfa74784542c5d6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460248.354089:0:18741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6380400/0x5dfa74784542c5d6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460248.354100:0:18741:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6380400/0x5dfa74784542c5d6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460248.354157:0:18741:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6381200/0x5dfa74784542c5dd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460248.354181:0:18741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6381200/0x5dfa74784542c5dd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460248.354189:0:18741:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6381200/0x5dfa74784542c5dd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460248.354289:0:18741:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6380800/0x5dfa74784542c5e4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460248.354297:0:18741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6380800/0x5dfa74784542c5e4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460248.354304:0:18741:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6380800/0x5dfa74784542c5e4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788460248.354313:0:18741:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1788460248.354448:0:18741:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6380400/0x5dfa74784542c5d6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460248.354456:0:18741:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6380400/0x5dfa74784542c5d6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460248.354463:0:18741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6380400/0x5dfa74784542c5d6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460248.354469:0:18741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc6380400 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:1.0:1788460248.354473:0:18741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6380400/0x5dfa74784542c5d6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460248.354480:0:18741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6380400/0x5dfa74784542c5d6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460248.354501:0:18741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8c4bfa9fec00) 00010000:00010000:1.0:1788460248.354504:0:18741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788460248.354509:0:18741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6380400/0x5dfa74784542c5d6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460248.354515:0:18741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6380400/0x5dfa74784542c5d6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460248.354528:0:18741:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6381200/0x5dfa74784542c5dd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460248.354534:0:18741:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6381200/0x5dfa74784542c5dd lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460248.354539:0:18741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6381200/0x5dfa74784542c5dd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460248.354544:0:18741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc6381200 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:1.0:1788460248.354547:0:18741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6381200/0x5dfa74784542c5dd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460248.354552:0:18741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6381200/0x5dfa74784542c5dd lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460248.354559:0:18741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8c4bc3995e00) 00010000:00010000:1.0:1788460248.354561:0:18741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788460248.354564:0:18741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6381200/0x5dfa74784542c5dd lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460248.354569:0:18741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6381200/0x5dfa74784542c5dd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460248.359042:0:18741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6381000/0x5dfa74784542c5cf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794aacf expref: 10 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460248.359068:0:18741:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6380800/0x5dfa74784542c5e4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794aacf expref: 9 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460248.359077:0:18741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c4bc3995600) 00010000:00010000:1.0:1788460248.359079:0:18741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788460248.359082:0:18741:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc6380800, rc 0) 00000100:00100000:1.0:1788460248.359140:0:18741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3471709-a010-41d7-90bc-b8b3ea7c57b0+9:15569:x1875336003449856:12345-192.168.206.5@tcp:101:lhsmtool_posix.0 Request processed in 5195us (15242us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788460248.359149:0:18741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 24 00000100:00100000:1.0:1788460248.369857:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460248.370080:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003449984 00000100:00100000:0.0:1788460248.370089:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003449984 00000100:00100000:0.0:1788460248.370146:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 25 00000100:00100000:0.0:1788460248.370157:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf7711180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3471709-a010-41d7-90bc-b8b3ea7c57b0+9:15569:x1875336003449984:12345-192.168.206.5@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788460248.370264:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf7711180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3471709-a010-41d7-90bc-b8b3ea7c57b0+9:15569:x1875336003449984:12345-192.168.206.5@tcp:59:lhsmtool_posix.0 Request processed in 109us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460248.370284:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 25 00000100:00100000:0.0:1788460248.373902:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460248.374118:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003450112 00000100:00100000:3.0:1788460248.374130:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003450112 00000100:00100000:3.0:1788460248.374224:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 26 00000100:00100000:3.0:1788460248.374236:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc532ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3471709-a010-41d7-90bc-b8b3ea7c57b0+5:15569:x1875336003450112:12345-192.168.206.5@tcp:59:lhsmtool_posix.0 00000100:00080000:1.0:1788460248.375220:0:17207:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:0.0:1788460248.377961:0:17212:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 3652us 00000100:00100000:3.0:1788460248.400531:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc532ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3471709-a010-41d7-90bc-b8b3ea7c57b0+5:15569:x1875336003450112:12345-192.168.206.5@tcp:59:lhsmtool_posix.0 Request processed in 26283us (26629us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460248.400569:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 26 00000100:00100000:3.0:1788460248.405915:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460248.406061:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003450240 00000100:00100000:0.0:1788460248.406073:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003450240 00000100:00100000:0.0:1788460248.406143:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 27 00000100:00100000:0.0:1788460248.406154:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac39d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3471709-a010-41d7-90bc-b8b3ea7c57b0+9:15575:x1875336003450240:12345-192.168.206.5@tcp:101:lfs.0 00010000:00010000:0.0:1788460248.406182:0:17211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460248.406208:0:17211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208600/0x5dfa74784542c5f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794aad6 expref: -99 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460248.406287:0:17211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209e00/0x5dfa74784542c5f9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460248.406304:0:17211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209e00/0x5dfa74784542c5f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460248.406317:0:17211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209e00/0x5dfa74784542c5f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460248.406335:0:17211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209800/0x5dfa74784542c600 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460248.406342:0:17211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209800/0x5dfa74784542c600 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460248.406349:0:17211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209800/0x5dfa74784542c600 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460248.406422:0:17211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209e00/0x5dfa74784542c5f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460248.406430:0:17211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209e00/0x5dfa74784542c5f9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460248.406437:0:17211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209e00/0x5dfa74784542c5f9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460248.406443:0:17211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bef209e00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460248.406447:0:17211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209e00/0x5dfa74784542c5f9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460248.406455:0:17211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209e00/0x5dfa74784542c5f9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460248.406469:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4bef1fee00) 00010000:00010000:0.0:1788460248.406472:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460248.406478:0:17211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209e00/0x5dfa74784542c5f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460248.406484:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209e00/0x5dfa74784542c5f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460248.406498:0:17211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209800/0x5dfa74784542c600 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460248.406504:0:17211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209800/0x5dfa74784542c600 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460248.406510:0:17211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209800/0x5dfa74784542c600 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460248.406522:0:17211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bef209800 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460248.406525:0:17211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209800/0x5dfa74784542c600 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460248.406532:0:17211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209800/0x5dfa74784542c600 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460248.406540:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8c4bc5dc1400) 00010000:00010000:0.0:1788460248.406543:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460248.406546:0:17211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209800/0x5dfa74784542c600 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460248.406552:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209800/0x5dfa74784542c600 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460248.406588:0:17211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208600/0x5dfa74784542c5f2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794aad6 expref: 10 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460248.406598:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4bef1fee00) 00010000:00010000:0.0:1788460248.406600:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788460248.406604:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208600/0x5dfa74784542c5f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794aad6 expref: 10 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460248.406614:0:17211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bef208600, rc 0) 00000100:00100000:0.0:1788460248.409518:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac39d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3471709-a010-41d7-90bc-b8b3ea7c57b0+9:15575:x1875336003450240:12345-192.168.206.5@tcp:101:lfs.0 Request processed in 3350us (3601us total) trans 0 rc 301/301 00000100:00100000:0.0:1788460248.409536:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 27 00000100:00100000:2.0:1788460248.418188:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460248.418338:0:17220:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003450368 00000100:00100000:3.0:1788460248.418352:0:17220:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003450368 00000100:00100000:3.0:1788460248.418411:0:17220:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 0 00000100:00100000:3.0:1788460248.418421:0:17220:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfaeabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:f3471709-a010-41d7-90bc-b8b3ea7c57b0+9:15575:x1875336003450368:12345-192.168.206.5@tcp:700:lfs.0 00000100:00100000:3.0:1788460248.418516:0:17220:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfaeabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:f3471709-a010-41d7-90bc-b8b3ea7c57b0+9:15575:x1875336003450368:12345-192.168.206.5@tcp:700:lfs.0 Request processed in 97us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460248.418525:0:17220:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 0 00000100:00100000:1.0:1788460248.420391:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460248.420465:0:18741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003450624 00000100:00100000:2.0:1788460248.420480:0:18741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003450624 00000100:00100000:2.0:1788460248.420542:0:18741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 28 00000100:00100000:2.0:1788460248.420551:0:18741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf7713100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3471709-a010-41d7-90bc-b8b3ea7c57b0+9:15575:x1875336003450624:12345-192.168.206.5@tcp:36:lfs.0 00010000:00010000:2.0:1788460248.420617:0:18741:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460248.420761:0:18741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7400/0x5dfa74784542c519 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794aa3c expref: 9 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.420794:0:18741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4bef1fee00) 00010000:00010000:2.0:1788460248.420800:0:18741:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788460248.422047:0:18741:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395ea00/0x5dfa74784542c607 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.422077:0:18741:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca6000/0x5dfa74784542c55f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794aab3 expref: 5 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.422088:0:18741:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395ea00/0x5dfa74784542c607 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.422145:0:18741:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca6000/0x5dfa74784542c55f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794aab3 expref: 5 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.422166:0:18741:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca6000/0x5dfa74784542c55f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794aab3 expref: 5 pid: 17212 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460248.422207:0:18741:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bfaea9180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18741:1875336022413696:192.168.206.5@tcp:104: 00000100:00100000:2.0:1788460248.422322:0:18741:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bedec2f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788460248.424851:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460248.424922:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003450752 00000100:00100000:1.0:1788460248.424934:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003450752 00010000:00010000:1.0:1788460248.425040:0:17197:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca6000/0x5dfa74784542c55f lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794aab3 expref: 6 pid: 17212 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460248.425085:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 17 00000100:00100000:1.0:1788460248.425097:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac39d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b90b6ab2-35a4-41df-bd79-b1d2f118ec83+6:2394:x1875336003450752:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788460248.425114:0:17197:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788460248.425122:0:17197:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca6000/0x5dfa74784542c55f lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794aab3 expref: 6 pid: 17212 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460248.425156:0:17197:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca6000/0x5dfa74784542c55f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794aab3 expref: 6 pid: 17212 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460248.425180:0:17197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4bef1fee00) 00010000:00010000:1.0:1788460248.425186:0:17197:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395ea00/0x5dfa74784542c607 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460248.425196:0:17197:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395ea00/0x5dfa74784542c607 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460248.425204:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395ea00/0x5dfa74784542c607 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460248.425225:0:17197:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788460248.425289:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac39d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b90b6ab2-35a4-41df-bd79-b1d2f118ec83+6:2394:x1875336003450752:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 193us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460248.425298:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 17 00000100:00080000:3.0:1788460248.425575:0:17207:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788460248.426933:0:18741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca6000/0x5dfa74784542c55f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794aab3 expref: 5 pid: 17212 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460248.427086:0:18741:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bfaea9180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:18741:1875336022413696:192.168.206.5@tcp:104: 00010000:00010000:2.0:1788460248.427116:0:18741:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395ea00/0x5dfa74784542c607 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.427128:0:18741:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395ea00/0x5dfa74784542c607 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.427135:0:18741:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395ea00/0x5dfa74784542c607 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.427172:0:18741:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f800/0x5dfa74784542c60e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.427187:0:18741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f800/0x5dfa74784542c60e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.427199:0:18741:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f800/0x5dfa74784542c60e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.429445:0:18741:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395fc00/0x5dfa74784542c615 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.429467:0:18741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395fc00/0x5dfa74784542c615 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.429484:0:18741:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395fc00/0x5dfa74784542c615 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788460248.429504:0:18741:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000b4f6ace reply state 00000000455bfbbe transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395fc00/0x5dfa74784542c615 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.429514:0:18741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395fc00/0x5dfa74784542c615 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.429522:0:18741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8c4bfa9fea00) 00010000:00010000:2.0:1788460248.429524:0:18741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788460248.429528:0:18741:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788460248.429533:0:18741:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788460248.429541:0:18741:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395ea00/0x5dfa74784542c607 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.429547:0:18741:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395ea00/0x5dfa74784542c607 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.429554:0:18741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395ea00/0x5dfa74784542c607 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.429561:0:18741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac395ea00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:2.0:1788460248.429566:0:18741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395ea00/0x5dfa74784542c607 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.429576:0:18741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395ea00/0x5dfa74784542c607 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.429589:0:18741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4bef1fee00) 00010000:00010000:2.0:1788460248.429592:0:18741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460248.429603:0:18741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395ea00/0x5dfa74784542c607 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.429609:0:18741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395ea00/0x5dfa74784542c607 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788460248.429635:0:18741:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000b4f6ace reply state 00000000455bfbbe transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f800/0x5dfa74784542c60e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.429644:0:18741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f800/0x5dfa74784542c60e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.429650:0:18741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8c4bfa9fe700) 00010000:00010000:2.0:1788460248.429652:0:18741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788460248.429654:0:18741:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1788460248.432386:0:18741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf7713100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3471709-a010-41d7-90bc-b8b3ea7c57b0+10:15575:x1875336003450624:12345-192.168.206.5@tcp:36:lfs.0 Request processed in 11824us (11994us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788460248.432399:0:18741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 28 00000100:00100000:3.0:1788460248.533059:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460248.533156:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003450880 00000100:00100000:2.0:1788460248.533166:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003450880 00000100:00100000:2.0:1788460248.533216:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 29 00000100:00100000:2.0:1788460248.533226:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac39d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3471709-a010-41d7-90bc-b8b3ea7c57b0+10:15583:x1875336003450880:12345-192.168.206.5@tcp:101:lctl.0 00010000:00010000:2.0:1788460248.533248:0:17213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460248.533268:0:17213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395ea00/0x5dfa74784542c61c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794aadd expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.533329:0:17213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395ee00/0x5dfa74784542c623 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.533342:0:17213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395ee00/0x5dfa74784542c623 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.533376:0:17213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395ee00/0x5dfa74784542c623 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788460248.533418:0:17213:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788460248.533422:0:17213:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788460248.533458:0:17213:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395ee00/0x5dfa74784542c623 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.533482:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395ea00/0x5dfa74784542c61c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794aadd expref: 12 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.533500:0:17213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395ee00/0x5dfa74784542c623 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794aadd expref: 11 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.533507:0:17213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4bfa9fe200) 00010000:00010000:2.0:1788460248.533510:0:17213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788460248.533513:0:17213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ac395ee00, rc 0) 00000100:00100000:2.0:1788460248.533576:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac39d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3471709-a010-41d7-90bc-b8b3ea7c57b0+11:15583:x1875336003450880:12345-192.168.206.5@tcp:101:lctl.0 Request processed in 350us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460248.533583:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 29 00000100:00100000:1.0:1788460248.550086:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460248.550166:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003451008 00000100:00100000:3.0:1788460248.550175:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003451008 00000100:00100000:3.0:1788460248.550232:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 30 00000100:00100000:3.0:1788460248.550242:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf7711500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90b6ab2-35a4-41df-bd79-b1d2f118ec83+5:15585:x1875336003451008:12345-192.168.206.5@tcp:101:lfs.0 00010000:00010000:3.0:1788460248.550261:0:17212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460248.550278:0:17212:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca6c00/0x5dfa74784542c62a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794aae4 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460248.550338:0:17212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7e00/0x5dfa74784542c631 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460248.550353:0:17212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7e00/0x5dfa74784542c631 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460248.550364:0:17212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7e00/0x5dfa74784542c631 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788460248.550429:0:17212:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788460248.550432:0:17212:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788460248.550455:0:17212:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7e00/0x5dfa74784542c631 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460248.550479:0:17212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca6c00/0x5dfa74784542c62a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794aae4 expref: 7 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460248.550498:0:17212:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7e00/0x5dfa74784542c631 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794aae4 expref: 6 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460248.550507:0:17212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4bfa9fe200) 00010000:00010000:3.0:1788460248.550510:0:17212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788460248.550513:0:17212:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc6ca7e00, rc 0) 00000100:00100000:3.0:1788460248.550577:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf7711500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90b6ab2-35a4-41df-bd79-b1d2f118ec83+6:15585:x1875336003451008:12345-192.168.206.5@tcp:101:lfs.0 Request processed in 337us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460248.550584:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 30 00000100:00100000:1.0:1788460248.554338:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460248.554426:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003451136 00000100:00100000:2.0:1788460248.554437:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003451136 00000100:00100000:2.0:1788460248.554502:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 31 00000100:00100000:2.0:1788460248.554513:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf7711f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90b6ab2-35a4-41df-bd79-b1d2f118ec83+6:15585:x1875336003451136:12345-192.168.206.5@tcp:101:lfs.0 00010000:00010000:2.0:1788460248.554534:0:17213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460248.554554:0:17213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395ea00/0x5dfa74784542c638 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794aaeb expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.554639:0:17213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395fa00/0x5dfa74784542c63f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.554654:0:17213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395fa00/0x5dfa74784542c63f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.554665:0:17213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395fa00/0x5dfa74784542c63f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.554676:0:17213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395fe00/0x5dfa74784542c646 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.554682:0:17213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395fe00/0x5dfa74784542c646 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.554688:0:17213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395fe00/0x5dfa74784542c646 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.554756:0:17213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395e800/0x5dfa74784542c64d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.554765:0:17213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395e800/0x5dfa74784542c64d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.554781:0:17213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395e800/0x5dfa74784542c64d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788460248.554817:0:17213:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788460248.554821:0:17213:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788460248.554838:0:17213:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395e800/0x5dfa74784542c64d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.554862:0:17213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395fa00/0x5dfa74784542c63f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.554869:0:17213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395fa00/0x5dfa74784542c63f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.554877:0:17213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395fa00/0x5dfa74784542c63f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.554883:0:17213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac395fa00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:2.0:1788460248.554887:0:17213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395fa00/0x5dfa74784542c63f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.554895:0:17213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395fa00/0x5dfa74784542c63f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.554906:0:17213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4bfa9fe200) 00010000:00010000:2.0:1788460248.554909:0:17213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460248.554913:0:17213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395fa00/0x5dfa74784542c63f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.554918:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395fa00/0x5dfa74784542c63f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.554931:0:17213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395fe00/0x5dfa74784542c646 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.554937:0:17213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395fe00/0x5dfa74784542c646 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.554977:0:17213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395fe00/0x5dfa74784542c646 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.554990:0:17213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac395fe00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:2.0:1788460248.554993:0:17213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395fe00/0x5dfa74784542c646 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.554999:0:17213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395fe00/0x5dfa74784542c646 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.555009:0:17213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8c4bfa9fe700) 00010000:00010000:2.0:1788460248.555011:0:17213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460248.555014:0:17213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395fe00/0x5dfa74784542c646 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.555019:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395fe00/0x5dfa74784542c646 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.555046:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395ea00/0x5dfa74784542c638 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794aaeb expref: 8 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.555060:0:17213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395e800/0x5dfa74784542c64d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794aaeb expref: 7 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.555067:0:17213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8c4bfa9fea00) 00010000:00010000:2.0:1788460248.555069:0:17213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788460248.555071:0:17213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ac395e800, rc 0) 00000100:00100000:2.0:1788460248.555138:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf7711f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90b6ab2-35a4-41df-bd79-b1d2f118ec83+7:15585:x1875336003451136:12345-192.168.206.5@tcp:101:lfs.0 Request processed in 625us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460248.555146:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 31 00000100:00100000:0.0:1788460248.558329:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460248.558424:0:17222:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003451264 00000100:00100000:3.0:1788460248.558433:0:17222:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003451264 00000100:00100000:3.0:1788460248.558508:0:17222:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 6 00000100:00100000:3.0:1788460248.558517:0:17222:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc532f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:b90b6ab2-35a4-41df-bd79-b1d2f118ec83+5:15585:x1875336003451264:12345-192.168.206.5@tcp:900:lfs.0 00000100:00100000:3.0:1788460248.558591:0:17222:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc532f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:b90b6ab2-35a4-41df-bd79-b1d2f118ec83+5:15585:x1875336003451264:12345-192.168.206.5@tcp:900:lfs.0 Request processed in 75us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460248.558599:0:17222:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 6 00000100:00080000:1.0:1788460248.558715:0:17207:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788460248.568787:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460248.568869:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003451520 00000100:00100000:3.0:1788460248.568879:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003451520 00000100:00100000:3.0:1788460248.568934:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 32 00000100:00100000:3.0:1788460248.569008:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf7710a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90b6ab2-35a4-41df-bd79-b1d2f118ec83+7:15585:x1875336003451520:12345-192.168.206.5@tcp:101:lfs.0 00010000:00010000:3.0:1788460248.569030:0:17212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460248.569049:0:17212:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca6c00/0x5dfa74784542c654 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794aaf2 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788460248.569154:0:17212:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788460248.569250:0:17212:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca6c00/0x5dfa74784542c654 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794aaf2 expref: 9 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460248.569265:0:17212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4bfa9fe200) 00010000:00010000:3.0:1788460248.569268:0:17212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788460248.569273:0:17212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca6c00/0x5dfa74784542c654 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794aaf2 expref: 9 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460248.569289:0:17212:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc6ca6c00, rc 0) 00000100:00100000:3.0:1788460248.569337:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf7710a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90b6ab2-35a4-41df-bd79-b1d2f118ec83+8:15585:x1875336003451520:12345-192.168.206.5@tcp:101:lfs.0 Request processed in 333us (570us total) trans 8589934595 rc 301/301 00000100:00100000:3.0:1788460248.569344:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 32 00000100:00100000:2.0:1788460248.574813:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460248.574920:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003451776 00000100:00100000:1.0:1788460248.574930:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003451776 00000100:00100000:1.0:1788460248.575023:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 33 00000100:00100000:1.0:1788460248.575032:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfaea9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90b6ab2-35a4-41df-bd79-b1d2f118ec83+8:15585:x1875336003451776:12345-192.168.206.5@tcp:36:lfs.0 00010000:00010000:1.0:1788460248.575078:0:17213:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788460248.575100:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395e800/0x5dfa74784542c64d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794aaeb expref: 8 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460248.575126:0:17213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8c4bfa9fea00) 00010000:00010000:1.0:1788460248.575131:0:17213:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788460248.575151:0:17213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6381800/0x5dfa74784542c662 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460248.575164:0:17213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6381800/0x5dfa74784542c662 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460248.575173:0:17213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6381800/0x5dfa74784542c662 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788460248.575338:0:17213:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000030b98e60 reply state 00000000e46d87e4 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6381800/0x5dfa74784542c662 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460248.575350:0:17213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6381800/0x5dfa74784542c662 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460248.575357:0:17213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8c4bfa9fea00) 00010000:00010000:1.0:1788460248.575359:0:17213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:1.0:1788460248.575362:0:17213:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788460248.575368:0:17213:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1788460248.575444:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfaea9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90b6ab2-35a4-41df-bd79-b1d2f118ec83+9:15585:x1875336003451776:12345-192.168.206.5@tcp:36:lfs.0 Request processed in 412us (639us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1788460248.575451:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 33 00000100:00100000:0.0:1788460248.577182:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460248.577323:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003452032 00000100:00100000:3.0:1788460248.577331:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003452032 00000100:00100000:3.0:1788460248.577377:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 2 00000100:00100000:3.0:1788460248.577385:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc532dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b90b6ab2-35a4-41df-bd79-b1d2f118ec83+9:15585:x1875336003452032:12345-192.168.206.5@tcp:35:lfs.0 00000100:00100000:3.0:1788460248.577551:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc532dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b90b6ab2-35a4-41df-bd79-b1d2f118ec83+10:15585:x1875336003452032:12345-192.168.206.5@tcp:35:lfs.0 Request processed in 166us (375us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1788460248.577559:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 2 00000100:00100000:2.0:1788460248.586867:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460248.587077:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003452288 00000100:00100000:3.0:1788460248.587099:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003452288 00000100:00100000:3.0:1788460248.587153:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 34 00000100:00100000:3.0:1788460248.587161:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfaea8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90b6ab2-35a4-41df-bd79-b1d2f118ec83+10:15585:x1875336003452288:12345-192.168.206.5@tcp:101:lfs.0 00010000:00010000:3.0:1788460248.587182:0:17212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460248.587200:0:17212:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca6c00/0x5dfa74784542c669 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794aaf9 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460248.587262:0:17212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca6200/0x5dfa74784542c670 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460248.587275:0:17212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca6200/0x5dfa74784542c670 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460248.587286:0:17212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca6200/0x5dfa74784542c670 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460248.587296:0:17212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7a00/0x5dfa74784542c677 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460248.587302:0:17212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7a00/0x5dfa74784542c677 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460248.587308:0:17212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7a00/0x5dfa74784542c677 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788460248.587401:0:17212:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788460248.587463:0:17212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca6200/0x5dfa74784542c670 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460248.587471:0:17212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca6200/0x5dfa74784542c670 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460248.587489:0:17212:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca6200/0x5dfa74784542c670 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460248.587495:0:17212:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc6ca6200 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:3.0:1788460248.587500:0:17212:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca6200/0x5dfa74784542c670 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460248.587508:0:17212:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca6200/0x5dfa74784542c670 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460248.587520:0:17212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4bfa9fe200) 00010000:00010000:3.0:1788460248.587523:0:17212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460248.587528:0:17212:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca6200/0x5dfa74784542c670 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460248.587535:0:17212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca6200/0x5dfa74784542c670 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460248.587549:0:17212:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7a00/0x5dfa74784542c677 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460248.587555:0:17212:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7a00/0x5dfa74784542c677 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460248.587561:0:17212:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7a00/0x5dfa74784542c677 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460248.587566:0:17212:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc6ca7a00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:3.0:1788460248.587568:0:17212:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7a00/0x5dfa74784542c677 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460248.587582:0:17212:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7a00/0x5dfa74784542c677 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460248.587590:0:17212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8c4bfa9fe700) 00010000:00010000:3.0:1788460248.587592:0:17212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460248.587595:0:17212:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7a00/0x5dfa74784542c677 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460248.587601:0:17212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7a00/0x5dfa74784542c677 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460248.587631:0:17212:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca6c00/0x5dfa74784542c669 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794aaf9 expref: 12 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460248.587640:0:17212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4bfa9fe200) 00010000:00010000:3.0:1788460248.587642:0:17212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788460248.587646:0:17212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca6c00/0x5dfa74784542c669 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794aaf9 expref: 12 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460248.587655:0:17212:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc6ca6c00, rc 0) 00000100:00100000:3.0:1788460248.587936:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfaea8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b90b6ab2-35a4-41df-bd79-b1d2f118ec83+11:15585:x1875336003452288:12345-192.168.206.5@tcp:101:lfs.0 Request processed in 773us (1075us total) trans 8589934598 rc 301/301 00000100:00100000:3.0:1788460248.587994:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 34 00000100:00100000:2.0:1788460248.595318:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460248.597449:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003452416 00000100:00100000:1.0:1788460248.597463:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003452416 00000100:00100000:1.0:1788460248.597526:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 35 00000100:00100000:1.0:1788460248.597535:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfaeaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90b6ab2-35a4-41df-bd79-b1d2f118ec83+11:15585:x1875336003452416:12345-192.168.206.5@tcp:101:lfs.0 00010000:00010000:1.0:1788460248.597557:0:17213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460248.597585:0:17213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6381400/0x5dfa74784542c685 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794ab00 expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460248.597668:0:17213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6381600/0x5dfa74784542c68c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460248.597681:0:17213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6381600/0x5dfa74784542c68c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460248.597693:0:17213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6381600/0x5dfa74784542c68c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788460248.597717:0:17213:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788460248.597720:0:17213:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788460248.598914:0:17213:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6381600/0x5dfa74784542c68c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460248.599036:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6381400/0x5dfa74784542c685 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab00 expref: 13 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460248.599054:0:17213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6381600/0x5dfa74784542c68c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab00 expref: 12 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460248.599061:0:17213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8c4bfa9fea00) 00010000:00010000:1.0:1788460248.599064:0:17213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788460248.599067:0:17213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc6381600, rc 0) 00000100:00100000:1.0:1788460248.599178:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfaeaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b90b6ab2-35a4-41df-bd79-b1d2f118ec83+12:15585:x1875336003452416:12345-192.168.206.5@tcp:101:lfs.0 Request processed in 1642us (3866us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460248.599187:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 35 00000100:00100000:1.0:1788460248.608198:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460248.608296:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003452544 00000100:00100000:3.0:1788460248.608306:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003452544 00000100:00100000:3.0:1788460248.608354:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 3 00000100:00100000:3.0:1788460248.608364:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf7710000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b90b6ab2-35a4-41df-bd79-b1d2f118ec83+12:15585:x1875336003452544:12345-192.168.206.5@tcp:37:lfs.0 00000100:00100000:3.0:1788460248.614306:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf7710000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b90b6ab2-35a4-41df-bd79-b1d2f118ec83+12:15585:x1875336003452544:12345-192.168.206.5@tcp:37:lfs.0 Request processed in 5934us (6108us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460248.614319:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 3 00000100:00100000:2.0:1788460248.618051:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460248.618176:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003452800 00000100:00100000:1.0:1788460248.618184:0:17214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003452800 00000100:00100000:1.0:1788460248.618234:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 4 00000100:00100000:1.0:1788460248.618243:0:17214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3b1b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b90b6ab2-35a4-41df-bd79-b1d2f118ec83+12:15585:x1875336003452800:12345-192.168.206.5@tcp:35:lfs.0 00000100:00100000:1.0:1788460248.618437:0:17214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3b1b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b90b6ab2-35a4-41df-bd79-b1d2f118ec83+13:15585:x1875336003452800:12345-192.168.206.5@tcp:35:lfs.0 Request processed in 194us (393us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1788460248.618445:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 4 00000100:00100000:1.0:1788460248.658151:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac39d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022413824:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788460248.658217:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460248.658856:0:18722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022413824 00000100:00100000:3.0:1788460248.658865:0:18722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022413824 00000100:00100000:3.0:1788460248.658921:0:18722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788460248.658931:0:18722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf7710000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022413824:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788460248.659091:0:17207:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1788460248.659118:0:18722:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788460248.659176:0:18722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf7710000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022413824:12345-0@lo:13:osp-pre-0-1.0 Request processed in 247us (958us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460248.659184:0:18722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788460248.659265:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac39d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022413824:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788460248.717216:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460248.717659:0:18741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003452928 00000100:00100000:2.0:1788460248.717669:0:18741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003452928 00000100:00100000:2.0:1788460248.717913:0:18741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 36 00000100:00100000:2.0:1788460248.717932:0:18741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf7713b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3471709-a010-41d7-90bc-b8b3ea7c57b0+11:15591:x1875336003452928:12345-192.168.206.5@tcp:101:bash.0 00010000:00010000:2.0:1788460248.717996:0:18741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460248.718016:0:18741:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f200/0x5dfa74784542c693 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794ab07 expref: -99 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.718079:0:18741:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395e200/0x5dfa74784542c69a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.718094:0:18741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395e200/0x5dfa74784542c69a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.718105:0:18741:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395e200/0x5dfa74784542c69a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.718116:0:18741:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395e400/0x5dfa74784542c6a1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.718124:0:18741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395e400/0x5dfa74784542c6a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.718130:0:18741:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395e400/0x5dfa74784542c6a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.718197:0:18741:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395fa00/0x5dfa74784542c6a8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.718222:0:18741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395fa00/0x5dfa74784542c6a8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.718230:0:18741:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395fa00/0x5dfa74784542c6a8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788460248.718261:0:18741:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788460248.718265:0:18741:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788460248.718300:0:18741:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395fa00/0x5dfa74784542c6a8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.718311:0:18741:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395e200/0x5dfa74784542c69a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.718318:0:18741:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395e200/0x5dfa74784542c69a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.718324:0:18741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395e200/0x5dfa74784542c69a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.718331:0:18741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac395e200 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:2.0:1788460248.718335:0:18741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395e200/0x5dfa74784542c69a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.718343:0:18741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395e200/0x5dfa74784542c69a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.718354:0:18741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4bfa9fe200) 00010000:00010000:2.0:1788460248.718357:0:18741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460248.718362:0:18741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395e200/0x5dfa74784542c69a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.718379:0:18741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395e200/0x5dfa74784542c69a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.718395:0:18741:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395e400/0x5dfa74784542c6a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.718402:0:18741:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395e400/0x5dfa74784542c6a1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.718408:0:18741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395e400/0x5dfa74784542c6a1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.720093:0:18741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac395e400 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:2.0:1788460248.720099:0:18741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395e400/0x5dfa74784542c6a1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.720108:0:18741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395e400/0x5dfa74784542c6a1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.720122:0:18741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8c4bfa9fe700) 00010000:00010000:2.0:1788460248.720125:0:18741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460248.720130:0:18741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395e400/0x5dfa74784542c6a1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.720137:0:18741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395e400/0x5dfa74784542c6a1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.720193:0:18741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f200/0x5dfa74784542c693 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab07 expref: 13 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.720227:0:18741:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395fa00/0x5dfa74784542c6a8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab07 expref: 12 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.720234:0:18741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8c4bfa9fea00) 00010000:00010000:2.0:1788460248.720237:0:18741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788460248.720239:0:18741:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ac395fa00, rc 0) 00000100:00100000:2.0:1788460248.720315:0:18741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf7713b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3471709-a010-41d7-90bc-b8b3ea7c57b0+12:15591:x1875336003452928:12345-192.168.206.5@tcp:101:bash.0 Request processed in 2393us (3106us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460248.720330:0:18741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 36 00000100:00100000:2.0:1788460248.727301:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460248.727373:0:17223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003453056 00000100:00100000:3.0:1788460248.727382:0:17223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003453056 00000100:00100000:3.0:1788460248.727443:0:17223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 7 00000100:00100000:3.0:1788460248.727452:0:17223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfaea8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f3471709-a010-41d7-90bc-b8b3ea7c57b0+5:15591:x1875336003453056:12345-192.168.206.5@tcp:900:bash.0 00000100:00100000:3.0:1788460248.727533:0:17223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfaea8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:f3471709-a010-41d7-90bc-b8b3ea7c57b0+5:15591:x1875336003453056:12345-192.168.206.5@tcp:900:bash.0 Request processed in 82us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460248.727541:0:17223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 7 00000100:00100000:1.0:1788460248.731005:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460248.731986:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003453312 00000100:00100000:0.0:1788460248.731996:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003453312 00000100:00100000:0.0:1788460248.732058:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 37 00000100:00100000:0.0:1788460248.732068:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf7711880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3471709-a010-41d7-90bc-b8b3ea7c57b0+12:15591:x1875336003453312:12345-192.168.206.5@tcp:101:bash.0 00010000:00010000:0.0:1788460248.732087:0:17211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460248.732106:0:17211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208200/0x5dfa74784542c6af lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794ab0e expref: -99 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460248.732202:0:17211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542c6b6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460248.732217:0:17211:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6381600/0x5dfa74784542c68c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab00 expref: 12 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460248.732226:0:17211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542c6b6 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460248.732258:0:17211:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6381600/0x5dfa74784542c68c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab00 expref: 12 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460248.732269:0:17211:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6381600/0x5dfa74784542c68c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab00 expref: 12 pid: 17213 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460248.732282:0:17211:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc532ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17211:1875336022413952:192.168.206.5@tcp:104: 00000100:00100000:0.0:1788460248.732356:0:17211:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc66a7900 going to sleep for 11 seconds 00000100:00100000:3.0:1788460248.734990:0:17211:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc532ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17211:1875336022413952:192.168.206.5@tcp:104: 00010000:00010000:3.0:1788460248.735016:0:17211:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542c6b6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460248.735615:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460248.736037:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003453440 00000100:00100000:2.0:1788460248.736045:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003453440 00010000:00010000:2.0:1788460248.736079:0:17199:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6381600/0x5dfa74784542c68c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab00 expref: 13 pid: 17213 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460248.736118:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 18 00000100:00100000:2.0:1788460248.736127:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf7710380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b90b6ab2-35a4-41df-bd79-b1d2f118ec83+13:2394:x1875336003453440:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788460248.736139:0:17199:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460248.736146:0:17199:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6381600/0x5dfa74784542c68c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab00 expref: 13 pid: 17213 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.736161:0:17199:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6381600/0x5dfa74784542c68c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab00 expref: 13 pid: 17213 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.736180:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6381600/0x5dfa74784542c68c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab00 expref: 13 pid: 17213 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.736212:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8c4bfa9fea00) 00010000:00010000:2.0:1788460248.736217:0:17199:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542c6b6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.736226:0:17199:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542c6b6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.736234:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542c6b6 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.736266:0:17199:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788460248.736320:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf7710380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b90b6ab2-35a4-41df-bd79-b1d2f118ec83+12:2394:x1875336003453440:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 193us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460248.736328:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 18 00010000:00010000:3.0:1788460248.736388:0:17211:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542c6b6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460248.736395:0:17211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542c6b6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460248.736432:0:17211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca6c00/0x5dfa74784542c6bd lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460248.736442:0:17211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca6c00/0x5dfa74784542c6bd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460248.736449:0:17211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca6c00/0x5dfa74784542c6bd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460248.737214:0:17211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7a00/0x5dfa74784542c6c4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460248.737227:0:17211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7a00/0x5dfa74784542c6c4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460248.737235:0:17211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7a00/0x5dfa74784542c6c4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788460248.737244:0:17211:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788460248.737268:0:17211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542c6b6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460248.737275:0:17211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542c6b6 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460248.737282:0:17211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542c6b6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460248.737288:0:17211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bef208400 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:3.0:1788460248.737293:0:17211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542c6b6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460248.737311:0:17211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542c6b6 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460248.737321:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8c4bfa9fea00) 00010000:00010000:3.0:1788460248.737324:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460248.737328:0:17211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542c6b6 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460248.737335:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208400/0x5dfa74784542c6b6 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788460248.737346:0:17211:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a02d6c8b reply state 00000000a46669cf transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca6c00/0x5dfa74784542c6bd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460248.737355:0:17211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca6c00/0x5dfa74784542c6bd lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460248.737361:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8c4bef1fec00) 00010000:00010000:3.0:1788460248.737364:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788460248.737366:0:17211:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788460248.737395:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208200/0x5dfa74784542c6af lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab0e expref: 15 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460248.737409:0:17211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7a00/0x5dfa74784542c6c4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab0e expref: 14 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460248.737644:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c4bef1fea00) 00010000:00010000:3.0:1788460248.737647:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1788460248.737650:0:17211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc6ca7a00, rc 0) 00000100:00100000:3.0:1788460248.738111:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf7711880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3471709-a010-41d7-90bc-b8b3ea7c57b0+15:15591:x1875336003453312:12345-192.168.206.5@tcp:101:bash.0 Request processed in 6044us (7113us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1788460248.738121:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 37 00000100:00100000:0.0:1788460248.759396:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460248.759554:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003453568 00000100:00100000:3.0:1788460248.759563:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003453568 00000100:00100000:3.0:1788460248.759620:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 38 00000100:00100000:3.0:1788460248.759629:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc532ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3471709-a010-41d7-90bc-b8b3ea7c57b0+15:15591:x1875336003453568:12345-192.168.206.5@tcp:101:bash.0 00010000:00010000:3.0:1788460248.759651:0:17212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460248.759668:0:17212:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca6200/0x5dfa74784542c6d2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794ab15 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460248.759726:0:17212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca6000/0x5dfa74784542c6d9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460248.759740:0:17212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca6000/0x5dfa74784542c6d9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460248.759751:0:17212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca6000/0x5dfa74784542c6d9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788460248.759805:0:17212:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788460248.759809:0:17212:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788460248.759827:0:17212:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca6000/0x5dfa74784542c6d9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460248.759836:0:17212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca6000/0x5dfa74784542c6d9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460248.759859:0:17212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca6200/0x5dfa74784542c6d2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab15 expref: 17 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460248.759894:0:17212:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca6000/0x5dfa74784542c6d9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab15 expref: 16 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460248.759903:0:17212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c4bef1fea00) 00010000:00010000:3.0:1788460248.759906:0:17212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788460248.759909:0:17212:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc6ca6000, rc 0) 00000100:00100000:3.0:1788460248.760025:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc532ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3471709-a010-41d7-90bc-b8b3ea7c57b0+16:15591:x1875336003453568:12345-192.168.206.5@tcp:101:bash.0 Request processed in 396us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460248.760032:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 38 00000100:00100000:1.0:1788460248.764063:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460248.766598:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003453824 00000100:00100000:2.0:1788460248.766611:0:17214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003453824 00000100:00100000:2.0:1788460248.766682:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 5 00000100:00100000:2.0:1788460248.766693:0:17214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf7713800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f3471709-a010-41d7-90bc-b8b3ea7c57b0+16:15591:x1875336003453824:12345-192.168.206.5@tcp:35:bash.0 00000100:00100000:2.0:1788460248.767164:0:17214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf7713800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f3471709-a010-41d7-90bc-b8b3ea7c57b0+17:15591:x1875336003453824:12345-192.168.206.5@tcp:35:bash.0 Request processed in 471us (3112us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1788460248.767173:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 5 00000100:00100000:1.0:1788460248.870035:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460248.870102:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003454080 00000100:00100000:2.0:1788460248.870113:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003454080 00000100:00100000:2.0:1788460248.870174:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 39 00000100:00100000:2.0:1788460248.870183:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf7711c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3471709-a010-41d7-90bc-b8b3ea7c57b0+17:15601:x1875336003454080:12345-192.168.206.5@tcp:101:lfs.0 00010000:00010000:2.0:1788460248.870209:0:17213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460248.870240:0:17213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f200/0x5dfa74784542c6e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794ab1c expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788460248.870332:0:17213:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788460248.870433:0:17213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f200/0x5dfa74784542c6e0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab1c expref: 19 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.870447:0:17213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8c4bfa9fe200) 00010000:00010000:2.0:1788460248.870450:0:17213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788460248.870455:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f200/0x5dfa74784542c6e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab1c expref: 19 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.870482:0:17213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ac395f200, rc 0) 00000100:00100000:2.0:1788460248.870547:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf7711c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3471709-a010-41d7-90bc-b8b3ea7c57b0+18:15601:x1875336003454080:12345-192.168.206.5@tcp:101:lfs.0 Request processed in 365us (520us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1788460248.870554:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 39 00000100:00100000:0.0:1788460248.877687:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460248.877835:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003454336 00000100:00100000:1.0:1788460248.877848:0:17214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003454336 00000100:00100000:1.0:1788460248.877919:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 6 00000100:00100000:1.0:1788460248.877931:0:17214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc532dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f3471709-a010-41d7-90bc-b8b3ea7c57b0+18:15601:x1875336003454336:12345-192.168.206.5@tcp:35:lfs.0 00000100:00100000:1.0:1788460248.878267:0:17214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc532dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f3471709-a010-41d7-90bc-b8b3ea7c57b0+19:15601:x1875336003454336:12345-192.168.206.5@tcp:35:lfs.0 Request processed in 337us (595us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1788460248.878276:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 6 00000100:00100000:1.0:1788460248.929520:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460248.929604:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003454592 00000100:00100000:3.0:1788460248.929619:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003454592 00000100:00100000:3.0:1788460248.929688:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 40 00000100:00100000:3.0:1788460248.929698:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf7712d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3471709-a010-41d7-90bc-b8b3ea7c57b0+19:15604:x1875336003454592:12345-192.168.206.5@tcp:101:lfs.0 00010000:00010000:3.0:1788460248.929723:0:17212:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460248.929884:0:17212:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca6200/0x5dfa74784542c6ee lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794ab23 expref: -99 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.931403:0:17212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f200/0x5dfa74784542c6f5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.931423:0:17212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f200/0x5dfa74784542c6f5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.931437:0:17212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f200/0x5dfa74784542c6f5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788460248.931452:0:17212:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788460248.931867:0:17212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca6200/0x5dfa74784542c6ee lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab23 expref: 22 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.931888:0:17212:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f200/0x5dfa74784542c6f5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab23 expref: 21 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460248.931909:0:17212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c4bef1fea00) 00010000:00010000:2.0:1788460248.931912:0:17212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788460248.931915:0:17212:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ac395f200, rc 0) 00000100:00100000:2.0:1788460248.932028:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf7712d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3471709-a010-41d7-90bc-b8b3ea7c57b0+21:15604:x1875336003454592:12345-192.168.206.5@tcp:101:lfs.0 Request processed in 2329us (2520us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1788460248.932038:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 40 00000100:00100000:2.0:1788460248.941456:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460248.941512:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460248.941615:0:20239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003454720 00000100:00100000:0.0:1788460248.941645:0:20239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003454720 00000100:00100000:0.0:1788460248.941731:0:20239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 1 00000100:00100000:0.0:1788460248.941742:0:20239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac1e65850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f3471709-a010-41d7-90bc-b8b3ea7c57b0+21:2394:x1875336003454720:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788460248.941778:0:20239:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788460248.941810:0:20239:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f200/0x5dfa74784542c6f5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab23 expref: 21 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460248.941836:0:20239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c4bef1fea00) 00010000:00010000:0.0:1788460248.941842:0:20239:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788460248.941912:0:20239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac1e65850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f3471709-a010-41d7-90bc-b8b3ea7c57b0+20:2394:x1875336003454720:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 172us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460248.941923:0:20239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 1 00000100:00100000:3.0:1788460248.943016:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003454848 00000100:00100000:3.0:1788460248.943027:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003454848 00000100:00100000:3.0:1788460248.943080:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 41 00000100:00100000:3.0:1788460248.943089:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac383a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3471709-a010-41d7-90bc-b8b3ea7c57b0+20:15604:x1875336003454848:12345-192.168.206.5@tcp:54:lfs.0 00010000:00010000:3.0:1788460248.943163:0:17211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7400/0x5dfa74784542c703 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460248.943181:0:17211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7400/0x5dfa74784542c703 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460248.943210:0:17211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7400/0x5dfa74784542c703 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460248.943252:0:17211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7400/0x5dfa74784542c703 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460248.943259:0:17211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7400/0x5dfa74784542c703 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460248.943268:0:17211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7400/0x5dfa74784542c703 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460248.943274:0:17211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc6ca7400 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:3.0:1788460248.943279:0:17211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7400/0x5dfa74784542c703 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460248.943287:0:17211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7400/0x5dfa74784542c703 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460248.943297:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c4bef1fea00) 00010000:00010000:3.0:1788460248.943300:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788460248.943304:0:17211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7400/0x5dfa74784542c703 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460248.943311:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7400/0x5dfa74784542c703 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460248.943389:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac383a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3471709-a010-41d7-90bc-b8b3ea7c57b0+20:15604:x1875336003454848:12345-192.168.206.5@tcp:54:lfs.0 Request processed in 301us (1875us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460248.943397:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 41 00000100:00100000:2.0:1788460248.950643:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460248.950876:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003455104 00000100:00100000:3.0:1788460248.950890:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003455104 00000100:00100000:3.0:1788460248.951000:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 7 00000100:00100000:3.0:1788460248.951012:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3838e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f3471709-a010-41d7-90bc-b8b3ea7c57b0+20:15604:x1875336003455104:12345-192.168.206.5@tcp:35:lfs.0 00000100:00100000:3.0:1788460248.951614:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3838e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f3471709-a010-41d7-90bc-b8b3ea7c57b0+21:15604:x1875336003455104:12345-192.168.206.5@tcp:35:lfs.0 Request processed in 602us (981us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1788460248.951623:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 7 00010000:00010000:3.0:1788460248.977204:0:18366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788460249.172100:0:17965:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788460249.264609:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460249.264729:0:18741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003455360 00000100:00100000:2.0:1788460249.264740:0:18741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003455360 00000100:00100000:2.0:1788460249.264814:0:18741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 42 00000100:00100000:2.0:1788460249.264838:0:18741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc532c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3471709-a010-41d7-90bc-b8b3ea7c57b0+21:15635:x1875336003455360:12345-192.168.206.5@tcp:101:cat.0 00010000:00010000:2.0:1788460249.264862:0:18741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460249.264881:0:18741:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395ea00/0x5dfa74784542c70a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794ab2a expref: -99 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460249.265011:0:18741:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f000/0x5dfa74784542c711 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460249.265027:0:18741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f000/0x5dfa74784542c711 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460249.265038:0:18741:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f000/0x5dfa74784542c711 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788460249.265067:0:18741:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788460249.265197:0:18741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395ea00/0x5dfa74784542c70a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab2a expref: 24 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460249.265217:0:18741:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f000/0x5dfa74784542c711 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab2a expref: 23 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460249.265226:0:18741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c4bef1fea00) 00010000:00010000:2.0:1788460249.265228:0:18741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788460249.265232:0:18741:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ac395f000, rc 0) 00000100:00100000:2.0:1788460249.265291:0:18741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc532c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3471709-a010-41d7-90bc-b8b3ea7c57b0+23:15635:x1875336003455360:12345-192.168.206.5@tcp:101:cat.0 Request processed in 468us (691us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1788460249.265298:0:18741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 42 00000100:00100000:2.0:1788460249.271849:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460249.271900:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460249.272011:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003455744 00000100:00100000:3.0:1788460249.272029:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003455744 00000100:00100000:3.0:1788460249.272116:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 2 00000100:00100000:3.0:1788460249.272127:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3839880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f3471709-a010-41d7-90bc-b8b3ea7c57b0+23:2396:x1875336003455744:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788460249.272148:0:17199:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788460249.272182:0:17199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f000/0x5dfa74784542c711 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab2a expref: 23 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460249.272207:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c4bef1fea00) 00010000:00010000:3.0:1788460249.272213:0:17199:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788460249.272293:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3839880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f3471709-a010-41d7-90bc-b8b3ea7c57b0+22:2396:x1875336003455744:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 167us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460249.272303:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 2 00000100:00100000:1.0:1788460249.272311:0:17214:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003455616 00000100:00100000:1.0:1788460249.272318:0:17214:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003455616 00000100:00100000:1.0:1788460249.272382:0:17214:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 8 00000100:00100000:1.0:1788460249.272391:0:17214:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3838a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f3471709-a010-41d7-90bc-b8b3ea7c57b0+22:15635:x1875336003455616:12345-192.168.206.5@tcp:35:cat.0 00000100:00100000:1.0:1788460249.272893:0:17214:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3838a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f3471709-a010-41d7-90bc-b8b3ea7c57b0+23:15635:x1875336003455616:12345-192.168.206.5@tcp:35:cat.0 Request processed in 500us (1048us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1788460249.272902:0:17214:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 8 00000100:00100000:2.0:1788460249.360593:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460249.360675:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003456000 00000100:00100000:3.0:1788460249.360686:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003456000 00000100:00100000:3.0:1788460249.360756:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 43 00000100:00100000:3.0:1788460249.360776:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc43f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3471709-a010-41d7-90bc-b8b3ea7c57b0+23:15641:x1875336003456000:12345-192.168.206.5@tcp:101:dd.0 00010000:00010000:3.0:1788460249.360800:0:17211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460249.360834:0:17211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7400/0x5dfa74784542c71f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794ab31 expref: -99 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460249.360930:0:17211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca6600/0x5dfa74784542c726 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460249.360974:0:17211:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7a00/0x5dfa74784542c6c4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab0e expref: 24 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460249.360983:0:17211:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca6000/0x5dfa74784542c6d9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab15 expref: 24 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460249.360992:0:17211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca6600/0x5dfa74784542c726 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460249.361024:0:17211:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca6000/0x5dfa74784542c6d9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab15 expref: 24 pid: 17212 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460249.361037:0:17211:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca6000/0x5dfa74784542c6d9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab15 expref: 24 pid: 17212 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460249.361051:0:17211:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac39d1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17211:1875336022414080:192.168.206.5@tcp:104: 00010000:00010000:3.0:1788460249.361171:0:17211:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7a00/0x5dfa74784542c6c4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab0e expref: 24 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460249.361182:0:17211:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7a00/0x5dfa74784542c6c4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab0e expref: 24 pid: 17211 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460249.361190:0:17211:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac39d2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17211:1875336022414208:192.168.206.5@tcp:104: 00000100:00100000:3.0:1788460249.361225:0:17211:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4ac28b4780 going to sleep for 11 seconds 00000040:00080000:0.0:1788460249.361647:0:17247:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788460249.364025:0:17211:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac39d1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17211:1875336022414080:192.168.206.5@tcp:104: 00000100:00100000:2.0:1788460249.364591:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460249.364624:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460249.364713:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003456128 00000100:00100000:1.0:1788460249.364721:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003456128 00010000:00010000:1.0:1788460249.364759:0:17197:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca6000/0x5dfa74784542c6d9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab15 expref: 25 pid: 17212 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460249.364807:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003456256 00000100:00100000:1.0:1788460249.364811:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003456256 00010000:00010000:1.0:1788460249.364823:0:17197:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7a00/0x5dfa74784542c6c4 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab0e expref: 26 pid: 17211 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460249.364847:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 19 00000100:00100000:1.0:1788460249.364855:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc43f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f3471709-a010-41d7-90bc-b8b3ea7c57b0+26:2394:x1875336003456128:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788460249.364869:0:17197:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788460249.364875:0:17197:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca6000/0x5dfa74784542c6d9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab15 expref: 26 pid: 17212 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460249.364888:0:17197:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca6000/0x5dfa74784542c6d9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab15 expref: 26 pid: 17212 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460249.364908:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca6000/0x5dfa74784542c6d9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab15 expref: 26 pid: 17212 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460249.364979:0:17197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c4bef1fea00) 00010000:00010000:1.0:1788460249.364984:0:17197:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca6600/0x5dfa74784542c726 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460249.364993:0:17197:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca6600/0x5dfa74784542c726 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460249.364999:0:17197:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788460249.365046:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc43f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f3471709-a010-41d7-90bc-b8b3ea7c57b0+25:2394:x1875336003456128:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 191us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460249.365054:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 19 00000100:00100000:1.0:1788460249.365071:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 20 00000100:00100000:1.0:1788460249.365077:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc43f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f3471709-a010-41d7-90bc-b8b3ea7c57b0+24:2393:x1875336003456256:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788460249.365086:0:17197:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788460249.365091:0:17197:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7a00/0x5dfa74784542c6c4 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab0e expref: 24 pid: 17211 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460249.365101:0:17197:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7a00/0x5dfa74784542c6c4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab0e expref: 24 pid: 17211 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460249.365112:0:17197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c4bef1fea00) 00010000:00010000:1.0:1788460249.365115:0:17197:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca6600/0x5dfa74784542c726 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460249.365122:0:17197:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca6600/0x5dfa74784542c726 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460249.365139:0:17197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca6600/0x5dfa74784542c726 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460249.365171:0:17197:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788460249.365192:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc43f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f3471709-a010-41d7-90bc-b8b3ea7c57b0+24:2393:x1875336003456256:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 115us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460249.365199:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 20 00010000:00010000:0.0:1788460249.365596:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7a00/0x5dfa74784542c6c4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab0e expref: 23 pid: 17211 timeout: 646 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460249.365611:0:17211:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac39d2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17211:1875336022414208:192.168.206.5@tcp:104: 00010000:00010000:0.0:1788460249.365632:0:17211:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca6600/0x5dfa74784542c726 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460249.365641:0:17211:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca6600/0x5dfa74784542c726 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460249.365647:0:17211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca6600/0x5dfa74784542c726 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788460249.365675:0:17211:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788460249.365841:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7400/0x5dfa74784542c71f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab31 expref: 24 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460249.365855:0:17211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca6600/0x5dfa74784542c726 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab31 expref: 23 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460249.365862:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c4bef1fea00) 00010000:00010000:0.0:1788460249.365864:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788460249.365867:0:17211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc6ca6600, rc 0) 00000100:00100000:0.0:1788460249.365910:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc43f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3471709-a010-41d7-90bc-b8b3ea7c57b0+23:15641:x1875336003456000:12345-192.168.206.5@tcp:101:dd.0 Request processed in 5145us (5325us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1788460249.365918:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 43 00000100:00100000:2.0:1788460249.372556:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460249.373596:0:18741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003456384 00000100:00100000:1.0:1788460249.373609:0:18741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003456384 00000100:00100000:1.0:1788460249.373672:0:18741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 44 00000100:00100000:1.0:1788460249.373682:0:18741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4908e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3471709-a010-41d7-90bc-b8b3ea7c57b0+23:15641:x1875336003456384:12345-192.168.206.5@tcp:101:dd.0 00010000:00010000:1.0:1788460249.373716:0:18741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460249.373736:0:18741:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6380600/0x5dfa74784542c734 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794ab38 expref: -99 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460249.374538:0:18741:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6380000/0x5dfa74784542c73b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460249.374559:0:18741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6380000/0x5dfa74784542c73b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460249.374572:0:18741:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6380000/0x5dfa74784542c73b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460249.374694:0:18741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6380600/0x5dfa74784542c734 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab38 expref: 25 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460249.374714:0:18741:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6380000/0x5dfa74784542c73b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab38 expref: 24 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460249.374730:0:18741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c4bef1fea00) 00010000:00010000:1.0:1788460249.374733:0:18741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788460249.374736:0:18741:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc6380000, rc 0) 00000100:00100000:1.0:1788460249.374875:0:18741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4908e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3471709-a010-41d7-90bc-b8b3ea7c57b0+24:15641:x1875336003456384:12345-192.168.206.5@tcp:101:dd.0 Request processed in 1192us (2325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460249.374883:0:18741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 44 00000100:00100000:1.0:1788460249.382017:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460249.382408:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003456640 00000100:00100000:2.0:1788460249.382418:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003456640 00000100:00100000:2.0:1788460249.382492:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 45 00000100:00100000:2.0:1788460249.382503:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf7710e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3471709-a010-41d7-90bc-b8b3ea7c57b0+24:15641:x1875336003456640:12345-192.168.206.5@tcp:36:dd.0 00010000:00010000:2.0:1788460249.382706:0:17213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395ea00/0x5dfa74784542c742 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460249.382723:0:17213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395ea00/0x5dfa74784542c742 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460249.382750:0:17213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395ea00/0x5dfa74784542c742 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788460249.382808:0:17213:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1788460249.382831:0:17213:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000355fb8e0 reply state 00000000984d9f84 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395ea00/0x5dfa74784542c742 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460249.382844:0:17213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395ea00/0x5dfa74784542c742 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460249.382851:0:17213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c4bef1fea00) 00010000:00010000:2.0:1788460249.382854:0:17213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788460249.382857:0:17213:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788460249.382972:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf7710e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3471709-a010-41d7-90bc-b8b3ea7c57b0+27:15641:x1875336003456640:12345-192.168.206.5@tcp:36:dd.0 Request processed in 469us (961us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1788460249.382981:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 45 00000020:00080000:2.0:1788460249.382986:0:17213:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788460249.385154:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460249.385233:0:18741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003456768 00000100:00100000:1.0:1788460249.385242:0:18741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003456768 00000100:00100000:1.0:1788460249.385300:0:18741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 46 00000100:00100000:1.0:1788460249.385309:0:18741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac39d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3471709-a010-41d7-90bc-b8b3ea7c57b0+27:15641:x1875336003456768:12345-192.168.206.5@tcp:101:dd.0 00010000:00010000:1.0:1788460249.385330:0:18741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460249.385347:0:18741:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6381400/0x5dfa74784542c749 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794ab3f expref: -99 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460249.385398:0:18741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6381400/0x5dfa74784542c749 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab3f expref: 28 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460249.385413:0:18741:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6381400/0x5dfa74784542c749 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab3f expref: 28 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460249.385431:0:18741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c4bef1fea00) 00010000:00010000:1.0:1788460249.385434:0:18741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788460249.385437:0:18741:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc6381400, rc 0) 00000100:00100000:1.0:1788460249.385493:0:18741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac39d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3471709-a010-41d7-90bc-b8b3ea7c57b0+28:15641:x1875336003456768:12345-192.168.206.5@tcp:101:dd.0 Request processed in 185us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460249.385515:0:18741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 46 00000100:00100000:1.0:1788460249.407396:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460249.407482:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003457024 00000100:00100000:3.0:1788460249.407491:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003457024 00000100:00100000:3.0:1788460249.407552:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 3 00000100:00100000:3.0:1788460249.407562:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bf7710380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f3471709-a010-41d7-90bc-b8b3ea7c57b0+28:15641:x1875336003457024:12345-192.168.206.5@tcp:103:dd.0 00010000:00010000:3.0:1788460249.407577:0:17197:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788460249.407599:0:17197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6381400/0x5dfa74784542c749 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab3f expref: 28 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460249.407616:0:17197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c4bef1fea00) 00010000:00010000:3.0:1788460249.407621:0:17197:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788460249.407678:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bf7710380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f3471709-a010-41d7-90bc-b8b3ea7c57b0+27:15641:x1875336003457024:12345-192.168.206.5@tcp:103:dd.0 Request processed in 117us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460249.407685:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 3 00000100:00100000:3.0:1788460249.413306:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460249.413761:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003457152 00000100:00100000:0.0:1788460249.413782:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003457152 00000100:00100000:0.0:1788460249.414068:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 47 00000100:00100000:0.0:1788460249.414079:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac39d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3471709-a010-41d7-90bc-b8b3ea7c57b0+27:15641:x1875336003457152:12345-192.168.206.5@tcp:58:dd.0 00010000:00010000:0.0:1788460249.414181:0:17211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209e00/0x5dfa74784542c750 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460249.414199:0:17211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209e00/0x5dfa74784542c750 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460249.414211:0:17211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209e00/0x5dfa74784542c750 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788460249.415653:0:17211:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788460249.416093:0:17211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1788460249.416511:0:17211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1788460249.416643:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac39d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3471709-a010-41d7-90bc-b8b3ea7c57b0+27:15641:x1875336003457152:12345-192.168.206.5@tcp:58:dd.0 Request processed in 2561us (3340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460249.416654:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 47 00000100:00100000:0.0:1788460249.421866:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460249.423544:0:18741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003457280 00000100:00100000:1.0:1788460249.423564:0:18741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003457280 00000100:00100000:1.0:1788460249.423631:0:18741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 48 00000100:00100000:1.0:1788460249.423641:0:18741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc532e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3471709-a010-41d7-90bc-b8b3ea7c57b0+27:15641:x1875336003457280:12345-192.168.206.5@tcp:101:dd.0 00010000:00010000:1.0:1788460249.423663:0:18741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460249.423683:0:18741:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6380600/0x5dfa74784542c757 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794ab46 expref: -99 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460249.423735:0:18741:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209e00/0x5dfa74784542c750 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460249.423746:0:18741:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6380600/0x5dfa74784542c757 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab46 expref: 28 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460249.423764:0:18741:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209e00/0x5dfa74784542c750 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460249.423788:0:18741:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6380600/0x5dfa74784542c757 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab46 expref: 28 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460249.423801:0:18741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c4bef1fea00) 00010000:00010000:1.0:1788460249.423804:0:18741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788460249.423808:0:18741:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6380600/0x5dfa74784542c757 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab46 expref: 28 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460249.423816:0:18741:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc6380600, rc 0) 00000100:00100000:1.0:1788460249.423884:0:18741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc532e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3471709-a010-41d7-90bc-b8b3ea7c57b0+28:15641:x1875336003457280:12345-192.168.206.5@tcp:101:dd.0 Request processed in 245us (2026us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460249.423890:0:18741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 48 00000100:00100000:1.0:1788460249.534524:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460249.534568:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460249.534598:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460249.534632:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460249.534788:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460249.534809:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460249.534832:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003457536 00000100:00100000:2.0:1788460249.534841:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003457536 00000100:00100000:2.0:1788460249.534884:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003458048 00000100:00100000:2.0:1788460249.534888:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003458048 00000100:00100000:2.0:1788460249.534911:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 50 00000100:00100000:2.0:1788460249.534919:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac1e60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3471709-a010-41d7-90bc-b8b3ea7c57b0+5:2393:x1875336003457536:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:3.0:1788460249.535117:0:17204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003457408 00000100:00100000:3.0:1788460249.535121:0:17204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003457408 00000100:00100000:3.0:1788460249.535153:0:17204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 189 00000100:00100000:3.0:1788460249.535161:0:17204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4043850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:051c7034-18a2-40f3-ae82-fb4fdf9e0800+14:2393:x1875336003457408:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:3.0:1788460249.535260:0:17204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4043850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:051c7034-18a2-40f3-ae82-fb4fdf9e0800+14:2393:x1875336003457408:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 95us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460249.535268:0:17204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 189 00000100:00100000:3.0:1788460249.535395:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 51 00000100:00100000:3.0:1788460249.535403:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac1e60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b90b6ab2-35a4-41df-bd79-b1d2f118ec83+5:2393:x1875336003458048:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:3.0:1788460249.535436:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac1e60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b90b6ab2-35a4-41df-bd79-b1d2f118ec83+5:2393:x1875336003458048:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 34us (837us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460249.535456:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 51 00000100:00100000:2.0:1788460249.535914:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac1e60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3471709-a010-41d7-90bc-b8b3ea7c57b0+5:2393:x1875336003457536:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 993us (1396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460249.535934:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 50 00000100:00100000:0.0:1788460249.543204:0:19273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003457792 00000100:00100000:0.0:1788460249.543217:0:19273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003457792 00000100:00100000:0.0:1788460249.543292:0:19273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003458304 00000100:00100000:0.0:1788460249.543296:0:19273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003458304 00000100:00100000:0.0:1788460249.543315:0:19273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003457664 00000100:00100000:0.0:1788460249.543319:0:19273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003457664 00000100:00100000:0.0:1788460249.543338:0:19273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 15 00000100:00100000:0.0:1788460249.543346:0:19273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac1e61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f3471709-a010-41d7-90bc-b8b3ea7c57b0+5:2393:x1875336003457792:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:0.0:1788460249.543421:0:19273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac1e61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f3471709-a010-41d7-90bc-b8b3ea7c57b0+5:2393:x1875336003457792:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 76us (8852us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460249.543429:0:19273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 15 00000100:00100000:3.0:1788460249.543464:0:18717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 16 00000100:00100000:3.0:1788460249.543477:0:18717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b90b6ab2-35a4-41df-bd79-b1d2f118ec83+5:2393:x1875336003458304:12345-192.168.206.5@tcp:400:kworker.0 00000100:00080000:1.0:1788460249.543487:0:17207:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788460249.543492:0:17207:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788460249.543511:0:18717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b90b6ab2-35a4-41df-bd79-b1d2f118ec83+5:2393:x1875336003458304:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 38us (8877us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460249.543519:0:18717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 16 00000100:00100000:1.0:1788460249.543998:0:19708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 17 00000100:00100000:1.0:1788460249.544010:0:19708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f3471709-a010-41d7-90bc-b8b3ea7c57b0+5:2393:x1875336003457664:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:1.0:1788460249.544043:0:19708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f3471709-a010-41d7-90bc-b8b3ea7c57b0+5:2393:x1875336003457664:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 37us (9232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460249.544050:0:19708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 17 00000100:00100000:1.0:1788460249.544118:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460249.544196:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460249.544214:0:19708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003458176 00000100:00100000:1.0:1788460249.544218:0:19708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003458176 00000100:00100000:1.0:1788460249.544245:0:19708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 18 00000100:00100000:1.0:1788460249.544251:0:19708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b90b6ab2-35a4-41df-bd79-b1d2f118ec83+5:2393:x1875336003458176:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:1.0:1788460249.544277:0:19708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b90b6ab2-35a4-41df-bd79-b1d2f118ec83+5:2393:x1875336003458176:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 26us (81us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460249.544284:0:19708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 18 00000100:00080000:1.0:1788460249.544301:0:17207:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788460249.544407:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003457920 00000100:00100000:1.0:1788460249.544411:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003457920 00000100:00100000:1.0:1788460249.544439:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 52 00000100:00100000:1.0:1788460249.544446:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b90b6ab2-35a4-41df-bd79-b1d2f118ec83+12:2393:x1875336003457920:12345-192.168.206.5@tcp:400:kworker.0 00000100:00100000:1.0:1788460249.544485:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b90b6ab2-35a4-41df-bd79-b1d2f118ec83+12:2393:x1875336003457920:12345-192.168.206.5@tcp:400:kworker.0 Request processed in 39us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460249.544492:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 52 00010000:00010000:2.0:1788460250.001378:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788460250.193278:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac41be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022414336:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788460250.193319:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc532e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022414464:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788460250.193366:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460250.193430:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022414336 00000100:00100000:0.0:1788460250.193436:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460250.193439:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022414336 00000100:00100000:2.0:1788460250.193486:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022414464 00000100:00100000:2.0:1788460250.193490:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022414464 00000100:00100000:0.0:1788460250.197047:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788460250.197068:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac490b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022414336:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788460250.197108:0:17216:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788460250.197194:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac490b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3660:x1875336022414336:12345-0@lo:41:osp-pre-1-0.0 Request processed in 135us (3828us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460250.197707:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788460250.197738:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788460250.197746:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc532fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022414464:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788460250.197795:0:17216:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1788460250.198055:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac41be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3660:1875336022414336:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788460250.200388:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc532fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022414464:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2634us (6944us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460250.200402:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788460250.200473:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc532e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022414464:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1788460250.385137:0:17247:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788460250.385146:0:17247:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788460250.385168:0:17247:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788460250.385176:0:17247:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788460250.385301:0:17247:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc532e680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17247:1875336022414592:192.168.206.5@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788460250.385388:0:17247:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc66a7300 going to sleep for 11 seconds 00000100:00100000:0.0:1788460250.388811:0:17247:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc532e680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17247:1875336022414592:192.168.206.5@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788460250.399166:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460250.399264:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003458432 00000100:00100000:2.0:1788460250.399273:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003458432 00000100:00100000:2.0:1788460250.399346:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 49 00000100:00100000:2.0:1788460250.399357:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3471709-a010-41d7-90bc-b8b3ea7c57b0+28:15642:x1875336003458432:12345-192.168.206.5@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788460250.399387:0:17213:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788460250.399499:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3471709-a010-41d7-90bc-b8b3ea7c57b0+28:15642:x1875336003458432:12345-192.168.206.5@tcp:53:lhsmtool_posix.0 Request processed in 144us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460250.399507:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 49 00000100:00080000:1.0:1788460250.399709:0:17207:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788460250.411542:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460250.411637:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003458560 00000100:00100000:3.0:1788460250.411648:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003458560 00000100:00100000:3.0:1788460250.411713:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 50 00000100:00100000:3.0:1788460250.411723:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3471709-a010-41d7-90bc-b8b3ea7c57b0+28:15642:x1875336003458560:12345-192.168.206.5@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788460250.411801:0:17211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca6400/0x5dfa74784542c75e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460250.411818:0:17211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca6400/0x5dfa74784542c75e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460250.411829:0:17211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca6400/0x5dfa74784542c75e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460250.411844:0:17211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7600/0x5dfa74784542c765 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460250.411850:0:17211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7600/0x5dfa74784542c765 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460250.411856:0:17211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7600/0x5dfa74784542c765 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460250.411894:0:17211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7000/0x5dfa74784542c76c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460250.411904:0:17211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7000/0x5dfa74784542c76c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460250.411910:0:17211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7000/0x5dfa74784542c76c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788460250.412003:0:17211:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788460250.412008:0:17211:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788460250.412059:0:17211:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7000/0x5dfa74784542c76c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460250.412070:0:17211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca6400/0x5dfa74784542c75e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460250.412077:0:17211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca6400/0x5dfa74784542c75e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460250.412084:0:17211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca6400/0x5dfa74784542c75e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460250.412090:0:17211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc6ca6400 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:3.0:1788460250.412094:0:17211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca6400/0x5dfa74784542c75e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460250.412101:0:17211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca6400/0x5dfa74784542c75e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460250.412112:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c4bc3995600) 00010000:00010000:3.0:1788460250.412122:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460250.412128:0:17211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca6400/0x5dfa74784542c75e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460250.412134:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca6400/0x5dfa74784542c75e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460250.412147:0:17211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7600/0x5dfa74784542c765 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460250.412153:0:17211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7600/0x5dfa74784542c765 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460250.412159:0:17211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7600/0x5dfa74784542c765 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460250.412164:0:17211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc6ca7600 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:3.0:1788460250.412166:0:17211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7600/0x5dfa74784542c765 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460250.412171:0:17211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7600/0x5dfa74784542c765 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460250.412178:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8c4bef1fe800) 00010000:00010000:3.0:1788460250.412181:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460250.412183:0:17211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7600/0x5dfa74784542c765 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460250.412189:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7600/0x5dfa74784542c765 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460250.412348:0:17211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7000/0x5dfa74784542c76c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460250.412361:0:17211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7000/0x5dfa74784542c76c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460250.412367:0:17211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7000/0x5dfa74784542c76c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460250.412372:0:17211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc6ca7000 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:3.0:1788460250.412375:0:17211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7000/0x5dfa74784542c76c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460250.412381:0:17211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7000/0x5dfa74784542c76c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460250.412391:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c4bef1fea00) 00010000:00010000:3.0:1788460250.412393:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460250.412396:0:17211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7000/0x5dfa74784542c76c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460250.412402:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7000/0x5dfa74784542c76c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460250.412475:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3471709-a010-41d7-90bc-b8b3ea7c57b0+28:15642:x1875336003458560:12345-192.168.206.5@tcp:34:lhsmtool_posix.0 Request processed in 752us (941us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460250.412484:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 50 00000100:00100000:3.0:1788460250.419725:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460250.419858:0:18741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003458816 00000100:00100000:2.0:1788460250.419868:0:18741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003458816 00000100:00100000:2.0:1788460250.419926:0:18741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 51 00000100:00100000:2.0:1788460250.419936:0:18741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac39d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3471709-a010-41d7-90bc-b8b3ea7c57b0+28:15642:x1875336003458816:12345-192.168.206.5@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788460250.419981:0:18741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460250.420001:0:18741:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f200/0x5dfa74784542c773 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794ab4d expref: -99 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.420109:0:18741:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395e200/0x5dfa74784542c77a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.420125:0:18741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395e200/0x5dfa74784542c77a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.420137:0:18741:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395e200/0x5dfa74784542c77a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788460250.420165:0:18741:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788460250.420434:0:18741:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395e200/0x5dfa74784542c77a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.420444:0:18741:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395e200/0x5dfa74784542c77a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.420451:0:18741:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395e200/0x5dfa74784542c77a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.420457:0:18741:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac395e200 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:2.0:1788460250.420461:0:18741:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395e200/0x5dfa74784542c77a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.420468:0:18741:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395e200/0x5dfa74784542c77a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.420480:0:18741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c4bef1fea00) 00010000:00010000:2.0:1788460250.420483:0:18741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788460250.420488:0:18741:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395e200/0x5dfa74784542c77a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.420493:0:18741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395e200/0x5dfa74784542c77a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.420544:0:18741:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f200/0x5dfa74784542c773 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab4d expref: 30 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.420710:0:18741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8c4bc3995600) 00010000:00010000:2.0:1788460250.420713:0:18741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788460250.420725:0:18741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f200/0x5dfa74784542c773 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab4d expref: 30 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.420736:0:18741:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ac395f200, rc 0) 00000100:00100000:2.0:1788460250.420848:0:18741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac39d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3471709-a010-41d7-90bc-b8b3ea7c57b0+29:15642:x1875336003458816:12345-192.168.206.5@tcp:101:lhsmtool_posix.0 Request processed in 913us (1131us total) trans 8589934611 rc 301/301 00000100:00100000:2.0:1788460250.420856:0:18741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 51 00000100:00100000:1.0:1788460250.432647:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460250.432805:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003458944 00000100:00100000:3.0:1788460250.432815:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003458944 00000100:00100000:3.0:1788460250.432878:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 52 00000100:00100000:3.0:1788460250.432887:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3471709-a010-41d7-90bc-b8b3ea7c57b0+29:15642:x1875336003458944:12345-192.168.206.5@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788460250.432936:0:17212:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788460250.433348:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3471709-a010-41d7-90bc-b8b3ea7c57b0+29:15642:x1875336003458944:12345-192.168.206.5@tcp:53:lhsmtool_posix.0 Request processed in 460us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460250.433357:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 52 00000100:00100000:1.0:1788460250.445360:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460250.447020:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003459200 00000100:00100000:2.0:1788460250.447033:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003459200 00000100:00100000:2.0:1788460250.447092:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 53 00000100:00100000:2.0:1788460250.447101:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3471709-a010-41d7-90bc-b8b3ea7c57b0+29:15642:x1875336003459200:12345-192.168.206.5@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788460250.447121:0:17213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460250.447142:0:17213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f200/0x5dfa74784542c788 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794ab54 expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788460250.447498:0:17213:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x7:0x0], count =27 00000004:00080000:2.0:1788460250.447504:0:17213:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x7:0x0]+27 in llog 00000004:00080000:2.0:1788460250.447526:0:17213:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x22:0x0], index 0: 0 00010000:00010000:2.0:1788460250.447668:0:17213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395e200/0x5dfa74784542c78f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.447681:0:17213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395e200/0x5dfa74784542c78f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.447691:0:17213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395e200/0x5dfa74784542c78f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.447745:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f200/0x5dfa74784542c788 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab54 expref: 32 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.447794:0:17213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395e200/0x5dfa74784542c78f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab54 expref: 31 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.447803:0:17213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8c4bfa9fe500) 00010000:00010000:2.0:1788460250.447806:0:17213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788460250.447809:0:17213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ac395e200, rc 0) 00000100:00100000:2.0:1788460250.447875:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3471709-a010-41d7-90bc-b8b3ea7c57b0+31:15642:x1875336003459200:12345-192.168.206.5@tcp:101:lhsmtool_posix.0 Request processed in 774us (2523us total) trans 8589934612 rc 0/0 00000100:00100000:2.0:1788460250.447883:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 53 00000100:00100000:1.0:1788460250.453561:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460250.453930:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003459456 00000100:00100000:3.0:1788460250.453940:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003459456 00000100:00100000:3.0:1788460250.454034:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 54 00000100:00100000:3.0:1788460250.454044:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3471709-a010-41d7-90bc-b8b3ea7c57b0+31:15642:x1875336003459456:12345-192.168.206.5@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788460250.454103:0:17211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788460250.454130:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395e200/0x5dfa74784542c78f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab54 expref: 31 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460250.454151:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8c4bfa9fe500) 00010000:00010000:3.0:1788460250.454162:0:17211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788460250.454183:0:17211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7000/0x5dfa74784542c79d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460250.454197:0:17211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7000/0x5dfa74784542c79d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460250.454422:0:17211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7000/0x5dfa74784542c79d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460250.454481:0:17211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7600/0x5dfa74784542c7a4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x69e5908c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460250.454489:0:17211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7600/0x5dfa74784542c7a4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x69e5908c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460250.454515:0:17211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7600/0x5dfa74784542c7a4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x69e5908c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460250.454555:0:17211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7000/0x5dfa74784542c79d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460250.454562:0:17211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7000/0x5dfa74784542c79d lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460250.454568:0:17211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7000/0x5dfa74784542c79d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460250.454574:0:17211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc6ca7000 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:3.0:1788460250.454578:0:17211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7000/0x5dfa74784542c79d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460250.454586:0:17211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7000/0x5dfa74784542c79d lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460250.454595:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8c4bfa9fea00) 00010000:00010000:3.0:1788460250.454598:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460250.454602:0:17211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7000/0x5dfa74784542c79d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460250.454608:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7000/0x5dfa74784542c79d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460250.454617:0:17211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7600/0x5dfa74784542c7a4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x69e5908c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460250.454623:0:17211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7600/0x5dfa74784542c7a4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x69e5908c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460250.454635:0:17211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7600/0x5dfa74784542c7a4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x69e5908c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460250.454640:0:17211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc6ca7600 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:3.0:1788460250.454643:0:17211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7600/0x5dfa74784542c7a4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x69e5908c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460250.454649:0:17211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7600/0x5dfa74784542c7a4 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x69e5908c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460250.454658:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x69e5908c (ffff8c4bef1fe800) 00010000:00010000:3.0:1788460250.454661:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788460250.454663:0:17211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7600/0x5dfa74784542c7a4 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x69e5908c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460250.454670:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7600/0x5dfa74784542c7a4 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x69e5908c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460250.454752:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3471709-a010-41d7-90bc-b8b3ea7c57b0+30:15642:x1875336003459456:12345-192.168.206.5@tcp:36:lhsmtool_posix.0 Request processed in 709us (1199us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788460250.454760:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 54 00000100:00100000:1.0:1788460250.457369:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460250.458510:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003459584 00000100:00100000:2.0:1788460250.458522:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003459584 00000100:00100000:2.0:1788460250.458588:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 55 00000100:00100000:2.0:1788460250.458598:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3471709-a010-41d7-90bc-b8b3ea7c57b0+30:15642:x1875336003459584:12345-192.168.206.5@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788460250.458617:0:17213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788460250.458638:0:17213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f200/0x5dfa74784542c7ab lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794ab5b expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.458672:0:17213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395e400/0x5dfa74784542c7b2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.458809:0:17213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395e400/0x5dfa74784542c7b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.458823:0:17213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395e400/0x5dfa74784542c7b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.458931:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f200/0x5dfa74784542c7ab lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab5b expref: 32 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.459057:0:17213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395e400/0x5dfa74784542c7b2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab5b expref: 31 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.459067:0:17213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8c4bfa9fe900) 00010000:00010000:2.0:1788460250.459069:0:17213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788460250.459072:0:17213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4ac395e400, rc 0) 00000100:00100000:2.0:1788460250.459177:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3471709-a010-41d7-90bc-b8b3ea7c57b0+31:15642:x1875336003459584:12345-192.168.206.5@tcp:101:lhsmtool_posix.0 Request processed in 580us (1816us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460250.459185:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 55 00000100:00100000:1.0:1788460250.461941:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460250.462133:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003459840 00000100:00100000:3.0:1788460250.462142:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003459840 00000100:00100000:3.0:1788460250.462676:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 56 00000100:00100000:3.0:1788460250.462689:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3471709-a010-41d7-90bc-b8b3ea7c57b0+31:15642:x1875336003459840:12345-192.168.206.5@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788460250.462775:0:17212:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7600/0x5dfa74784542c7b9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460250.462791:0:17212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7600/0x5dfa74784542c7b9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460250.462816:0:17212:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7600/0x5dfa74784542c7b9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788460250.464269:0:17212:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:2.0:1788460250.464301:0:17212:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 547567355935ns, next at 548567351252ns, rc = 0 00000004:00010000:2.0:1788460250.464372:0:17212:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000059fd1736 reply state 0000000067fc3b3a transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7600/0x5dfa74784542c7b9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.464392:0:17212:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7600/0x5dfa74784542c7b9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.464401:0:17212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8c4bfa9fe900) 00010000:00010000:2.0:1788460250.464405:0:17212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788460250.464409:0:17212:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788460250.464521:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3471709-a010-41d7-90bc-b8b3ea7c57b0+33:15642:x1875336003459840:12345-192.168.206.5@tcp:36:lhsmtool_posix.0 Request processed in 1832us (2584us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1788460250.464531:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 56 00000100:00100000:1.0:1788460250.474294:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460250.474825:0:18741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003459968 00000100:00100000:3.0:1788460250.474836:0:18741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003459968 00000100:00100000:3.0:1788460250.474990:0:18741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 57 00000100:00100000:3.0:1788460250.475003:0:18741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3471709-a010-41d7-90bc-b8b3ea7c57b0+33:15642:x1875336003459968:12345-192.168.206.5@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788460250.475027:0:18741:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460250.475045:0:18741:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7000/0x5dfa74784542c7c0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794ab62 expref: -99 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460250.475114:0:18741:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7000/0x5dfa74784542c7c0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab62 expref: 34 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460250.475128:0:18741:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7000/0x5dfa74784542c7c0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab62 expref: 34 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460250.475154:0:18741:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8c4bfa9fe900) 00010000:00010000:3.0:1788460250.475158:0:18741:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788460250.475162:0:18741:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc6ca7000, rc 0) 00000100:00100000:3.0:1788460250.475228:0:18741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3471709-a010-41d7-90bc-b8b3ea7c57b0+34:15642:x1875336003459968:12345-192.168.206.5@tcp:101:lhsmtool_posix.0 Request processed in 229us (953us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460250.475234:0:18741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 57 00000100:00100000:1.0:1788460250.481367:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460250.481836:0:19708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003460096 00000100:00100000:2.0:1788460250.481845:0:19708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003460096 00000100:00100000:2.0:1788460250.481904:0:19708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 20 00000100:00100000:2.0:1788460250.481914:0:19708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f3471709-a010-41d7-90bc-b8b3ea7c57b0+5:2394:x1875336003460096:12345-192.168.206.5@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788460250.482181:0:19708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f3471709-a010-41d7-90bc-b8b3ea7c57b0+6:2394:x1875336003460096:12345-192.168.206.5@tcp:2:lhsmtool_posix.0 Request processed in 268us (821us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1788460250.482190:0:19708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 20 00000100:00100000:1.0:1788460250.495033:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460250.495171:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003460352 00000100:00100000:3.0:1788460250.495181:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003460352 00000100:00100000:3.0:1788460250.495236:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 9 00000100:00100000:3.0:1788460250.495246:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f3471709-a010-41d7-90bc-b8b3ea7c57b0+34:15642:x1875336003460352:12345-192.168.206.5@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788460250.495462:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f3471709-a010-41d7-90bc-b8b3ea7c57b0+35:15642:x1875336003460352:12345-192.168.206.5@tcp:35:lhsmtool_posix.0 Request processed in 216us (435us total) trans 8589934614 rc 0/0 00000100:00100000:3.0:1788460250.495470:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 9 00000100:00100000:3.0:1788460250.504101:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460250.504352:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003460608 00000100:00100000:1.0:1788460250.504362:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003460608 00000100:00100000:1.0:1788460250.504470:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 58 00000100:00100000:1.0:1788460250.504481:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac39d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3471709-a010-41d7-90bc-b8b3ea7c57b0+35:15642:x1875336003460608:12345-192.168.206.5@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788460250.504582:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac39d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3471709-a010-41d7-90bc-b8b3ea7c57b0+35:15642:x1875336003460608:12345-192.168.206.5@tcp:57:lhsmtool_posix.0 Request processed in 103us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460250.504590:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 58 00000100:00100000:2.0:1788460250.517207:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460250.517301:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003460736 00000100:00100000:1.0:1788460250.517312:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003460736 00000100:00100000:1.0:1788460250.517370:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 59 00000100:00100000:1.0:1788460250.517379:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4284700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3471709-a010-41d7-90bc-b8b3ea7c57b0+35:15642:x1875336003460736:12345-192.168.206.5@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788460250.517399:0:17213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788460250.517420:0:17213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6380400/0x5dfa74784542c7c7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794ab69 expref: -99 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460250.517487:0:17213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6381200/0x5dfa74784542c7ce lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460250.517501:0:17213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6381200/0x5dfa74784542c7ce lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460250.517513:0:17213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6381200/0x5dfa74784542c7ce lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788460250.517555:0:17213:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788460250.517573:0:17213:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6381200/0x5dfa74784542c7ce lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460250.517598:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6380400/0x5dfa74784542c7c7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab69 expref: 37 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460250.517615:0:17213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6381200/0x5dfa74784542c7ce lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab69 expref: 36 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460250.517623:0:17213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8c4bfa9fe900) 00010000:00010000:1.0:1788460250.517625:0:17213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788460250.517628:0:17213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc6381200, rc 0) 00000100:00100000:1.0:1788460250.517828:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4284700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3471709-a010-41d7-90bc-b8b3ea7c57b0+36:15642:x1875336003460736:12345-192.168.206.5@tcp:101:lhsmtool_posix.0 Request processed in 449us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460250.517836:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 59 00000100:00100000:2.0:1788460250.531410:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460250.531512:0:19273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003460864 00000100:00100000:0.0:1788460250.531521:0:19273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003460864 00000100:00100000:0.0:1788460250.531576:0:19273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 21 00000100:00100000:0.0:1788460250.531983:0:19273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac43a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f3471709-a010-41d7-90bc-b8b3ea7c57b0+6:2394:x1875336003460864:12345-192.168.206.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788460250.532000:0:19273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460250.532019:0:19273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d609de44/0x5dfa74784542c7d5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794ab70 expref: -99 pid: 19273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788460250.532042:0:19273:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a99bcd9, blocks: 0x0 00010000:00010000:0.0:1788460250.532061:0:19273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=547s v=(0 0) 00010000:00010000:0.0:1788460250.532065:0:19273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460250.532074:0:19273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d609de44/0x5dfa74784542c7d5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab70 expref: 7 pid: 19273 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460250.532109:0:19273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d609de44/0x5dfa74784542c7d5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab70 expref: 7 pid: 19273 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460250.532121:0:19273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bef209800, rc 0) 00000100:00100000:0.0:1788460250.532910:0:19273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac43a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f3471709-a010-41d7-90bc-b8b3ea7c57b0+7:2394:x1875336003460864:12345-192.168.206.5@tcp:101:lhsmtool_posix.0 Request processed in 918us (1494us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460250.532919:0:19273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 21 00000100:00100000:2.0:1788460250.547629:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460250.547740:0:17212:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003461120 00000100:00100000:1.0:1788460250.547758:0:17212:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003461120 00000100:00100000:1.0:1788460250.547826:0:17212:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 60 00000100:00100000:1.0:1788460250.547835:0:17212:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac43ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3471709-a010-41d7-90bc-b8b3ea7c57b0+36:15642:x1875336003461120:12345-192.168.206.5@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788460250.547940:0:17212:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac43ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f3471709-a010-41d7-90bc-b8b3ea7c57b0+36:15642:x1875336003461120:12345-192.168.206.5@tcp:57:lhsmtool_posix.0 Request processed in 105us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460250.547985:0:17212:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 60 00000100:00100000:2.0:1788460250.553416:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460250.553644:0:18741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003461248 00000100:00100000:3.0:1788460250.553654:0:18741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003461248 00000100:00100000:3.0:1788460250.553790:0:18741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 61 00000100:00100000:3.0:1788460250.553802:0:18741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac43ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3471709-a010-41d7-90bc-b8b3ea7c57b0+36:15642:x1875336003461248:12345-192.168.206.5@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788460250.558354:0:17192:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:0.0:1788460250.558372:0:17192:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:0.0:1788460250.558416:0:17192:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00010000:00010000:0.0:1788460250.558469:0:3645:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6381800/0x5dfa74784542c662 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460250.558480:0:3645:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6381800/0x5dfa74784542c662 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460250.558487:0:3645:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6381800/0x5dfa74784542c662 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460250.558493:0:3645:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc6381800 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:0.0:1788460250.558497:0:3645:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6381800/0x5dfa74784542c662 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460250.558504:0:3645:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6381800/0x5dfa74784542c662 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460250.558532:0:3645:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8c4bfa9fea00) 00010000:00010000:0.0:1788460250.558535:0:3645:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1788460250.558551:0:3645:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6381800/0x5dfa74784542c662 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460250.558558:0:3645:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6381800/0x5dfa74784542c662 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460250.558709:0:3661:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788460250.558726:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac39d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022414720:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788460250.558795:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788460250.558917:0:18741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac43ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f3471709-a010-41d7-90bc-b8b3ea7c57b0+19:15642:x1875336003461248:12345-192.168.206.5@tcp:44:lhsmtool_posix.0 Request processed in 5116us (5507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460250.558927:0:18741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 61 00010000:00010000:2.0:1788460250.559112:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f800/0x5dfa74784542c60e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.559121:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f800/0x5dfa74784542c60e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.559128:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f800/0x5dfa74784542c60e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.559134:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac395f800 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:2.0:1788460250.559138:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f800/0x5dfa74784542c60e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.559145:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f800/0x5dfa74784542c60e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.559155:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8c4bfa9fe700) 00010000:00010000:2.0:1788460250.559158:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460250.559161:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f800/0x5dfa74784542c60e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.559167:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f800/0x5dfa74784542c60e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.559210:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395fc00/0x5dfa74784542c615 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.559217:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395fc00/0x5dfa74784542c615 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.559223:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395fc00/0x5dfa74784542c615 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.559229:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac395fc00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:2.0:1788460250.559231:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395fc00/0x5dfa74784542c615 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.559237:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395fc00/0x5dfa74784542c615 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.559245:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8c4bfa9fea00) 00010000:00010000:2.0:1788460250.559256:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460250.559260:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395fc00/0x5dfa74784542c615 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.559266:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395fc00/0x5dfa74784542c615 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18741 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.559279:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca6c00/0x5dfa74784542c6bd lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.559285:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca6c00/0x5dfa74784542c6bd lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.559290:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca6c00/0x5dfa74784542c6bd lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.559301:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc6ca6c00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:2.0:1788460250.559304:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca6c00/0x5dfa74784542c6bd lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.559311:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca6c00/0x5dfa74784542c6bd lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.559320:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8c4bef1fec00) 00010000:00010000:2.0:1788460250.559322:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460250.559325:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca6c00/0x5dfa74784542c6bd lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.559330:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca6c00/0x5dfa74784542c6bd lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.559345:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395ea00/0x5dfa74784542c742 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.559686:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395ea00/0x5dfa74784542c742 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.559693:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395ea00/0x5dfa74784542c742 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.559698:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac395ea00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:2.0:1788460250.559702:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395ea00/0x5dfa74784542c742 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.559709:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395ea00/0x5dfa74784542c742 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.559741:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c4bef1fea00) 00010000:00010000:2.0:1788460250.559743:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460250.559747:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395ea00/0x5dfa74784542c742 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.559753:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395ea00/0x5dfa74784542c742 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.559777:0:3646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7600/0x5dfa74784542c7b9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.559784:0:3646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7600/0x5dfa74784542c7b9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.559790:0:3646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7600/0x5dfa74784542c7b9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.559795:0:3646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc6ca7600 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:2.0:1788460250.559798:0:3646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7600/0x5dfa74784542c7b9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.559804:0:3646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7600/0x5dfa74784542c7b9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.559812:0:3646:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8c4bfa9fe900) 00010000:00010000:2.0:1788460250.559814:0:3646:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788460250.559817:0:3646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7600/0x5dfa74784542c7b9 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.559823:0:3646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7600/0x5dfa74784542c7b9 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17212 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460250.559860:0:18720:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022414720 00000100:00100000:2.0:1788460250.559868:0:18720:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022414720 00000100:00100000:2.0:1788460250.559933:0:18720:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788460250.559973:0:18720:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac39d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3661:x1875336022414720:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1788460250.560086:0:18720:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788460250.560089:0:18720:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1788460250.560091:0:18720:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788460250.560093:0:18720:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1788460249 -> 1788460249 00002000:00010000:2.0:1788460250.560096:0:18720:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1788460250.560153:0:18720:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac39d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3661:x1875336022414720:12345-0@lo:2:osp-syn-0-0.0 Request processed in 213us (1358us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1788460250.560161:0:18720:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000004:00080000:2.0:1788460250.560332:0:3661:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8c4ac39d1180/2, rc 0, transno 8589934596 00000100:00100000:2.0:1788460250.560339:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac39d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022414720:0@lo:2:osp-syn-0-0.0 00000100:00080000:0.0:1788460250.562784:0:17207:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788460250.577964:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460250.583187:0:19708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003461376 00000100:00100000:2.0:1788460250.583202:0:19708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003461376 00000100:00100000:3.0:1788460250.584198:0:18717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 23 00000100:00100000:3.0:1788460250.584212:0:18717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc532e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f3471709-a010-41d7-90bc-b8b3ea7c57b0+7:2393:x1875336003461376:12345-192.168.206.5@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788460250.584326:0:18717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc532e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f3471709-a010-41d7-90bc-b8b3ea7c57b0+7:2393:x1875336003461376:12345-192.168.206.5@tcp:16:lhsmtool_posix.0 Request processed in 117us (6385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460250.584334:0:18717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 23 00000100:00100000:2.0:1788460250.598482:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:1.0:1788460250.598579:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003461632 00000100:00100000:1.0:1788460250.598589:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003461632 00000100:00100000:1.0:1788460250.598643:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 62 00000100:00100000:1.0:1788460250.598653:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac43aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3471709-a010-41d7-90bc-b8b3ea7c57b0+15:15642:x1875336003461632:12345-192.168.206.5@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788460250.598699:0:17211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788460250.598725:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6381200/0x5dfa74784542c7ce lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab69 expref: 15 pid: 17213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460250.598743:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8c4bfa9fe900) 00010000:00010000:1.0:1788460250.598748:0:17211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788460250.598788:0:17211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6380400/0x5dfa74784542c7dc lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460250.598803:0:17211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6380400/0x5dfa74784542c7dc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460250.598812:0:17211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6380400/0x5dfa74784542c7dc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788460250.598929:0:17211:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005d1817e0 reply state 000000009d4b378b transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6380400/0x5dfa74784542c7dc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460250.598941:0:17211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6380400/0x5dfa74784542c7dc lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460250.599000:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8c4bfa9fe900) 00010000:00010000:1.0:1788460250.599002:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788460250.599005:0:17211:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788460250.599097:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac43aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3471709-a010-41d7-90bc-b8b3ea7c57b0+16:15642:x1875336003461632:12345-192.168.206.5@tcp:36:lhsmtool_posix.0 Request processed in 445us (622us total) trans 8589934615 rc 0/0 00000100:00100000:1.0:1788460250.599105:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 62 00000100:00100000:2.0:1788460250.611924:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460250.612089:0:19273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003461760 00000100:00100000:0.0:1788460250.612098:0:19273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003461760 00000100:00100000:0.0:1788460250.612147:0:19273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 24 00000100:00100000:0.0:1788460250.612156:0:19273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bc6eeb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f3471709-a010-41d7-90bc-b8b3ea7c57b0+7:15642:x1875336003461760:12345-192.168.206.5@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788460250.612172:0:19273:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788460250.612186:0:19273:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000194c07b1/0x5dfa74784542c7e3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794ab77 expref: -99 pid: 19273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460250.612223:0:19273:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d609de44/0x5dfa74784542c7d5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab70 expref: 8 pid: 19273 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460250.612232:0:19273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460250.612236:0:19273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460250.612242:0:19273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000194c07b1/0x5dfa74784542c7e3 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab77 expref: 8 pid: 19273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460250.612452:0:19273:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d609de44/0x5dfa74784542c7d5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab70 expref: 8 pid: 19273 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460250.612465:0:19273:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d609de44/0x5dfa74784542c7d5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab70 expref: 8 pid: 19273 timeout: 647 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460250.612490:0:19273:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc532d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:19273:1875336022414848:192.168.206.5@tcp:104: 00000100:00100000:0.0:1788460250.612566:0:19273:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc66a7300 going to sleep for 11 seconds 00000100:00100000:1.0:1788460250.617985:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460250.618113:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003461888 00000100:00100000:2.0:1788460250.618121:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003461888 00010000:00010000:2.0:1788460250.618157:0:17198:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d609de44/0x5dfa74784542c7d5 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab70 expref: 9 pid: 19273 timeout: 647 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460250.618204:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 21 00000100:00100000:2.0:1788460250.618215:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f3471709-a010-41d7-90bc-b8b3ea7c57b0+9:2394:x1875336003461888:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788460250.618231:0:17198:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788460250.618265:0:17198:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d609de44/0x5dfa74784542c7d5 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab70 expref: 9 pid: 19273 timeout: 647 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.618279:0:17198:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d609de44/0x5dfa74784542c7d5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab70 expref: 9 pid: 19273 timeout: 647 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.618302:0:17198:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788460250.618318:0:17198:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788460250.618325:0:17198:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000194c07b1/0x5dfa74784542c7e3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab77 expref: 9 pid: 19273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.618335:0:17198:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000194c07b1/0x5dfa74784542c7e3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab77 expref: 9 pid: 19273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.618381:0:17198:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000194c07b1/0x5dfa74784542c7e3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab77 expref: 9 pid: 19273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460250.618395:0:17198:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac43aad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:17198:1875336022414976:192.168.206.5@tcp:105: 00000100:00100000:2.0:1788460250.618465:0:17198:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc62d8000 going to sleep for 11 seconds 00010000:00010000:0.0:1788460250.618928:0:19273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d609de44/0x5dfa74784542c7d5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab70 expref: 9 pid: 19273 timeout: 647 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460250.618991:0:19273:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc532d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:19273:1875336022414848:192.168.206.5@tcp:104: 00010000:00010000:0.0:1788460250.619013:0:19273:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000194c07b1/0x5dfa74784542c7e3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab77 expref: 8 pid: 19273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460250.619023:0:19273:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bef208600, rc 0) 00000100:00100000:0.0:1788460250.619058:0:19273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bc6eeb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f3471709-a010-41d7-90bc-b8b3ea7c57b0+8:15642:x1875336003461760:12345-192.168.206.5@tcp:101:lhsmtool_posix.0 Request processed in 6903us (7143us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460250.619065:0:19273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 24 00000100:00100000:1.0:1788460250.624063:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460250.624170:0:17198:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac43aad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:17198:1875336022414976:192.168.206.5@tcp:105: 00010000:00010000:2.0:1788460250.624193:0:17198:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788460250.624256:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f3471709-a010-41d7-90bc-b8b3ea7c57b0+7:2394:x1875336003461888:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 6043us (6311us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460250.624268:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 21 00000100:00100000:0.0:1788460250.624599:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003462016 00000100:00100000:0.0:1788460250.624607:0:18719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003462016 00000100:00100000:0.0:1788460250.624654:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 25 00000100:00100000:0.0:1788460250.624664:0:18719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f3471709-a010-41d7-90bc-b8b3ea7c57b0+7:2393:x1875336003462016:12345-192.168.206.5@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788460250.624833:0:18719:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788460250.624837:0:18719:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1788460248 00002000:00010000:0.0:1788460250.624840:0:18719:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 1788460247 00002000:00010000:0.0:1788460250.624842:0:18719:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1788460249 -> 1788460248 00002000:00010000:0.0:1788460250.624845:0:18719:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1788460250.624879:0:18719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f3471709-a010-41d7-90bc-b8b3ea7c57b0+8:2393:x1875336003462016:12345-192.168.206.5@tcp:2:lhsmtool_posix.0 Request processed in 216us (824us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1788460250.624898:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 25 00000100:00100000:1.0:1788460250.628856:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460250.629016:0:19708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003462144 00000100:00100000:0.0:1788460250.629025:0:19708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003462144 00000100:00100000:0.0:1788460250.629117:0:19708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 26 00000100:00100000:0.0:1788460250.629128:0:19708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f3471709-a010-41d7-90bc-b8b3ea7c57b0+8:2393:x1875336003462144:12345-192.168.206.5@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788460250.629169:0:19708:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d609de44/0x5dfa74784542c7ea lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460250.629188:0:19708:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000194c07b1/0x5dfa74784542c7e3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab77 expref: 8 pid: 19273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460250.629207:0:19708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460250.629212:0:19708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788460250.629217:0:19708:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d609de44/0x5dfa74784542c7ea lrc: 4/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460250.629253:0:19708:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000194c07b1/0x5dfa74784542c7e3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab77 expref: 8 pid: 19273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460250.629267:0:19708:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000194c07b1/0x5dfa74784542c7e3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab77 expref: 8 pid: 19273 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460250.629281:0:19708:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc532d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:19708:1875336022415104:192.168.206.5@tcp:104: 00000100:00100000:0.0:1788460250.629589:0:19708:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc66a7300 going to sleep for 11 seconds 00000100:00100000:1.0:1788460250.632882:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460250.632989:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003462272 00000100:00100000:3.0:1788460250.632998:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003462272 00010000:00010000:3.0:1788460250.633036:0:17197:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000194c07b1/0x5dfa74784542c7e3 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab77 expref: 9 pid: 19273 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460250.633078:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 22 00000100:00100000:3.0:1788460250.633101:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f3471709-a010-41d7-90bc-b8b3ea7c57b0+9:2393:x1875336003462272:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788460250.633115:0:17197:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788460250.633135:0:17197:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000194c07b1/0x5dfa74784542c7e3 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab77 expref: 9 pid: 19273 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460250.633148:0:17197:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000194c07b1/0x5dfa74784542c7e3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab77 expref: 9 pid: 19273 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460250.633170:0:17197:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788460250.633175:0:17197:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788460250.633181:0:17197:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d609de44/0x5dfa74784542c7ea lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 19708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460250.633190:0:17197:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d609de44/0x5dfa74784542c7ea lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 19708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460250.634683:0:19708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000194c07b1/0x5dfa74784542c7e3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab77 expref: 9 pid: 19273 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460250.634721:0:19708:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc532d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:19708:1875336022415104:192.168.206.5@tcp:104: 00010000:00010000:0.0:1788460250.636651:0:19708:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d609de44/0x5dfa74784542c7ea lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460250.636666:0:17197:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788460250.636669:0:19708:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d609de44/0x5dfa74784542c7ea lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460250.636678:0:19708:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d609de44/0x5dfa74784542c7ea lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460250.636707:0:19708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000d609de44/0x5dfa74784542c7ea lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460250.636716:0:19708:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d609de44/0x5dfa74784542c7ea lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460250.636724:0:19708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d609de44/0x5dfa74784542c7ea lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460250.636730:0:19708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bef209800 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:0.0:1788460250.636734:0:19708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d609de44/0x5dfa74784542c7ea lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460250.636743:0:19708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d609de44/0x5dfa74784542c7ea lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460250.636785:0:19708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d609de44/0x5dfa74784542c7ea lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460250.636794:0:19708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d609de44/0x5dfa74784542c7ea lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19708 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788460250.636858:0:19708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f3471709-a010-41d7-90bc-b8b3ea7c57b0+8:2393:x1875336003462144:12345-192.168.206.5@tcp:1:lhsmtool_posix.0 Request processed in 7726us (8003us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460250.636859:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f3471709-a010-41d7-90bc-b8b3ea7c57b0+8:2393:x1875336003462272:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 3752us (3982us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460250.636880:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 22 00000100:00100000:0.0:1788460250.636881:0:19708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 26 00000100:00100000:1.0:1788460250.643567:0:3652:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460250.643749:0:17213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003462528 00000100:00100000:2.0:1788460250.643759:0:17213:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003462528 00000100:00100000:2.0:1788460250.643847:0:17213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 63 00000100:00100000:2.0:1788460250.643857:0:17213:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3471709-a010-41d7-90bc-b8b3ea7c57b0+16:15642:x1875336003462528:12345-192.168.206.5@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788460250.643936:0:17213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395fc00/0x5dfa74784542c7f1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.644130:0:17213:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6380000/0x5dfa74784542c73b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab38 expref: 16 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.644139:0:17213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395fc00/0x5dfa74784542c7f1 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.644173:0:17213:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6380000/0x5dfa74784542c73b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab38 expref: 16 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.644185:0:17213:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6380000/0x5dfa74784542c73b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab38 expref: 16 pid: 18741 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460250.644197:0:17213:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac43aad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17213:1875336022415232:192.168.206.5@tcp:104: 00000100:00100000:2.0:1788460250.644369:0:17213:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc62d8000 going to sleep for 11 seconds 00000100:00100000:1.0:1788460250.647671:0:3654:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460250.647756:0:20239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003462656 00000100:00100000:3.0:1788460250.647776:0:20239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003462656 00010000:00010000:3.0:1788460250.647812:0:20239:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6380000/0x5dfa74784542c73b lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab38 expref: 17 pid: 18741 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460250.647858:0:20239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 23 00000100:00100000:3.0:1788460250.647867:0:20239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac1e66850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f3471709-a010-41d7-90bc-b8b3ea7c57b0+17:2393:x1875336003462656:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788460250.647895:0:20239:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788460250.647902:0:20239:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6380000/0x5dfa74784542c73b lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab38 expref: 17 pid: 18741 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460250.647916:0:20239:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6380000/0x5dfa74784542c73b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab38 expref: 17 pid: 18741 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460250.647936:0:20239:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c4bef1fea00) 00010000:00010000:3.0:1788460250.647989:0:20239:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6380600/0x5dfa74784542c757 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab46 expref: 17 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460250.648001:0:20239:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395fc00/0x5dfa74784542c7f1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460250.648009:0:20239:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395fc00/0x5dfa74784542c7f1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460250.648016:0:20239:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395fc00/0x5dfa74784542c7f1 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460250.648037:0:20239:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788460250.648082:0:20239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac1e66850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f3471709-a010-41d7-90bc-b8b3ea7c57b0+17:2393:x1875336003462656:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 215us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460250.648090:0:20239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 23 00010000:00010000:2.0:1788460250.648435:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6380000/0x5dfa74784542c73b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab38 expref: 16 pid: 18741 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460250.648453:0:17213:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac43aad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17213:1875336022415232:192.168.206.5@tcp:104: 00010000:00010000:2.0:1788460250.648471:0:17213:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395fc00/0x5dfa74784542c7f1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.648480:0:17213:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395fc00/0x5dfa74784542c7f1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.648497:0:17213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395fc00/0x5dfa74784542c7f1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.648679:0:17213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f800/0x5dfa74784542c7f8 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.648692:0:17213:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7000/0x5dfa74784542c7c0 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab62 expref: 16 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.648700:0:17213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f800/0x5dfa74784542c7f8 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.648728:0:17213:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7000/0x5dfa74784542c7c0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab62 expref: 16 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.648742:0:17213:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7000/0x5dfa74784542c7c0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab62 expref: 16 pid: 18741 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460250.648755:0:17213:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac43aad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17213:1875336022415360:192.168.206.5@tcp:104: 00000100:00100000:2.0:1788460250.648817:0:17213:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bc62d8840 going to sleep for 11 seconds 00000100:00100000:1.0:1788460250.653150:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460250.654154:0:17199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003462784 00000100:00100000:3.0:1788460250.654165:0:17199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003462784 00010000:00010000:3.0:1788460250.654207:0:17199:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7000/0x5dfa74784542c7c0 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab62 expref: 17 pid: 18741 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460250.654274:0:17199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 24 00000100:00100000:3.0:1788460250.654283:0:17199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f3471709-a010-41d7-90bc-b8b3ea7c57b0+17:2394:x1875336003462784:12345-192.168.206.5@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788460250.654298:0:17199:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788460250.654316:0:17199:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7000/0x5dfa74784542c7c0 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab62 expref: 17 pid: 18741 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460250.654329:0:17199:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7000/0x5dfa74784542c7c0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab62 expref: 17 pid: 18741 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460250.654505:0:17199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8c4bfa9fe900) 00010000:00010000:3.0:1788460250.654511:0:17199:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f800/0x5dfa74784542c7f8 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460250.654522:0:17199:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f800/0x5dfa74784542c7f8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460250.654529:0:17199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f800/0x5dfa74784542c7f8 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460250.654552:0:17199:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788460250.654677:0:17199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f3471709-a010-41d7-90bc-b8b3ea7c57b0+17:2394:x1875336003462784:12345-192.168.206.5@tcp:103:ldlm_bl.0 Request processed in 393us (1740us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460250.654697:0:17199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 24 00010000:00010000:2.0:1788460250.655190:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7000/0x5dfa74784542c7c0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab62 expref: 16 pid: 18741 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460250.655209:0:17213:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac43aad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17213:1875336022415360:192.168.206.5@tcp:104: 00010000:00010000:2.0:1788460250.655229:0:17213:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f800/0x5dfa74784542c7f8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.655239:0:17213:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f800/0x5dfa74784542c7f8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.655258:0:17213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f800/0x5dfa74784542c7f8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788460250.655481:0:17213:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:2.0:1788460250.655592:0:17213:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1788460250.655628:0:17213:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1788460250.655863:0:17213:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac43aad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17213:1875336022415488:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788460250.655927:0:17213:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460250.656157:0:17213:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4bd16eb840 going to sleep for 11 seconds 00000100:00100000:1.0:1788460250.657593:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022415488 00000100:00100000:1.0:1788460250.657606:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022415488 00000100:00100000:1.0:1788460250.657724:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788460250.657734:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac43a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17213:x1875336022415488:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788460250.657871:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac43a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17213:x1875336022415488:12345-0@lo:1000:mdt00_002.0 Request processed in 138us (1942us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460250.657878:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788460250.658163:0:17213:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac43aad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17213:1875336022415488:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1788460250.658403:0:17213:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1788460250.658470:0:17213:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac43aad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17213:1875336022415616:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788460250.658507:0:17213:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460250.658873:0:17213:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4befc1a240 going to sleep for 11 seconds 00000100:00100000:0.0:1788460250.659130:0:17216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022415616 00000100:00100000:0.0:1788460250.659137:0:17216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022415616 00000100:00100000:0.0:1788460250.659171:0:17216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788460250.659179:0:17216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac43a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17213:x1875336022415616:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788460250.659467:0:17216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac43a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:17213:x1875336022415616:12345-0@lo:1000:mdt00_002.0 Request processed in 289us (960us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1788460250.659475:0:17216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788460250.659573:0:17213:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac43aad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17213:1875336022415616:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1788460250.659612:0:17213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f800/0x5dfa74784542c7f8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.659621:0:17213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f800/0x5dfa74784542c7f8 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.659628:0:17213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f800/0x5dfa74784542c7f8 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.659634:0:17213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac395f800 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:2.0:1788460250.659638:0:17213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f800/0x5dfa74784542c7f8 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.659659:0:17213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f800/0x5dfa74784542c7f8 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.659674:0:17213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8c4bfa9fe900) 00010000:00010000:2.0:1788460250.659678:0:17213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788460250.659683:0:17213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f800/0x5dfa74784542c7f8 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.659829:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f800/0x5dfa74784542c7f8 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.659863:0:17213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209e00/0x5dfa74784542c750 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.659870:0:17213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209e00/0x5dfa74784542c750 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.659876:0:17213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209e00/0x5dfa74784542c750 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.659881:0:17213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bef209e00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:2.0:1788460250.659885:0:17213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209e00/0x5dfa74784542c750 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.659891:0:17213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209e00/0x5dfa74784542c750 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.659900:0:17213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c4bef1fea00) 00010000:00010000:2.0:1788460250.659902:0:17213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788460250.659910:0:17213:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6380600/0x5dfa74784542c757 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab46 expref: 19 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.659933:0:17213:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6380600/0x5dfa74784542c757 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab46 expref: 19 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.660088:0:17213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6380600/0x5dfa74784542c757 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab46 expref: 19 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.660149:0:17213:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6380600/0x5dfa74784542c757 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab46 expref: 19 pid: 18741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460250.660163:0:17213:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac43a9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17213:1875336022415744:192.168.206.5@tcp:105: 00000100:00100000:2.0:1788460250.660327:0:17213:0:(client.c:2716:ptlrpc_set_wait()) set ffff8c4befc1a540 going to sleep for 11 seconds 00000100:00100000:1.0:1788460250.667466:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460250.670493:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003462912 00000100:00100000:3.0:1788460250.670506:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003462912 00000100:00100000:3.0:1788460250.670570:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 10 00000100:00100000:3.0:1788460250.670579:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3b19450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f3471709-a010-41d7-90bc-b8b3ea7c57b0+20:15641:x1875336003462912:12345-192.168.206.5@tcp:49:dd.0 00000100:00100000:2.0:1788460250.671501:0:17213:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac43a9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17213:1875336022415744:192.168.206.5@tcp:105: 00010000:00010000:2.0:1788460250.671528:0:17213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209e00/0x5dfa74784542c750 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.671538:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef209e00/0x5dfa74784542c750 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.671587:0:17213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f000/0x5dfa74784542c7ff lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.671600:0:17213:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f000/0x5dfa74784542c7ff lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.671610:0:17213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f000/0x5dfa74784542c7ff lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.671621:0:17213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f000/0x5dfa74784542c7ff lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.671637:0:17213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f000/0x5dfa74784542c7ff lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.671643:0:17213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f000/0x5dfa74784542c7ff lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.671649:0:17213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac395f000 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:2.0:1788460250.671653:0:17213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f000/0x5dfa74784542c7ff lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.671660:0:17213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f000/0x5dfa74784542c7ff lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.671671:0:17213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c4bef1fea00) 00010000:00010000:2.0:1788460250.671674:0:17213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788460250.671678:0:17213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f000/0x5dfa74784542c7ff lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.671695:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395f000/0x5dfa74784542c7ff lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.671709:0:17213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395fc00/0x5dfa74784542c7f1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.671715:0:17213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395fc00/0x5dfa74784542c7f1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.671721:0:17213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395fc00/0x5dfa74784542c7f1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460250.671836:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3b19450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f3471709-a010-41d7-90bc-b8b3ea7c57b0+20:15641:x1875336003462912:12345-192.168.206.5@tcp:49:dd.0 Request processed in 1255us (4376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460250.671846:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 10 00010000:00010000:2.0:1788460250.672904:0:17213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4ac395fc00 already unused, calling callback (ffffffffc18714f0) 00010000:00010000:2.0:1788460250.672919:0:17213:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395fc00/0x5dfa74784542c7f1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.672928:0:17213:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395fc00/0x5dfa74784542c7f1 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.672941:0:17213:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c4bef1fea00) 00010000:00010000:2.0:1788460250.672960:0:17213:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788460250.672966:0:17213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395fc00/0x5dfa74784542c7f1 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788460250.672972:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4ac395fc00/0x5dfa74784542c7f1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17213 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788460250.673130:0:17213:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f3471709-a010-41d7-90bc-b8b3ea7c57b0+19:15642:x1875336003462528:12345-192.168.206.5@tcp:57:lhsmtool_posix.0 Request processed in 29272us (29569us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1788460250.673139:0:17213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 63 00000020:00080000:2.0:1788460250.673144:0:17213:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788460250.673860:0:17247:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788460250.673866:0:17247:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788460250.673882:0:17247:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788460250.673889:0:17247:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788460250.680248:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:3.0:1788460250.680434:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003463040 00000100:00100000:3.0:1788460250.680444:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003463040 00000100:00100000:3.0:1788460250.680498:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 64 00000100:00100000:3.0:1788460250.680508:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3471709-a010-41d7-90bc-b8b3ea7c57b0+19:15641:x1875336003463040:12345-192.168.206.5@tcp:101:dd.0 00010000:00010000:3.0:1788460250.680528:0:17211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788460250.680547:0:17211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca6400/0x5dfa74784542c806 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0d808c4a794ab7e expref: -99 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460250.680580:0:17211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7c00/0x5dfa74784542c80d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460250.680594:0:17211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7c00/0x5dfa74784542c80d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460250.680604:0:17211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7c00/0x5dfa74784542c80d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17211 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460250.681386:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460250.682201:0:17215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003463296 00000100:00100000:0.0:1788460250.682210:0:17215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003463296 00000100:00100000:0.0:1788460250.682257:0:17215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 11 00000100:00100000:0.0:1788460250.682265:0:17215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f3471709-a010-41d7-90bc-b8b3ea7c57b0+21:15642:x1875336003463296:12345-192.168.206.5@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788460250.683913:0:17215:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788460250.684009:0:17215:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:0.0:1788460250.684060:0:17215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208a00/0x5dfa74784542c814 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460250.684077:0:17215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208a00/0x5dfa74784542c814 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460250.684088:0:17215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208a00/0x5dfa74784542c814 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460250.684096:0:17215:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208a00/0x5dfa74784542c814 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460250.684102:0:17215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208a00/0x5dfa74784542c814 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460250.684107:0:17215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208a00/0x5dfa74784542c814 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460250.684131:0:17215:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788460250.684231:0:17215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f3471709-a010-41d7-90bc-b8b3ea7c57b0+23:15642:x1875336003463296:12345-192.168.206.5@tcp:35:lhsmtool_posix.0 Request processed in 1962us (2844us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1788460250.684241:0:17215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 11 00000020:00080000:0.0:1788460250.684246:0:17215:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788460250.684308:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca6400/0x5dfa74784542c806 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab7e expref: 23 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460250.684337:0:17211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bc6ca7c00/0x5dfa74784542c80d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.5@tcp remote: 0xe0d808c4a794ab7e expref: 22 pid: 17211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460250.684346:0:17211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8c4bef1fea00) 00010000:00010000:0.0:1788460250.684364:0:17211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788460250.684369:0:17211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8c4bc6ca7c00, rc 0) 00000100:00100000:0.0:1788460250.684399:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f3471709-a010-41d7-90bc-b8b3ea7c57b0+22:15641:x1875336003463040:12345-192.168.206.5@tcp:101:dd.0 Request processed in 3892us (4158us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460250.684405:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 64 00010000:00010000:3.0:1788460250.684759:0:17201:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788460250.684776:0:17201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208a00/0x5dfa74784542c814 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460250.684783:0:17201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bef208a00 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:3.0:1788460250.684787:0:17201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208a00/0x5dfa74784542c814 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460250.684795:0:17201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208a00/0x5dfa74784542c814 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460250.684813:0:17201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8c4bfa9fe900) 00010000:00010000:3.0:1788460250.684816:0:17201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788460250.684820:0:17201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208a00/0x5dfa74784542c814 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460250.684826:0:17201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8c4bef208a00/0x5dfa74784542c814 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17215 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460250.684838:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460250.684839:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788460250.684841:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788460250.930214:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:0.0:1788460250.930322:0:18723:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003463424 00000100:00100000:0.0:1788460250.930332:0:18723:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003463424 00000100:00100000:0.0:1788460250.930405:0:18723:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 0 00000100:00100000:0.0:1788460250.930416:0:18723:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f3471709-a010-41d7-90bc-b8b3ea7c57b0+7:2395:x1875336003463424:12345-192.168.206.5@tcp:4:dd.0 00002000:00010000:0.0:1788460250.930471:0:18723:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x6a99bcd8, atime: 0x6a99bcd7, ctime: 0x6a99bcd8, blocks: 0x0 00010000:00010000:0.0:1788460250.930480:0:18723:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061419026/0x5dfa74784542c81b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460250.930496:0:18723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=548s v=(0 0) 00010000:00010000:0.0:1788460250.930501:0:18723:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788460250.930507:0:18723:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061419026/0x5dfa74784542c81b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788460250.930525:0:18723:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061419026/0x5dfa74784542c81b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788460250.942083:0:3653:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.5@tcp (source: 12345-192.168.206.5@tcp) 00000100:00100000:2.0:1788460250.942306:0:18725:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1788460250.942316:0:18725:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:2.0:1788460250.943000:0:18725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336003463552 00000100:00100000:2.0:1788460250.943011:0:18725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336003463552 00000100:00100000:1.0:1788460250.943609:0:20353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.5@tcp, seq: 1 00000100:00100000:1.0:1788460250.943622:0:20353:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac39d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f3471709-a010-41d7-90bc-b8b3ea7c57b0+9:2396:x1875336003463552:12345-192.168.206.5@tcp:4:dd.0 00010000:00010000:1.0:1788460250.943657:0:20353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dee93afb/0x5dfa74784542c822 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460250.943673:0:20353:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460250.943678:0:20353:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788460250.943694:0:20353:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dee93afb/0x5dfa74784542c822 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460250.943708:0:20353:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dee93afb/0x5dfa74784542c822 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788460251.025589:0:18366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788460251.031820:0:18714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00000001:00080000:2.0:1788460251.031833:0:18714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00000001:00080000:2.0:1788460251.033409:0:18714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00002000:00010000:1.0:1788460251.033576:0:18723:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:1.0:1788460251.033581:0:18723:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 1788460248 -> 1788460249 00002000:00010000:1.0:1788460251.033584:0:18723:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1788460248 -> 1788460249 00002000:00010000:1.0:1788460251.033586:0:18723:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8192 00010000:00010000:1.0:1788460251.033602:0:18723:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061419026/0x5dfa74784542c81b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460251.033614:0:18723:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000061419026/0x5dfa74784542c81b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460251.033623:0:18723:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000061419026/0x5dfa74784542c81b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460251.033637:0:18723:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bef208e00 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:1.0:1788460251.033642:0:18723:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000061419026/0x5dfa74784542c81b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460251.033651:0:18723:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000061419026/0x5dfa74784542c81b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460251.033671:0:18723:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000061419026/0x5dfa74784542c81b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460251.033689:0:18723:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061419026/0x5dfa74784542c81b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18723 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460251.037523:0:18723:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f3471709-a010-41d7-90bc-b8b3ea7c57b0+9:2395:x1875336003463424:12345-192.168.206.5@tcp:4:dd.0 Request processed in 107099us (107306us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1788460251.037537:0:18723:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 0 00000001:00080000:3.0:1788460251.047631:0:18714:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00002000:00010000:1.0:1788460251.047814:0:20353:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 4194304 -> 7654321 00002000:00010000:1.0:1788460251.047820:0:20353:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 8192 -> 14952 00010000:00010000:1.0:1788460251.047835:0:20353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dee93afb/0x5dfa74784542c822 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460251.047847:0:20353:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dee93afb/0x5dfa74784542c822 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460251.047856:0:20353:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dee93afb/0x5dfa74784542c822 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460251.047876:0:20353:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8c4bc6381800 already unused, calling callback (ffffffffc0c5a700) 00010000:00010000:1.0:1788460251.047881:0:20353:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dee93afb/0x5dfa74784542c822 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460251.047890:0:20353:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dee93afb/0x5dfa74784542c822 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460251.047908:0:20353:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dee93afb/0x5dfa74784542c822 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788460251.047916:0:20353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dee93afb/0x5dfa74784542c822 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788460251.048046:0:20353:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac39d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f3471709-a010-41d7-90bc-b8b3ea7c57b0+5:2396:x1875336003463552:12345-192.168.206.5@tcp:4:dd.0 Request processed in 104423us (105978us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1788460251.048056:0:20353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.5@tcp, seq: 1 00000100:00100000:1.0:1788460251.730131:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac41bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022415872:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788460251.730200:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460251.730240:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc532ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022416384:0@lo:400:kworker.0 00000100:00100000:0.0:1788460251.730260:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc532d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022416256:0@lo:400:kworker.0 00000100:00100000:1.0:1788460251.730286:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460251.730316:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc532d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c482be18-c056-4068-8a37-ed5038fc364a:3660:1875336022416000:0@lo:400:kworker.0 00000100:00100000:2.0:1788460251.730534:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc532e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022416128:0@lo:400:kworker.0 00000100:00100000:3.0:1788460251.732110:0:19707:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022415872 00000100:00100000:3.0:1788460251.732123:0:19707:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022415872 00000100:00100000:3.0:1788460251.732183:0:19707:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788460251.732195:0:19707:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac41bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022415872:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788460251.732224:0:19707:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00080000:0.0:1788460251.743880:0:17207:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788460251.743973:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460251.744036:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc532f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3660:1875336022416512:0@lo:400:kworker.0 00000100:00100000:0.0:1788460251.744089:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460251.744116:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3660:1875336022417024:0@lo:400:kworker.0 00000100:00100000:0.0:1788460251.744138:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460251.744159:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac3672a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3660:1875336022417536:0@lo:400:kworker.0 00000100:00100000:0.0:1788460251.744180:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460251.744437:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460251.744461:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc532dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022416768:0@lo:400:kworker.0 00000100:00100000:0.0:1788460251.744488:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460251.744508:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3662:1875336022417280:0@lo:400:kworker.0 00000100:00100000:0.0:1788460251.744530:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788460251.744563:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022416384 00000100:00100000:0.0:1788460251.744570:0:18719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022416384 00000100:00100000:0.0:1788460251.744619:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022416256 00000100:00100000:0.0:1788460251.744623:0:18719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022416256 00000100:00100000:0.0:1788460251.744640:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022416768 00000100:00100000:0.0:1788460251.744642:0:18719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022416768 00000100:00100000:0.0:1788460251.744659:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788460251.744667:0:18719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac42ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022416384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460251.744883:0:17205:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022416000 00000100:00100000:1.0:1788460251.744889:0:17205:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022416000 00000100:00100000:1.0:1788460251.744920:0:17205:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1788460251.744927:0:17205:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4bfc2e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+29:3660:x1875336022416000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460251.745014:0:17205:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4bfc2e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c482be18-c056-4068-8a37-ed5038fc364a+29:3660:x1875336022416000:12345-0@lo:400:kworker.0 Request processed in 87us (1044us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460251.745022:0:17205:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1788460251.745058:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022416896:0@lo:400:kworker.0 00000100:00100000:1.0:1788460251.745082:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460251.745095:0:3659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac490a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1875336022417408:0@lo:400:kworker.0 00000100:00100000:1.0:1788460251.745114:0:3659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460251.745150:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc532d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c482be18-c056-4068-8a37-ed5038fc364a:3660:1875336022416000:0@lo:400:kworker.0 00000100:00100000:1.0:1788460251.745254:0:19273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022416896 00000100:00100000:1.0:1788460251.745273:0:19273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022416896 00000100:00100000:1.0:1788460251.745294:0:19273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788460251.745301:0:19273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4284a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3662:x1875336022416256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460251.745339:0:19273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4284a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3662:x1875336022416256:12345-0@lo:400:kworker.0 Request processed in 38us (903us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460251.745346:0:19273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788460251.745359:0:19273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788460251.745365:0:19273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4285880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022416768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460251.745392:0:19273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4285880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3662:x1875336022416768:12345-0@lo:400:kworker.0 Request processed in 28us (903us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460251.745398:0:19273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788460251.745409:0:19273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788460251.745415:0:19273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac42fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3659:x1875336022416896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460251.745444:0:19273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac42fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3659:x1875336022416896:12345-0@lo:400:kworker.0 Request processed in 30us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460251.745459:0:19273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788460251.745487:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022416896:0@lo:400:kworker.0 00000100:00100000:1.0:1788460251.745506:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022416512 00000100:00100000:1.0:1788460251.745510:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022416512 00000100:00100000:1.0:1788460251.745529:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022417024 00000100:00100000:1.0:1788460251.745532:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022417024 00000100:00100000:1.0:1788460251.745541:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022417536 00000100:00100000:1.0:1788460251.745544:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022417536 00000100:00100000:1.0:1788460251.745556:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022417280 00000100:00100000:1.0:1788460251.745559:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022417280 00000100:00100000:1.0:1788460251.745569:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022417408 00000100:00100000:1.0:1788460251.745571:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022417408 00000100:00100000:1.0:1788460251.745583:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788460251.745589:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3671c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1875336022416512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460251.745624:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3671c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3660:x1875336022416512:12345-0@lo:400:kworker.0 Request processed in 35us (1534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460251.745630:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788460251.745641:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788460251.745647:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3670a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1875336022417024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460251.745672:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3670a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3660:x1875336022417024:12345-0@lo:400:kworker.0 Request processed in 26us (1534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460251.745678:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788460251.745689:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788460251.745695:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac3670e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1875336022417536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460251.745722:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac3670e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3660:x1875336022417536:12345-0@lo:400:kworker.0 Request processed in 27us (1541us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460251.745728:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788460251.745747:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788460251.745753:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac4287100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875336022417280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460251.745793:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac4287100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3662:x1875336022417280:12345-0@lo:400:kworker.0 Request processed in 40us (1262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460251.745799:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788460251.745810:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788460251.745816:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac42ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1875336022417408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788460251.745845:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac42ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3659:x1875336022417408:12345-0@lo:400:kworker.0 Request processed in 30us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460251.745851:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788460251.745875:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac490a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3659:1875336022417408:0@lo:400:kworker.0 00000100:00100000:1.0:1788460251.745902:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc532f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3660:1875336022416512:0@lo:400:kworker.0 00000100:00100000:1.0:1788460251.745912:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3660:1875336022417024:0@lo:400:kworker.0 00010000:00080000:1.0:1788460251.745929:0:3660:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4ac3672a00 x1875336022417536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460267 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460251.745939:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac3672a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3660:1875336022417536:0@lo:400:kworker.0 00000100:00080000:1.0:1788460251.745994:0:17207:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788460251.746004:0:17207:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788460251.746007:0:17207:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788460251.746009:0:17207:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788460251.746032:0:3662:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:1.0:1788460251.746038:0:3662:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8c4ac39d1180, transno 8589934596 00000004:00080000:1.0:1788460251.746050:0:3662:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:1.0:1788460251.746066:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc532d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022416256:0@lo:400:kworker.0 00000100:00100000:1.0:1788460251.746089:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc532dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3662:1875336022416768:0@lo:400:kworker.0 00010000:00080000:1.0:1788460251.746099:0:3662:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8c4bf75e2a00 x1875336022417280/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788460267 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788460251.746108:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3662:1875336022417280:0@lo:400:kworker.0 00000100:00100000:1.0:1788460251.746555:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac42fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022417792:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788460251.746588:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460251.746618:0:3662:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788460251.746624:0:3662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac42fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022417664:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788460251.746647:0:3662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460251.746671:0:18721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022417792 00000100:00100000:1.0:1788460251.746676:0:18721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022417792 00000100:00100000:1.0:1788460251.746696:0:18721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022417664 00000100:00100000:1.0:1788460251.746698:0:18721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022417664 00000100:00100000:1.0:1788460251.746709:0:18721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788460251.746715:0:18721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac42fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3662:x1875336022417792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788460251.746729:0:18721:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788460251.746777:0:18721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac42fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3662:x1875336022417792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460251.746783:0:18721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788460251.746795:0:18721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788460251.746802:0:18721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac42fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875336022417664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788460251.746810:0:18721:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3923505152 avail 3684278272 00000100:00100000:1.0:1788460251.746834:0:18721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac42fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3662:x1875336022417664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 33us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460251.746839:0:18721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788460251.746877:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac42fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022417664:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788460251.746887:0:3662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac42fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3662:1875336022417792:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788460251.747532:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460251.747556:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bc532ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022416640:0@lo:400:kworker.0 00000100:00100000:2.0:1788460251.747579:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460251.747603:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022416128 00000100:00100000:2.0:1788460251.747617:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022416128 00000100:00100000:2.0:1788460251.747645:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022416640 00000100:00100000:2.0:1788460251.747648:0:17217:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022416640 00000100:00100000:2.0:1788460251.747660:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788460251.747665:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac43a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1875336022416128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460251.747700:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac43a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3661:x1875336022416128:12345-0@lo:400:kworker.0 Request processed in 34us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460251.747706:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788460251.747719:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788460251.747725:0:17217:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac43a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022416640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460251.747749:0:17217:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac43a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3661:x1875336022416640:12345-0@lo:400:kworker.0 Request processed in 24us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460251.747767:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788460251.747797:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc532ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3661:1875336022416640:0@lo:400:kworker.0 00000100:00100000:2.0:1788460251.747804:0:3661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4bf75e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3661:1875336022417152:0@lo:400:kworker.0 00000100:00100000:2.0:1788460251.747826:0:3661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788460251.747859:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc532e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3661:1875336022416128:0@lo:400:kworker.0 00000100:00100000:2.0:1788460251.747876:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022417152 00000100:00100000:2.0:1788460251.747879:0:17211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022417152 00000100:00080000:2.0:1788460251.747896:0:17207:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788460251.747919:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788460251.747925:0:17211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac43a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1875336022417152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788460251.747975:0:17211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac43a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3661:x1875336022417152:12345-0@lo:400:kworker.0 Request processed in 51us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1788460251.747982:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788460251.748006:0:3661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bf75e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3661:1875336022417152:0@lo:400:kworker.0 00000100:00100000:0.0:1788460251.749565:0:18719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac42ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3659:x1875336022416384:12345-0@lo:400:kworker.0 Request processed in 4891us (19271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788460251.749580:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788460251.749639:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4bc532ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3659:1875336022416384:0@lo:400:kworker.0 00000100:00100000:3.0:1788460251.753524:0:19707:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac41bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3659:x1875336022415872:12345-0@lo:13:osp-pre-1-1.0 Request processed in 21323us (23314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788460251.753554:0:19707:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788460251.767150:0:3659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac41bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3659:1875336022415872:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788460252.060727:0:17200:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788460252.246871:0:17965:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:0.0:1788460252.633181:0:20390:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:3.0:1788460253.073148:0:17201:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788460253.777236:0:3660:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788460253.777257:0:3660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8c4ac42fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022417920:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788460253.777315:0:3660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788460253.777361:0:18721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875336022417920 00000100:00100000:1.0:1788460253.777367:0:18721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875336022417920 00000100:00100000:1.0:1788460253.777416:0:18721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788460253.777424:0:18721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8c4ac42fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022417920:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788460253.777450:0:18721:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1788460253.777492:0:18721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8c4ac42fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3660:x1875336022417920:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1788460253.777499:0:18721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788460253.777543:0:3660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8c4ac42fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3660:1875336022417920:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788460253.783316:0:17207:0:(pinger.c:507:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788460254.098837:0:18366:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 44962 lines, 44962 kept, 0 dropped, 0 bad.